General Dynamics Information Technology Software Engineer, Expert w/Polygraph in Herndon, Virginia

Job Description

Work with a team performing entity correlation for critical systems. Support the migration of Big Data processing systems from local hardware to a cloud-based computing environment. Modernize legacy software and data analysis tools, and assist with the conversion of complex applications and shell scripts to a modular cloud-based system using Hadoop, Spark, and other tools. Identify methods for more precise entity correlation and evaluate the value and impact of new data sets. Analyze the benefits and drawbacks of new and emerging entity correlation, cloud computing, and big data technologies. Support special projects and new requirements as needed.

  • Analyzes existing software applications and tools, and recommends new technologies and methodologies to improve system performance and usability.

  • Designs, develops, tests, and deploys new software tools that extend or replace existing capabilities.

  • Modernizes legacy applications as part of the migration to a cloud-based computing environment.

  • Designs and implements cloud-native data processing capabilities using distributed computing technologies such as Spark, Hive, Hadoop, and NiFi.

  • Supports the design and development of a streaming data processing and entity correlation architecture.

  • Assists with the transition of existing batch processing systems to a near-real time streaming pipeline.

  • Maintains current knowledge of relevant technology.

  • Researches incorrectly correlated entities and identifies remediation strategies.

  • Test and documents performance benchmarks and metrics for developed software.


  • 5+ years of software development experience with a language such as Java, Scala, or Python.

  • Experience with Spark, Hive, Hadoop, and other big data processing technologies.

  • Experience with Linux-based systems and shell scripting.

  • Experience with application development and deployments with Amazon Web Services.

  • Experience analyzing large volumes of complex structured and unstructured data.

Desired skills:

  • Experience developing streaming data processing pipelines.

  • Familiarity with Databricks, Elastic Map Reduce, or Cloudera platforms and service offerings.

  • Background in data analysis, statistical analysis, machine learning, or data science.

  • Experience with entity resolution products or a background in data matching theory and technologies.

  1. Designs, develops, codes, tests, and debugs complex new software products, or makes significant enhancements to existing software.

  2. Researches and integrates design strategies, product specifications, development schedules, and user expectations into product capabilities.

  3. Resolves complex hardware/software compatibility and interface design considerations.

  4. Conducts investigations and tests of considerable complexity.

  5. Researches emerging technologies to determine impact on application execution.

  6. Provides input to staff involved in writing and updating technical documentation such as user manuals, system documentation, and training materials.

  7. Troubleshoots complex problems and provides customer support for software operating systems and application issues.

  8. Advises hardware engineers on machine characteristics that affect software systems, such as storage capacity, processing speed, and input/output requirements.

  9. Prepares reports on analyses, findings, and project progress.

  10. Provides guidance and work leadership to less-experienced software engineers.

  11. May serve as a technical team or task leader.

  12. Maintains current knowledge of relevant technology as assigned.

  13. Participates in special projects as required.


Bachelors Degree in Computer Science, Engineering or a related technical discipline, or the equivalent combination of education, technical training, or work/military experience.


8-10 years of related software development experience.

As a trusted systems integrator for more than 50 years, General Dynamics Information Technology provides information technology (IT), systems engineering, professional services and simulation and training to customers in the defense, federal civilian government, health, homeland security, intelligence, state and local government and commercial sectors.With approximately 32,000 professionals worldwide, the company delivers IT enterprise solutions, manages large-scale, mission-critical IT programs and provides mission support services.GDIT is an Equal Opportunity/Affirmative Action Employer - Minorities/Females/Protected Veterans/Individuals with Disabilities.






Job ID2018-49147

Number of Positions1

Job FunctionInformation Technology

Security Clearance LevelTop Secret/SCI with Polygraph

Full/Part TimeFull Time