Data Engineer
Springfield, VT - USA
Job Summary
Absolute Business Solutions Corp (ABSC) is a community of innovators engineers analysts and business professionals working with customers to tackle complex challenges. For more than 20 years we have supported critical DoD Intelligence Community and Federal Civilian missions as well as global commercial clients. Our work spans intelligence technology defense AI/ML and data science.
We are hiring a cleared Data Engineer to support NGAs Data Modernization Services (DMS) mission and related customer efforts. Youll build data pipelines and products develop or optimize analytical and machine learning solutions and help customers turn large complex datasets into useful insights.
Were interested in candidates with hands-on experience in Apache Spark. The right candidate may come from a data engineering software development data science or machine learning background and can work effectively with both technical teams and mission stakeholders.
Location: On-site in Herndon VA; Springfield VA
What Youll Do
- Build maintain and optimize data pipelines and data products for large-scale data processing.
- Develop solutions using Apache Spark.
- Ingest transform validate and prepare data for analytics machine learning and downstream applications.
- Develop deploy and maintain analytical or machine learning models where appropriate to the work.
- Apply statistical and data science methods to identify patterns answer customer questions and produce actionable insights.
- Tune data processing and Spark workloads for performance reliability and efficient storage.
- Work with distributed data systems data lakes and formats such as Parquet and Delta Lake.
- Integrate data products with databases APIs analytics platforms and AI/ML workflows.
- Explain findings and recommendations to nontechnical stakeholders and collaborate with engineering teams on implementation.
- Troubleshoot data quality pipeline and model issues in secure environments including air-gapped systems when required.
- Contribute to production-quality code documentation and collaborative development practices.
Required Qualifications
- Active TS/SCI security clearance with willingness to obtain and maintain counterintelligence polygraph.
- Bachelors degree and at least 2 years of relevant experience in data engineering software development data science analytics or machine learning; additional relevant experience may substitute for a degree.
- Hands-on experience with Apache Spark including PySpark or Scala
- Experience working with data using SQL and at least one programming or analytical language such as Python Java Scala or R.
- Experience building supporting or maintaining data pipelines analytical solutions or production software.
- Understanding of data quality validation and troubleshooting.
- Ability to work effectively with engineers analysts customers and other stakeholders.
- Strong written and verbal communication skills.
Preferred Qualifications
- 5 or more years of relevant experience particularly in data engineering or large-scale data processing.
- Experience with Delta Lake Parquet Structured Streaming or lakehouse architectures.
- Experience with distributed data systems or big data platforms such as Flink MapReduce EMR Dataproc Cloudera or Hortonworks.
- Experience with containers and orchestration tools such as Docker and Kubernetes.
- Experience with object storage including S3-compatible systems.
- Experience developing deploying or maintaining machine learning models and AI/ML data pipelines.
- Familiarity with orchestration tools such as Airflow dbt or NiFi.
- Experience with cloud platforms such as AWS GCP or Azure.
- Experience with CI/CD Git Jenkins REST APIs or infrastructure as code.
- Knowledge of statistics probability NLP image processing or A/B testing.
- Familiarity with LLMs and GPT models.
- Prior experience supporting NGA DoD or Intelligence Community programs.
- Experience presenting data-driven findings to customer or business stakeholders.
- Familiarity with JIRA Confluence or similar collaboration tools.
Compensation
The approximate salary range is $120000 - $225000 depending on work location responsibilities education experience skills and internal equity. Other factors may include applicable market data bargaining agreements and law.
Who We Are
ABSC combines the agility of a small business with proven processes refined over more than two decades. We support public-sector clients in Intelligence Defense Health and Safety helping advance innovation agility and security across their missions.
Some of our benefits include:
- Generous paid time off plus 11 federal holidays
- Fully vested 401(k) with company match
- Tuition assistance
- Annual health and wellness allowance
- Annual career development funds for education training and AI subscriptions
- Eight hours of paid volunteer time each year
- Charitable donation matching
- Internal and external referral bonuses
- Living Our Values awards
Apply to join our team. If you know someone seeking a new career opportunity please share this opening. External referrals are eligible for ABSCs referral program.
ABSC is a proud Virginia Values Veterans (V3) member and is committed to hiring veterans. Veterans are encouraged to include their service in their application.
ABSC is an Equal Opportunity Employer including veterans and individuals with disabilities.
Required Experience:
IC
About Company
Absolute Business Solutions Corp (ABSC) experts provide critical, time-sensitive and innovative solutions to complex problems facing the US Department of Defense and the Intelligence Community