Role: Data Engineer
Location: Plano TX Hybrid (Prefer local)
Duration: 6 months
Job Description
- 5 years of data engineering experience.
- Design develop and maintain efficient data pipelines for the extraction transformation and loading (ETL) of data from various sources (databases APIs flat files etc.)
- Solid experience writing clean concise tested maintainable code in Java.
- Experience building and deploying applications in AWS
- Experience orchestrating configdriven deployments using modern CI/CD tooling.
- Experience in sourcecontrol practices such as Git and infrastructure as code utilizing Terraform.
- Handson production experience working with Big Data platforms building and optimizing data pipelines that involve data processing and streaming platforms including work serverless architecture and queuing systems.
- Experience in test automation frameworks optimizing performance and security enabling delivery of robust and maintainable architecture.
- Experience in Agile practices and development techniques such as TDD BDD and CI/CD.
- Experience with MongoDB.
- Handson experience building and delivering Telematics or Connected Car products or solutions is a plus.
MUST HAVE:
- AWS Glue
- Python/Pyspark
- AWS Lambdas (Serverless architecture)
- MongoDB (Must have)