Lead Data Engineer Senior Platform Engineer
Lead Data Engineer Senior Platform Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Lead Data Engineer (Senior Platform Engineer) Chicago IL (Onsite)
Specialization
-
- AWS Data Engineering Basic: Lead Data Engineer with Spark/Scala Java Kafka AWS
Job requirements
-
- Bachelors in Computer Science Engineering or related technical discipline or equivalent combination of training and experience
-
- 10 years programming experience: building application frameworks and backend systems for highvolume pipelines using Go/Java/Python. Python/Java preferred.
-
- 10 years experience building data frameworks platforms and scaling them to large volume of data using message brokers. Kafka experience is must.
-
- 5 years experience building streaming platform using Apache Kafka Confluent Kafka AWS Managed Kafka Service.
-
- 5 years experience ingesting data from SQL Server/My SQL/Oracle using Change Data Capture debezium and Kafka Connect.
-
- 2 years experience using AWS Data Services: any combination of DMS EMR Glue Athena S3 CloudWatch Lambda or IAM
-
- 1year exp. with data architecture ETL and processing of structured and unstructured data
-
- 2 years experience with DevOps tools (any combination of GitHub TravisCI or Jira) and methodologies (Lean Agile Scrum Test Driven Development)
Specialization AWS Data Engineering Basic: Lead Data Engineer with Spark/Scala + Java + Kafka + AWS Job requirements Bachelor s in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience 10+ years programming experience: building application frameworks, and back-end systems for high-volume pipelines using Go/Java/Python. Python/Java preferred. 10+ years experience building data frameworks, platforms and scaling them to large volume of data using message brokers. Kafka experience is must. 5+ years experience building streaming platform using Apache Kafka, Confluent Kafka, AWS Managed Kafka Service. 5+ years experience ingesting data from SQL Server/My SQL/Oracle using Change Data Capture, debezium, and Kafka Connect. 2 years experience using AWS Data Services: any combination of DMS, EMR, Glue, Athena, S3, CloudWatch, Lambda or IAM 1-year exp. with data architecture, ETL and processing of structured and unstructured data 2 years experience with DevOps tools (any combination of GitHub, TravisCI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)
Employment Type
Full Time
