Title: Lead Data Engineer (AWS) Technical Lead
Location: Newark NJ (Hybrid)
Job Description:
We are looking for a Lead AWS Data Engineer who has worked in highly scalable cloud environments. Lead design architect solution data projects based on business needs. Highly visible role interfacing with users and supporting business needs while leading a team of talented data engineers/developers.
Experience implementing software applications supporting data lakes data warehouses and data applications on AWS for large enterprises Programming experience with Python Shell scripting and SQL Solid experience of AWS services such as CloudFormation S3 Athena Glue EMR/Spark RDS Redshift DataSync DMS DynamoDB Lambda Step Functions IAM KMS SM etc. Candidates must have experience with AWS Step Functions. Solid experience implementing solutions on AWSbased data lakes. Experience in AWS data lake/data warehouse/business analytics Experience in system analysis design development and implementation of data ingestion pipeline in AWS Knowledge of ETL/ELT Endtoend data solutions (ingest storage integration processing access) on AWS Architect and implement CI/CD strategy for EDP Implement high velocity streaming solutions using Amazon Kinesis SQS and Kafka (preferred) Migrate data from traditional relational database systems file systems NAS shares to AWS relational databases such as Amazon RDS Aurora and Redshift Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS Aurora and Redshift AWS Solutions Architect or AWS Developer Certification preferred
Requirements:
- 5 years of experience as Data application developer
- Experience developing business applications using NoSQL/SQL databases.
- Experience working with Object stores(S3) and JSON is must have
- MUST have good experience with AWS Services Glue Lambda Step Functions SQS DynamoDB S3 Redshift.
- Plus to have knowledge on Snowflake