AWS Data Engineer

Overview:

Key Responsibilities:

• Designing building and maintaining scalable data pipelines and ETL processes in AWS
• Optimizing data models and data architecture for performance and reliability
• Implementing data security and privacy measures in compliance with industry standards and regulations
• Developing and maintaining data infrastructure on AWS such as Redshift S3 Glue and EMR
• Collaborating with data scientists and analysts to support their data needs and analysis
• Monitoring troubleshooting and optimizing data workflows to ensure data quality and reliability
• Automating data processes and workflows to improve efficiency
• Implementing best practices for data governance storage and access control
• Supporting the integration of new data sources and technologies into the data ecosystem
• Documenting data pipelines workflows and processes for knowledge sharing and future reference
• Providing technical leadership and mentorship to junior data engineering team members
• Staying updated with the latest AWS data technologies and best practices
• Collaborating with crossfunctional teams to understand and address their data needs
• Participating in oncall support and incident response activities when necessary
• Contributing to the continuous improvement of data engineering processes and standards

Required Qualifications:

• Bachelors degree in Computer Science Engineering or a related field
• Proven experience in designing building and maintaining data solutions in AWS
• Strong proficiency in SQL ETL processes and data modeling
• Handson experience with AWS services such as Redshift S3 Glue EMR Lambda and Kinesis
• Proficiency in at least one programming language such as Python Java or Scala
• Experience with big data technologies and frameworks such as Hadoop Spark or Hive
• Knowledge of data warehousing concepts and best practices
• Experience in implementing data security and compliance measures in AWS
• Excellent problemsolving and troubleshooting skills related to data systems and workflows
• Effective communication and collaboration skills to work across teams and departments
• Ability to work in a fastpaced dynamic environment and manage multiple priorities
• Experience with version control systems and continuous integration/continuous deployment (CI/CD) pipelines
• Understanding of Agile methodologies and practices
• AWS certifications such as AWS Certified Big Data Specialty or AWS Certified Solutions Architect

aws,data engineering,etl,sql,python,big data,data modeling,data warehousing