Data Engineer Snowflake / Azure (ADLS ADF Synapse) /AWS
Overview:
The position of Data Engineer is crucial to our organizations data infrastructure. The individual will play a key role in designing implementing and maintaining data pipelines and systems utilizing Snowflake Azure (ADLS ADF Synapse) and AWS to ensure efficient data processing and retrieval.
Key Responsibilities:
- Design and develop data pipelines and ETL processes using Snowflake Azure (ADLS ADF Synapse) and AWS services.
- Collaborate with stakeholders to gather requirements and understand data needs.
- Implement data models and database schemas to support data storage and retrieval.
- Optimize and tune data processing and querying performance.
- Ensure data quality and integrity through data validation and testing.
- Implement and maintain data security and access controls.
- Monitor and troubleshoot data pipeline issues and performance bottlenecks.
- Provide technical guidance to junior team members and stakeholders.
- Document data infrastructure and processes for knowledge sharing and reference.
- Stay updated with the latest trends and best practices in data engineering.
Required Qualifications:
- Bachelors degree in Computer Science Engineering or related field.
- Proven work experience as a Data Engineer utilizing Snowflake Azure and AWS technologies.
- Strong proficiency in SQL and database management systems.
- Experience with data modeling and designing data warehouses.
- Handson experience with Azure Data Lake Storage Azure Data Factory and Azure Synapse Analytics.
- Familiarity with AWS data services such as S3 Glue and Redshift.
- Ability to write efficient ETL code using Python Scala or other relevant languages.
- Understanding of distributed computing and big data technologies.
- Excellent problemsolving and analytical skills.
- Strong communication and collaboration abilities.
snowflake,azure,aws,sql,data modeling,etl,data warehousing