Azure Data Engineer

Design develop and maintain scalable data pipelines using Azure Data Factory Azure Databricks and other Azure data services.

Utilize Databricks for big data analytics and realtime data processing ensuring optimal performance and efficiency.

Collaborate with data architects to design and implement effective data models and architectures to support business requirements.

Implement ETL processes for data extraction transformation and loading ensuring the integrity and quality of the data.

Integrate data from various sources ensuring compatibility accuracy and adherence to data governance standards.

Identify and address performance bottlenecks in data pipelines optimizing for speed reliability and scalability.

Work closely with crossfunctional teams including data scientists analysts and business stakeholders to understand data requirements and deliver effective solutions.

Conduct code reviews enforce best practices in coding and documentation and mentor junior team members.

Education:

Experience:

Technical Skills:

Proficiency in Azure Data Factory Azure Databricks Pyspark SQL Python and ETL processes.

Solid understanding of data modeling data warehousing and big data concepts