As an Azure Data Engineer you will:
- Design develop and maintain complex data pipelines using Azure Data Factory and Azure Databricks.
- Build and optimize largescale data processing solutions with PySpark and Databricks.
- Collaborate with crossfunctional teams to understand data requirements and deliver efficient scalable data solutions.
- Implement and manage CI/CD pipelines in Azure DevOps for automated testing integration and deployment of data solutions.
- Develop test and maintain robust data solutions in Python for ETL (Extract Transform Load) processes.
- Monitor troubleshoot and optimize data pipelines to ensure high performance and reliability.
- Ensure data security and compliance with company standards and best practices.
- Stay updated with the latest trends and best practices in cloud data engineering and Azure services.
What You Bring to the Table:
- 68 years of experience in cloud data engineering with a focus on Azure Data Factory and Azure Databricks.
- Strong proficiency in PySpark for big data processing.
- Advanced programming skills in Python particularly for data extraction transformation and loading (ETL).
- Handson experience with Azure DevOps particularly in implementing CI/CD pipelines.
- Solid understanding of SQL and experience querying and managing large datasets.
- Strong problemsolving skills and the ability to work independently or in crossfunctional teams.
- Excellent communication and documentation skills.
You should possess the ability to:
- Design and develop scalable data processing solutions using Azure tools.
- Implement automation and CI/CD practices in cloud data pipelines.
- Collaborate effectively with various teams to understand data requirements and deliver solutions.
- Optimize and troubleshoot data pipelines for performance and reliability.
- Maintain data security and adhere to best practices in cloud data engineering.
What We Bring to the Table:
- The opportunity to work with cuttingedge cloud technologies and data engineering tools.
- A collaborative work environment with crossfunctional teams.
- Exposure to the latest industry trends and technologies in cloud data engineering.
- Opportunities for professional growth and development in a dynamic and evolving field.
As an Azure Data Engineer, you will: Design, develop, and maintain complex data pipelines using Azure Data Factory and Azure Databricks. Build and optimize large-scale data processing solutions with PySpark and Databricks. Collaborate with cross-functional teams to understand data requirements and deliver efficient, scalable data solutions. Implement and manage CI/CD pipelines in Azure DevOps for automated testing, integration, and deployment of data solutions. Develop, test, and maintain robust data solutions in Python for ETL (Extract, Transform, Load) processes. Monitor, troubleshoot, and optimize data pipelines to ensure high performance and reliability. Ensure data security and compliance with company standards and best practices. Stay updated with the latest trends and best practices in cloud data engineering and Azure services. What You Bring to the Table: 6-8 years of experience in cloud data engineering, with a focus on Azure Data Factory and Azure Databricks. Strong proficiency in PySpark for big data processing. Advanced programming skills in Python, particularly for data extraction, transformation, and loading (ETL). Hands-on experience with Azure DevOps, particularly in implementing CI/CD pipelines. Solid understanding of SQL and experience querying and managing large datasets. Strong problem-solving skills and the ability to work independently or in cross-functional teams. Excellent communication and documentation skills. You should possess the ability to: Design and develop scalable data processing solutions using Azure tools. Implement automation and CI/CD practices in cloud data pipelines. Collaborate effectively with various teams to understand data requirements and deliver solutions. Optimize and troubleshoot data pipelines for performance and reliability. Maintain data security and adhere to best practices in cloud data engineering. What We Bring to the Table: The opportunity to work with cutting-edge cloud technologies and data engineering tools. A collaborative work environment with cross-functional teams. Exposure to the latest industry trends and technologies in cloud data engineering. Opportunities for professional growth and development in a dynamic and evolving field.