Overview:
The Senior Azure Data Engineer plays a pivotal role in designing implementing and maintaining the data architecture within the Azure environment. This position is crucial for ensuring efficient data storage accessibility and security as well as enabling the organization to leverage data for strategic decisionmaking.
Key Responsibilities:
- Design and develop scalable data pipelines within Azure using big data technologies.
- Collaborate with crossfunctional teams to gather and understand data requirements.
- Implement ETL processes to ingest transform and load data into Azure data solutions.
- Develop and maintain data models and schema within Azure data services.
- Optimize data storage processing and querying for performance and costefficiency.
- Implement data security measures and ensure compliance with data governance policies.
- Provide technical guidance and mentorship to junior data engineering team members.
- Monitor and troubleshoot data pipelines and services to ensure optimal performance and uptime.
- Collaborate with data analysts and data scientists to support their data requirements and enable insights generation.
- Stay updated with the latest Azure data services and industry best practices.
- Contribute to the continuous improvement of data engineering processes and practices.
- Document data architecture processes and solutions for knowledge sharing and future reference.
- Participate in the evaluation and selection of tools and technologies for data engineering within Azure.
- Participate in project planning estimation and related to data engineering initiatives.
- Collaborate with stakeholders to understand business objectives and translate them into data engineering requirements.
Required Qualifications:
- Bachelors degree in Computer Science Engineering or a related field.
- Proven experience in designing and implementing data solutions within the Azure environment.
- Strong proficiency in big data technologies such as Hadoop Spark or Databricks.
- Expertise in ETL processes and tools for data integration.
- Indepth knowledge of SQL and NoSQL databases data modeling and schema design.
- Experience with data warehousing and dimension modeling concepts.
- Proficiency in programming languages such as Python Scala or Java for data processing and transformation.
- Familiarity with data governance security and compliance principles within Azure.
- Strong analytical and problemsolving skills with a focus on data quality and performance optimization.
- Excellent communication skills and the ability to collaborate effectively in a team environment.
- Relevant certifications in Azure data engineering or relevant technologies are a plus.
- Ability to work in an agile environment with strong multitasking and prioritization skills.
- Experience in mentoring and guiding junior data engineering team members.
- Demonstrated ability to adapt to and learn new technologies and tools quickly.
- Strong attention to detail and a commitment to delivering highquality data solutions.
security,data warehousing,communication,sql,scala,java,etl processes,data governance,etl,data engineering,azure,compliance,agile,mentoring,big data,nosql databases,problem-solving,python