Senior Data Engineer (Azure & Databricks)
Job Summary
About the Role
We are looking for a Senior Data Engineer to build data pipelines efficient storage structures and powerful materialized views across analytical technologies as well as data exchange endpoints for end users. The role also involves working with data governance tools covering glossary modelling lineage and data quality.
Key Responsibilities
Design and build scalable data pipelines on the Microsoft Azure data platform.
Create efficient storage structures and materialized views across analytical technologies.
Build and maintain data exchange endpoints for users.
Develop lakehouse solutions with Databricks PySpark Delta Lake and medallion architecture.
Orchestrate pipelines with Azure Data Factory.
Optimize Azure SQL performance through execution plans indexing partitioning and advanced T-SQL.
Contribute to data governance: glossary modelling lineage and data quality.
Set up and follow version control CI/CD automated deployment and monitoring practices.
Mentor data engineers and act as a technical reference for the team.
Requirements
Must Have
At least 5 years of hands-on data engineering experience.
At least 1 year leading mentoring or coaching data engineers or acting as a technical reference.
Hands-on experience with Microsoft Azure data services and the Microsoft data platform.
Hands-on Databricks PySpark Delta Lake Delta tables and medallion architecture.
Expertise in Azure SQL and SQL performance tuning: execution plans indexing wait statistics partitioning dimensional modelling and advanced T-SQL.
Azure Data Factory for orchestration and pipeline development.
Practical experience with Parquet files and lakehouse data storage.
Version control CI/CD automated deployment and monitoring practices.
Fluent English.
Able to work on-site in Brussels.
Nice to Have
Unity Catalog and data governance in Databricks.
Kafka or event-driven data ingestion.
Azure cost optimization cluster optimization and FinOps practices.
Azure DevOps infrastructure-as-code and platform automation.
Data quality data lineage access control and operational monitoring.
German language skills.
What We Value
Challenges ideas with rational no-nonsense thinking.
Looks at data across the whole enterprise not in silos to maximize coherence reuse and adoption.
Drives results through continuous improvement and an analytical approach.
Customer- and product-oriented with an iterative way of working.
Team player who shares ideas openly and communicates well.
Key Skills
Azure Data Services Databricks PySpark Delta Lake Medallion Architecture Azure SQL SQL Performance Tuning T-SQL Azure Data Factory Parquet Lakehouse CI/CD Azure DevOps Kafka Unity Catalog Data Governance Data Quality Data Lineage FinOps.