Our clientis a leading global provider of sustainable multimodal transportation and logistics solutions with a presence in over 24 countries across Europe North America Asia and Australia. It operates an extensive network that integrates shortsea road rail and inland waterway transport offering innovative and environmentally conscious logistics services.
The Senior Data Engineer / Tech Lead plays a crucial role in transforming vast and complex datasets into strategic assets enabling datadriven decisions and enhancing innovative services. The main focus is on managing internal and external data enhancing the modern Azurebased data platform and ensuring seamless integration storage and processing of big and streaming data. This position requires both technical leadership and handson engineering skills offering a dynamic and impactful role within the company.
Key Responsibilities:
- Serve as a trusted advisor to the Data Architect offering alternative approaches and architectures.
- Lead and mentor team members fostering a collaborative and highperformance environment.
- Proactively drive improvements by optimizing and automating processes.
- Build deploy monitor and manage data pipelines in Azure with a focus on efficiency and performance.
- Implement delta loads on multiple data sources to enhance system functionality.
- Monitor the performance and implement quality control measures.
- Develop and refine system integrations using scripting languages and tools.
Required Qualifications:
- Bachelors degree in Computer Science Engineering or a related field.
- 4 years of experience as a Data Engineer.
- Proficiency in SQL (e.g. MySQL MSSQL Oracle SQL).
- Solid understanding of Microsoft Azure features particularly Azure Data Factory and Azure Data Lake.
- Familiarity with CI/CD pipelines using Azure DevOps.
- Knowledge of ETL frameworks data models containerization and data formats such as JSON and Parquet.
Preferred Qualifications:
- Azure Data Engineer Associate certification or equivalent.
- Experience in data analytics machine learning or data science.
- Industry experience in transport/logistics is a plus.
- Python scripting experience is an advantage.
- Strong communication skills with the ability to influence and engage stakeholders.
Personal Attributes:
- Entrepreneurial mindset with a proactive approach to challenges.
- Critical thinking and problemsolving abilities with attention to detail and accuracy.
- Ability to adapt quickly in a fastpaced evolving environment.
- Excellent collaboration and negotiation skills.
Challenges:
- Managing imperfect datasets.
- Navigating a changing architecture and application landscape.
- Adapting to shifting business priorities.