Lead Data Engineer (m/w/d)

Be part of two of AutoScout24 s teams that are shaping the company s ability to leverage data and technology resources to improve our customer experience. This role is uniquely positioned with Data Platform Engineering and Data Science teams to unlock the full potential of data within AutoScout24. You will have the opportunity to build and refine the services at the foundation of our Data Landscape along with those that directly impact our customers.

We welcome big data enthusiasts who want to solve important problems and are excited to partner with teams across the organization to build solutions that make cutting-edge experiences possible. Knowledge sharing within and across teams is an important part of how we work and helps to drive the success of cross-functional projects.

We are looking forward to your application!

At AutoScout24 we appreciate different lifestyles and cultural backgrounds. We welcome diversity as a strength. We know that mixed teams work more successfully. Our organisation is made up of more than 50+ different nationalities, all working together inclusively and respectfully.

The role:

• Contribute to the design and implementation of our data landscape, emphasizing reliability and efficiency along with opportunities for real-time processing

• Focus on integrating new solutions in into existing system architecture

• Develop resilient solutions to store, ingest, process and analyze high volumes of data from different sources

• Collaborate on the delivery of data, and its transformation, to efficiently contribute to company data models

• Adopt a consulting and coaching mindset to best support data stakeholders in a dynamic, cross-functional environment

• Collaborate with tech leads and engineering managers to align on architectural approaches in cross-functional settings

• Take over end-to-end ownership for projects, from data processing, to training, evaluating, deploying and monitoring

• Understand business objectives and translate them into solutions that leverage data for machine learning along with KPI oversight

• Monitor data quality and enable on feature engineering

• Automate data, model training and inference pipelines

• Define validation and monitoring strategies for data and ML models

You are/have:

• Several years (5+) of relevant work experience

• Business-proven hands-on experience in AWS, Azure or GCP

• Experience with established tools like Hadoop, Spark and Airflow as well as knowledge of newer developments such as Arrow, DBT, Great Expectations

• Proficiency in Python, SQL and/or Java Scala is a plus

• Hands on experience building ETL pipelines

• Solid experience in data modelling and resilient engineering

• Experience with data science and ML libraries

• First-hand experience in deploying, maintaining, and updating models in production is essential

• You collaborate in diverse and visionary teams and settings

• Strong communication skills

• Business fluent English language skills, German speaking and writing skills are an advantage

• Data-driven mindset

• Passion to share knowledge and onboard new team members

Nice to have:

• Previous experience in large-scale projects with multiple stakeholder groups based on varying data sources and technologies
• Understanding of technologies used to collect and transform consumer data
• Familiarity with complex software systems, microservice architectures, and real-time processing.
• Practice in Clean Code, Test Driven Development or Pair Programming

We work with:

• AWS services (S3, Kinesis Firehose, EMR, EC2, Glue, )
• Big data technologies that include Hadoop, Spark, Presto, Hive and Kafka.
• Tensorflow, Pytorch and other ML libraries
• Google Analytics, Google BigQuery and Google Tag Manager

If this appeals to you but you are in doubt about how exactly your skills match our requirements - we value personality, ambition and an open mind. Don t hesitate to get in touch and present your personal strengths to us.

Benefits:
AutoScout24 offers benefits that allow our employees to work as freely and effectively as possible. We provide flexible office attendance and working hours, up to 30 days paid vacation (depending on the location) and state of the art, modern offices to name a few. Our goal is to support you in doing your best work.