Databricks Data Engineer
Databricks Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
About the Role:
We are seeking a talented and passionate Databricks Data Engineer to join our expanding Data & AI team Databricks Partner 50 FTE). In this role you will be a crucial player in designing building and maintaining cuttingedge data solutions on the Databricks platform. You will have the opportunity to work with a variety of clients across different industries collaborating with both internal teams and client stakeholders to deliver highquality data pipelines and enable datadriven decisionmaking.
Responsibilities:
- Data Pipeline Engineering: Design develop and deploy robust and scalable data pipelines using Databricks incorporating data extraction from diverse sources (databases APIs streaming platforms) transformation and cleansing using Spark and loading into target systems (data lakes data warehouses etc.. Optimize pipeline performance for efficiency and costeffectiveness.
- Databricks Ecosystem Expertise: Utilize the full capabilities of the Databricks platform including Databricks SQL Delta Lake Databricks Runtime and Databricks Workflows to orchestrate complex data workflows and ensure data quality and pipeline reliability.
- Cloud Integration: Seamlessly integrate Databricks with cloud services (Azure AWS or GCP) for storage compute and security leveraging services like Azure Data Lake Storage AWS S3 Google Cloud Storage and more.
- Data Architecture and Modeling: Contribute to the design and implementation of robust data models and architectures for data lakes and data warehouses ensuring data consistency integrity and accessibility for various use cases.
- Data Quality Assurance: Implement rigorous data quality checks and validation procedures throughout the data pipeline to maintain high accuracy and reliability. Adhere to data governance policies and best practices.
- Collaboration and Communication: Work closely with data scientists analysts business intelligence specialists and business stakeholders to understand their data requirements and provide technical expertise on Databricks and data engineering best practices.
- Continuous Learning: Stay up to date with the latest Databricks features cloud technologies and data engineering trends to continuously improve our solutions and deliver innovative results for our clients.
Qualifications :
- Hold a University Degree in Computer Science (Business) Engineering or a specialized masters in Machine Learning or AI.
- Proven Experience: 3 years of experience as a Data Engineer with demonstrated expertise in Databricks.
- Cloud Proficiency: Handson experience with at least one major cloud platform (Azure AWS or GCP) with a good understanding of cloud data services and infrastructure.
- Programming Skills: Strong programming skills in Python or Scala with experience in data manipulation libraries (e.g. PySpark Spark SQL).
- Data Fundamentals: Solid understanding of data warehousing principles ETL processes data modeling techniques and database systems.
- SQL Expertise: Advanced SQL skills for data querying transformation and analysis.
- Communication Skills: Excellent communication and interpersonal skills with the ability to effectively collaborate with technical and nontechnical stakeholders.
- ProblemSolving: Strong analytical and problemsolving abilities with a proactive approach to identifying and resolving datarelated challenges.
- Fluent in English and proficiency in Dutch or French is mandatory.
Bonus Points :
- Experience with machine learning or AI technologies.
- Knowledge of DevOps practices.
- Contributions to opensource projects.
- Experience with data visualization tools (e.g. Tableau Power BI).
Additional Information :
Why choose us
- Thrive in a fastgrowing entrepreneurial environment
- Work with innovative and impactful Cloud Data & AI projects for industryleading clients
- Connect with extraordinary talents in a collaborative and diverse culture
- Enjoy a healthy worklife balance in an inspiring ecofriendly workplace
- Competitive compensation package
At Devoteam we combine strong values respect frankness ambition entrepreneurship & collaboration with a fun and supportive environment that empowers you to innovate grow and succeed in the fastpaced world of Cloud Data & AI.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
