Data Engineer
Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
We now have a new requirement and are looking for a consultant colleague with the qualifications listed below. The position is part of our consulting business which means you will be employed by us and work either with clients or on internal projects and assignments.
As part of your application you may be presented to clients/partners as part of the recruitment process. If selected for the assignment you will be employed by us and work either with clients or on internal projects and assignments as part of our consulting business.
Job Description
- Design develop and maintain scalable data pipelines using Databricks to support data ingestion transformation and loading (ETL/ELT) processes.
- Collaborate with and mentor other product teams and engineers to build and maintain the data platform that integrates data from multiple sources.
- Optimize data processing workflows and ensure they adhere to architectural principles performance and security.
- Implement and enforce data quality checks monitoring and alerting systems to ensure the integrity and reliability of the data.
- Leverage Databricks features such as Delta Lake and Databricks Workflows to enhance data pipeline performance and reliability.
- Work with cloud infrastructure teams to ensure the platforms performance availability and scalability within the cloud environment.
Your Profile (Musthave requirements)
- 5 years of experience as a Data Engineer or similar role with at least 2 year of handson experience in Databricks.
- Knowledge of IAC CI/CD pipelines version control (Git) and DevOps practices in data engineering.
- Proficiency in Databricks and familiarity with key features like Delta Lake Databricks Jobs and Databricks SQL.
- Excellent skills in Python for data processing and pipeline development. (Beneficial if experienced in SQL)
- Strong understanding of distributed data processing technologies such as Apache Spark.
- Experience in working with big data technologies and tools including Spark Kafka Hadoop or similar.
- Experience of medallion architecture in Databricks.
- Experience in working with automation testing and data quality.
Meritorious
- Experience of Azure infrastructure (especially ADF Blob Storage & DataLake).
- Experience of agile practices working in a product organization.
- Understanding and experience of data mesh concepts.
- Experience of using Terraform and/or Bicep.
- Experience of working with streaming ETL.
- Understanding or experience of concepts like SLO GitHub and control planes.
Application deadline:
About Us
We currently employ experienced consultants in areas such as System Development AI Machine Learning Testing Cloud Infra DevOps and IT Project Management.
Working at Deploja is something entirely different from working at an ordinary consulting companyand we are really proud of that. So what makes us unique
We simply offer more than just a high salary and greater freedom; thats just the beginning. With us youll find the work environment and opportunities you deserve. Welcome to Deploja where the grass is indeed greener!
Vi erbjuder dig fljande Valet r ditt!
Exciting assignments with our many clients. We focus on longterm projects which gives you the opportunity to create value for the client while also developing yourself.
A secure monthly salary together well agree on a base salary depending on your assignments.
Company car we encourage you to choose an electric car for a more sustainable future.
Occupational pension and great opportunities for salary conversion.
Vacation Would you like more than 30 days of vacation perhaps 60 days
Private health insurance accident insurance and life insurance for increased security.
Skills development you set your own budget and choose the training you wish to attend.
Quality of life Are you struggling to balance everyday life and wish to work a little less while still earning as much if not more
We handle applications continuously and due to the high workload its especially important to include a short motivation for the position explaining how you meet the requirements.
Employment Type
Full Time
