drjobs Data Engineer Azure

Employer Active

drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Alexander City - USA

Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Job Description

Job Requirements:

Experience: 810 years experience

1. Python ETL: The ideal candidate should have strong proficiency in Python programming language and experience in Extract Transform Load (ETL) processes. They should be able to design and develop efficient ETL workflows to extract data from various sources transform it as per business requirements and load it into target systems.

2. Azure Experience: The candidate should have handson experience working with Microsoft Azure cloud platform. They should be familiar with Azure services and tools and have a good understanding of Azure architecture and best practices.

3. Azure Data Factory DataBricks Azure Storage and Azure VM: The candidate should have practical experience with Azure Data Factory DataBricks Azure Storage and Azure Virtual Machines. They should be able to design and implement data pipelines using Azure Data Factory perform data transformations and analytics using DataBricks and manage data storage and virtual machines in Azure.

4. Data Governance Data Quality and Controls: The candidate should have a strong understanding of data governance principles data quality management and data controls. They should be able to implement data governance frameworks establish data quality standards and ensure compliance with data regulations and policies.

5. Implementing alerts and notifications for batch jobs: The candidate should have experience in setting up alerts and notifications for batch jobs. They should be able to configure monitoring and alerting mechanisms to ensure timely identification and resolution of issues in batch job execution.

Here are a few other notes I got from the call but this JD is very detailed as it relates to what theyre looking for.

Underlying work is helping migrate current pipeline from the server into Azure Data factory.
ETL and Azure Data Factory pipelines
Their goal is to use AI techniques to solve problems. 15 people in this team. Roy is 1st consultant hired for this project.

Python is VERY important for this
A lot of these pipelines on the team are generated through AI as code.
Reporting into Martin but a very flat team dont really care who they report to.


Employment Type

Full Time

Company Industry

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.