Azure Data Engineer
Azure Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Title: Azure Data Engineer
Location: Remote w/ 1 Monthly onsite meeting to Philadelphia PA required (University City Section)
- Must reside in Pennsylvania New Jersey Maryland or Delaware only (for benefits purposes once converted)
Type of Employment: Contact to Hire (6 Months to Hire)
We are Seeking an experience Azure Cloud Data Engineer. The Senior Azure Cloud Engineer will be responsible for designing deploying and maintaining our Azure Data pipelines. You will develop optimize and maintain data pipelines as well as support data platform teams efforts to generate datadriven insights. The Senior Azure Data Engineer is a member of a team and should have strong experience with Azure Cloud Azure Data Lake Databricks ADF (Azure Data Factory) and Python. Prior experience supporting SQL/SQL Server on prem would be highly desired since they still do have some data warehouses in SQL Server and onprem.
Responsibilities:
- Design develop and maintain scalable data pipelines and architectures on Azure Cloud.
- Implement and manage Azure Data Lake solutions to store and process large volumes of data.
- Utilize Databricks for data processing transformation and analytics.
- Develop and maintain ETL processes using Azure Data Factory.
- Write efficient and optimized SQL queries to extract transform and load data.
- Work with relational databases to ensure data integrity and performance.
- Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Implement data security and compliance measures in accordance with industry standards.
Qualifications:
- Bachelors degree in Computer Science Information Technology or a related field is required.
- 810 years of Data Engineering experience with a focus on Azure Cloud services for 23 years.
- 35 years of experience working with Azure Data Lake.
- 35 years of Python for data processing and automation.
- 2 years of Databricks experience.
- 12 years of Azure Data Factory (ADF) for extra transfer load process.
- 5 years of SQL and prior experience with other ETL processes such as SSIS.
- Familiarity with data governance and security best practices.
- Excellent problemsolving skills and attention to detail.
- Strong communication and collaboration abilities.
Preferred Qualifications:
- Masters degree in a related field.
- Certification in Azure Data Engineering or related Azure certifications.
- Experience with other Azure services such as Azure Synapse Analytics Azure Machine Learning etc.
- Knowledge of big data technologies like Hadoop Spark etc.
Employment Type
Full Time
