Azure Data Engineer
Azure Data Engineer
Posted on :
10-11-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This is a remote position.
Job Overview:
We are seeking a highly skilled Azure Data Engineer with extensive experience in Databricks PySpark and Spark SQL to join our team. The ideal candidate will be responsible for designing developing and maintaining largescale data solutions on Azure with a focus on realtime and batch data processing using Databricks.
Requirements
Key Responsibilities:
- Design build and maintain scalable data pipelines on Azure Databricks using PySpark and Spark SQL.
- Develop and optimize ETL processes for handling large data sets.
- Collaborate with data scientists analysts and other stakeholders to understand data requirements and implement solutions.
- Ensure data quality performance and scalability by implementing best practices for coding and data architecture.
- Create and manage data models databases and data lakes on Azure.
- Monitor and troubleshoot data pipelines ensuring high availability and reliability.
- Implement security and compliance best practices in the data pipeline following Azure standards.
- Work with Azure services like Azure Data Factory Azure Synapse and Azure Blob Storage to orchestrate and manage data workflows.
Qualifications:
- Bachelors degree in Computer Science Information Technology or a related field.
- 5 years of handson experience with Azure Databricks.
- Proficiency in PySpark and Spark SQL for building scalable data pipelines.
- Solid understanding of Azure data ecosystem including Azure Data Lake Azure Data Factory and Azure Synapse Analytics.
- Experience with ETL processes data modeling and data architecture.
- Familiarity with cloud security best practices and data governance.
- Strong problemsolving and troubleshooting skills.
- Excellent communication and collaboration skills.
NicetoHave:
- Experience with CI/CD pipelines using tools like Azure DevOps.
- Knowledge of Data Warehousing and Big Data technologies.
- Experience with other programming languages like Python or Scala.
- Familiarity with Machine Learning workflows on Databricks.
Qualifications: 5+ years of experience in data technology roles Proficiency in SQL scripting and Azure ETL tools (Blob Storage, Azure Data Factory, Key Vaults) Hands-on experience with Snowflake Strong data modeling and ETL/ELT skills across various tools (ADF, BODS, Informatica, etc.) Knowledge of CI/CD and DevOps principles Experience in Agile development environments Proficiency in Azure Databricks Experience with Amazon Marketing Cloud (AMC) for data analysis and marketing insights Nice to Have: Python or JavaScript experience Exposure to Tableau or PowerBI for data visualization This role offers an opportunity to apply your technical expertise to make a lasting impact, enhance data-driven decision-making, and shape the future of our data solutions. Join us to help translate data into valuable insights that drive business success.
Education
Bachelor s degree
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
