Azure Databricks Developer
Azure Databricks Developer
Posted on :
22-11-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Title: Azure Databricks Developer
Location: Pune
Experience: 514 years
We are seeking an experienced Azure Databricks Developer with a strong background in building deploying and optimizing data pipelines in Microsoft Azure. The ideal candidate will have at least 2 years of handson experience in implementing Azurebased data solutions including Azure Data Factory Azure Databricks and Azure Synapse Analytics. This role demands strong expertise in Python PySpark and SQL and the ability to work with a variety of Azure services.
Key Responsibilities:- Design develop and implement data pipelines and workflows using Azure Data Factory Azure Synapse Analytics and Azure Databricks.
- Work with Delta Tables and Unity Catalog in Azure Databricks for data storage management and governance.
- Develop and optimize ETL/ELT processes using Python PySpark and SQL.
- Build scalable efficient data pipelines to transform clean and process large volumes of data.
- Implement data orchestration automation and monitoring to ensure efficient data flow across platforms.
- Collaborate with business analysts data scientists and other engineering teams to design data solutions that meet business needs.
- Utilize Azure Bus Service Function Apps (C#) and Git for version control and deployment processes.
- Troubleshoot performance issues in data pipelines and suggest improvements for scalability and reliability.
- Ensure data quality and consistency while working with structured semistructured and unstructured data.
- 514 years of experience in data engineering or a related field with at least 2 years focused on Azure data technologies.
- Proven handson experience with Azure Data Factory Azure Databricks Azure Synapse SQL and related Azure data services.
- Expertise in Python PySpark and SQL for developing data processing solutions.
- Demonstrated experience in designing and implementing Azure Data Pipelines for data ingestion transformation and storage.
- Experience working with Delta Tables and Unity Catalog in Azure Databricks.
- Strong understanding of Azure Bus Service Function Apps (C#) and version control with Git.
- Solid experience with data governance data security and best practices in the Azure ecosystem.
- Familiarity with cloudbased data storage data lakes and data warehousing concepts.
- Microsoft Certified: Azure Data Engineer Associate or similar Azure certifications.
- Knowledge of other Azure services like Azure SQL Database Azure Machine Learning or Power BI.
- Experience with Agile/Scrum development methodologies and cloudnative application architectures.
- Strong communication skills both written and verbal to collaborate effectively with crossfunctional teams.
Employment Type
Full Time
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
