Azure with Databricks Engineer
Azure with Databricks Engineer
Posted on :
03-11-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Position Title: Azure with Databricks Engineer
Location: Philadelphia PA
Responsibilities:
- Design implement and manage Azurebased solutions ensuring scalability reliability and security.
- Work with Azure services such as Azure Databricks Azure Data Lake Storage Azure SQL Database and others to build robust data processing and analytics solutions.
- Develop and maintain data engineering and data processing workflows using Databricks.
- Collaborate with data scientists and analysts to implement machine learning models and analytical solutions on the Databricks platform.
- Design develop and implement ETL processes to move and transform data from various sources to Azure Databricks.
- Optimize and troubleshoot data pipelines to ensure efficient and reliable data processing.
- Implement and adhere to security best practices for Azure and Databricks ensuring data protection and compliance with industry standards and regulations.
- Monitor and address security vulnerabilities and potential risks within the Azure and Databricks environments.
- Collaborate with crossfunctional teams including data scientists analysts and other engineers to understand project requirements and deliver effective solutions.
- Communicate technical concepts and solutions to both technical and nontechnical stakeholders.
- Stay uptodate with the latest Azure and Databricks features and updates.
- Continuously identify opportunities for process improvement automation and optimization of data workflows.
- Bachelors degree in Computer Science Engineering or a related field.
- Proven experience working with Azure cloud services particularly Azure Databricks.
- Strong proficiency in programming languages such as Python Scala or SQL.
- Experience with data engineering ETL processes and data integration.
- Familiarity with machine learning concepts and frameworks is a plus.
- Excellent problemsolving and troubleshooting skills.
- Strong communication and collaboration skills.
Certifications:
- Relevant certifications in Azure and Databricks are highly desirable.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
