Job Title: Senior Data Engineer Databricks & Azure
Location: Bengaluru / Hybrid
Experience: 5 to 10 Years
Job Overview: We are looking for an experienced Senior Data Engineer specializing in Databricks and Microsoft Azure to join our team. In this role youll design and implement scalable data pipelines optimize big data workflows and develop highperformance data platforms. You will work closely with data scientists and crossfunctional teams to deliver data solutions that support our datadriven strategies.
Key Responsibilities: - Data Pipeline Development: Build and manage efficient ETL/ELT pipelines on Azure Databricks with Apache Spark for distributed data processing.
- Cloud Data Infrastructure: Architect solutions using Azure Data Lake Synapse Analytics and SQL Database optimized for cost and performance.
- Databricks Expertise: Configure and optimize Databricks clusters; integrate Delta Sharing and Unity Catalog.
- Azure Integration: Leverage Azure Data Factory Event Hubs and Stream Analytics for data integration and realtime processing.
- Governance & Security: Ensure data governance quality and compliance using rolebased access and encryption.
- Collaboration & Mentorship: Collaborate with crossfunctional teams; mentor junior engineers in best practices.
Qualifications: - Experience: 5 years in data engineering with expertise in Azure and Databricks.
- Technical Skills: Proficiency in Python Scala or SQL; handson with Azure Databricks Data Factory and Data Lakes.
- Certifications (Preferred): Azure Data Engineer Associate Databricks Certified Data Engineer Associate (mandatory).