Company Name: Our client a new GCC in Bangalore.
Role: Data engineering Leader
Location: Bangalore (Work from Office)
Key Responsibilities
- Lead a technical team effectively while fostering collaboration across onshore and offshore teams.
- Maintain a handson approach by actively writing and reviewing code daily.
- Ensure team adherence to established data governance policies and standards.
- Oversee the design development and maintenance of new and existing data pipelines.
- Conduct regular code reviews and provide mentorship to the data engineering team.
- Collaborate with the Head of Engineering to align with platform strategy and roadmap.
- Support the Head of Engineering in managing software engineers as needed.
Qualifications and Skills
- Bachelors Masters or Ph.D. in Computer Science or a related discipline.
- A minimum of 8 years of experience in data engineering or related fields.
- Proven expertise in working with Databricks.
- Advanced knowledge of Azure Data Lake Parquet and Delta tables.
- Strong experience with structured and semistructured datasets.
- Comprehensive understanding of ELT/ETL processes and their implementation in data pipelines.
- Proficiency in developing implementing and integrating notebooks within data pipelines.
- Expertise in configuring and managing data ingestion pipelines using Azure Data Factory or Databricks.
- Extensive experience in programming languages such as Python R and SQL.
- Familiarity with consuming and processing data from secure REST APIs.
- Experience with data visualization tools like Power BI or Spotfire.
- Knowledge of Azure DevOps (or similar tools) and CI/CD methodologies.
- Strong communication skills with the ability to propose and discuss solutions effectively with both technical and business stakeholders.
- Capability to present project updates and metrics to senior management.
Remote Work :
No