Decision Minds a Bangalorebased leader in data cloud and Gen AI Solutions is looking for a highly skilled Databricks Expert with a strong background in services. The ideal candidate should have handson experience in migrating from Hadoop to Databricks and from SQL to Databricks along with deep expertise in Apache Spark. This individual will play a crucial role in driving our data transformation projects optimizing data pipelines and ensuring successful transitions to the Databricks platform.
Key Responsibilities:
Lead Hadoop to Databricks and SQL to Databricks migration projects.
Design develop and optimize Sparkbased data pipelines.
Collaborate with teams to ensure seamless integration and migration processes.
Provide technical guidance on Databricks architecture best practices and data management strategies.
Troubleshoot and resolve technical challenges during migration.
Requirements
Qualifications:
Proven experience with Hadoop and SQL to Databricks migrations.
Indepth knowledge of Apache Spark and the Databricks platform.
Strong background in services and managing largescale data projects.
Excellent problemsolving abilities and a detailoriented approach.
Located in Bangalore or willing to relocate.
Benefits
Experience :
1215 years.
Years of experience: 1. Minimum 12+ years of IT experience in Data background. 2. Minimum 4 years of hands-on experience with Snowflake. 3. Snowflake migration experience (preferably SQL Server to Snowflake). 4. Candidate who is currently hands-on, and has architecture solutions and design responsibilities. 5. 1-2 years of DBT and Five Tran experience. 6. Can lead Snowflake developers and engineers. Key Skills required: Data background, Experience in migrations, Solution Architecture