Data bricks Consultant

Location: Bangalore
Exp: 7yrs


Bachelors degree in Computer Science Information Technology or a related field.
Apache Spark and Delta Lake expertise: Handson experience with big data pipelines.
Programming skills: Proficiency in Python Scala or SQL.
Databricks platform experience and its features and capabilities.
Data engineering background: Solid experience in data modeling warehousing and ETL/ELT processes.
Cloud computing knowledge: Experience with AWS Azure GCP and their integration with Databricks.
Data security and compliance: Knowledge of encryption access controls and data privacy regulations (e.g. GDPR HIPAA).
Analytical skills: Ability to analyze and optimize system performance.
Project management experience: Skilled in managing timelines resources and stakeholder expectations.
Communication and collaboration: Ability to work effectively with crossfunctional teams and explain technical concepts to nontechnical stakeholders.
Continuous learning: Commitment to staying current with big data technologies Databricks updates and industry best practices.

Key Responsibilities:
1. Databricks Deployment: Lead the setup and configuration of the Databricks environment within the organizations cloud infrastructure (AWS Azure GCP).
Ensure the integration of Databricks with existing data sources data warehouses and other analytics tools.
2. Data Pipeline Engineering:
Design develop and maintain robust data pipelines within Databricks leveraging Apache Spark and Delta Lake for efficient data processing and storage.
Implement ETL/ELT processes that cater to the needs of diverse analytics and machine learning projects.
3. Performance Optimization: Monitor the performance of data processes and queries within Databricks identifying and resolving bottlenecks.
Optimize Spark jobs and Databricks clusters for cost efficiency and computational performance.
4. Security and Governance: Implement and maintain security measures

Professional & Technical Skills: - Must To Have Skills: Strong experience in ServiceNow development. - Good To Have Skills: Experience with ITIL processes and ServiceNow certifications. - Solid understanding of ServiceNow platform architecture and development best practices. - Experience with ServiceNow modules such as Incident Management, Change Management, and Service Catalog. - Strong problem-solving and analytical skills. Additional Information: - The candidate should have a minimum of 3 years of experience in ServiceNow development. - The ideal candidate will possess a strong educational background in computer science or a related field, along with a proven track record of delivering impactful ServiceNow solutions.