Databrick Admin

Greetings from Maneva!

Job Description

Job Title Databrick Admin

Location Pune

Experience 5 10 years

Shift 8 am 5 pm EST 5:30 PM2:30 AM

Notice Immediate to 30 Days

Requirements:

Efficiently manage AWS cloud infrastructure and Databricks environment to ensure seamless operations.

Conduct regular performance optimization and scaling of Databricks clusters on AWS to meet evolving needs includes capacity planning.

Seamlessly integrate Azure DevOps or GitHub for robust CI/CD pipelines including Delta Live Tables for realtime data processing.

Automate deployment processes to enhance efficiency and reliability.

Provide comprehensive support for ML and AI Chabot initiatives understanding platform requirements for optimal client and data science team benefits.

Facilitate the integration of ML models and Chabot functionalities within the Data bricks environment.

Skilfully create and configure new workspaces within the AWS environment ensuring smooth setup and minimal vendor dependency.

Proficiently write shell scripts for automation leveraging Python and Scala for advanced scripting tasks is addon.

Implement robust access control mechanisms configuring Databricks compute pools service principles groups and roles.

Implement stringent encryption measures for data stored in DBFS and AWS S3 buckets utilizing AWS KMS for key management.

Enforce strict access controls and security policies to protect against unauthorized access and data breaches.

Configure comprehensive logging mechanisms to track system activities and user actions effectively includes utilizing AWS Cloud Trail for auditing and monitoring security events in realtime.

Establish robust backup procedures including regular backups of critical data and configurations.

Implement versioning and lifecycle policies for data stored in S3 buckets to ensure data integrity and availability.

Foster effective collaboration with crossfunctional teams and application teams to support their requirements.

Actively engage in knowledge sharing and contribute to the continuous improvement of the AWS Databricks environment and associated processes.

If you are excited to grab this opportunity please apply directly or share your CV at and