Data Architect
Data Architect
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Greetings!
This is Rakesh from MSRCOSMOS LLC.
We are one of the leading staffing agency in North America. I am reaching out to check your availability for the below role. Please review the job description and let me know if you are interested to submit your resume. You can share your resume to
Job Title: Data Architect (Databricks Azure Data Lake Python)
Duration: Long term contract
Location: Greenfield India (Onsite from day 1)
Mandatory Cloud/Data/Solution Architecture addressing various patterns around Data management security deployment costing governance modelling observability Finops well architected frameworks etc
Hiring Manager
Educational Qualification*
Any Bachelors Degree good in Computer Science Information Technology
Job Description
We are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have extensive experience in cloud technologies DevOps development practices and Data Engineering to support and enhance our RDAP initiatives.
Key Responsibilities:
Design develop and maintain Databricks Lakehouse solutions sourcing from cloud platforms such as Azure Synapse and GCP.
Implement and manage DevOps and CICD workflows using tools like GitHub.
Apply best practices in testdriven development code review branching strategies and deployment processes.
Build manage and optimize Python packages using tools like setup poetry wheels and artifact registries.
Develop and optimize data pipelines and workflows in Databricks utilizing PySpark and Databricks Asset Bundles.
Manage and query SQL databases (Unity Catalog SQL Server Hive Postgres).
Implement orchestration solutions using Databricks Workflows Airflow and Dagster.
Work with eventdriven architectures using Kafka Azure Event Hub and GoogleC4 Cloud Pub/Sub.
Develop and maintain Change Data Capture (CDC) solutions using tools like Debezium.
Extensive experience in design and implementation of data migration projects specifically involving Azure Synapse and Databricks Lakehouse
Manage cloud storage solutions including Azure Data Lake Storage and Google Cloud Storage.
Configure and manage identity and access solutions using Azure Active Directory including AD Groups Service Principals and Managed Identities.
Primary (Must have skills)*
Python package builds(setuppoetry wheelsartifact registries)
Specific technologies
Databricks(PySparkDatabricks Asset Bundles)
Open File Formats (Delta/Parquet/Iceberg/etc )
SQL Databases (Unity Catalog SQL Server Hive Postgres)
Orchestration Tools(Databricks Workflows Airflow Dagster)
Azure Data Lake Storage
Azure Active Directory (AD groups Service PrinciplesManaged Identities)
Expierence Range
1012 years
Secondary Skills (Good To have)*
Kafka Azure Event Hub Cloud Pub/Sub
Change Data Capture (Debizum)
Google Cloud Storage
Soft skills/other skills (If any)
Communication Skills:
Ability to convey complex technical concepts in a clear and concise manner to both technical and nontechnical stakeholders.
Strong documentation skills for creating process guidelines technical workflows and reports.
ProblemSolving and Analytical Thinking:
Capability to troubleshoot and resolve issues efficiently.
Analytical mindset for optimizing workflows and improving system performance.
Lead Responsibilities
Effective in Customer interactions for understanding requirements participating in design discussions and translating requirements into deliverables by working with the development team at Offshore
Effective in collaborating with crossfunctional teams across development operations and business units.
Strong interpersonal skills to build and maintain productive relationships with team members.
Employment Type
Full Time
