Job Title: AWS Databricks Architect
Location: San Diego CA (Onsite 3 days)
Duration: Long Term
Must Have:
-
Possess excellent written and verbal communication ss.
-
Ability to run ETL jobs in Databricks.
-
Unity catalog with delta MongoDB regular s3 based parquet files Delta format based S3.
-
Ability to articulate pros and cons of delta format.
-
Ability to run Databricks with AWS glue catalog.
-
Monitoring of Databricks jobs.
-
Operations related experience of Databricks jobs.
-
Best practices of setting up nested ETL jobs.
-
Scheduling of jobs in Databricks.
-
Ping runtime parameters to ETL jobs.
-
Handling experience in AWS in data engineering project.
-
Ability to coordinate/work with team in India.
Job Description:
-
Lead and manage a team of engineers and Sr engineers by providing guidance mentorship and fostering a collaborative work environment.
-
Elish and maintain positive relationships with client stack holders.
-
Consult with client on project status proposals and technical issues and provide postimplementation support to them.
-
Facilitates communication and collaboration between onshore and offshore teams and ensure the successful design development and of the productprojectdeliverables on time
-
Experience in POC development Capacity sizing Tool Evaluation.
Good to Have: