Employer Active
Job Alert
You will be updated with latest job alerts via emailJob Alert
You will be updated with latest job alerts via emailDatabricks Engineer
Location: Plano TX Hybrid ( need candidates within TX)
Experience : 10 years
Must Have:
1. Databricks
2. Apache Spark
3. Python(and/or Scala)
4. AWS
5. SQL
6. Java
7. CI/CD Pipeline tools
Minimum Industry experience: 10 years
Job Description:
1. Bachelors degree or equivalent work experience
2. Must have experience implementing atleast 2 end to end projects with Databricks which includes components like
Delta lake
Unity Catalog
Databricks Connect
DataBricks API
Databricks workflow Orchestration
3. Must be wellversed with Databricks Lakehouse concepts and its implementation in large scale enterprise environments
4. Must have good understanding to create complex data pipelines and use of data ingestion tools like nifi
5. Must be well versed in using Apache Spark framework and strong in SQL and sparksql
6. Must have excellent coding skills in Python(and/or Scala) preferably Python
7. Must have strong performance optimization skills to improve efficiency and reduce cost using techniques like parallel processing
8. Must have worked on AWS and should have working experience of AWS services like S3 Lambda DynamoDB SQS CloudWatch
9. Must be able to work with architects and lead engineers to design solutions to meet functional and nonfunctional requirements
10. Must have strong written and verbal communication skills
11. Must have experience in an Agile environment
12. Data engineering background is a plus
Full Time