Job Title: Databricks Architect
Job Location: Remote
Job Duration: Long-Term
Job Description:
- Demonstrate a deep knowledge of Databricks products and solutions , and ability to operationalize, leading data and analytics initiatives
- Partner end-to-end with Product Managers and Data Scientists to understand customer requirements and design prototypes and bring ideas to production.
- Expert in Databricks design, coding, and scripting.
- Facilitate problem diagnosis and resolution in technical and functional areas.
- Encourage change, especially in support of data engineering best practices and developer satisfaction.
- Demonstrate correctness with pragmatic automated tests.
- Review the work of other engineers in a collegial fashion to promote and improve quality and engineering practices.
- Develop strong working relationships with others across levels and functions.
- Participate in, and potentially coordinate, Communities-of-Practice in those technologies in which you have an interest.
- Serve as a member of an agile engineering team and participate in the team's workflow.
What you know:
- 5 - 8 years of experience as a in Big Data
- 2-4 years of experience in Databricks (Knowledge is also fine)
- Experience in driving end to end programs from Source to consumption, distributed, scalable, and reliable data pipelines that ingest and process data at scale and in batch and real-time.
- Strong knowledge of programming languages/tools including Scala, Python, Spark, SQL, Hive, PowerBi
- Added plus: Experience with streaming technologies such as Spark streaming. messaging systems, such as Kafka, implementing Lambda Architecture.
- An understanding of software development best practice
- Enthusiasm for constant improvement as a Databricks Data Engineer
- Ability to review and critique code and proposed designs and offer thoughtful feedback in a collegial fashion.
- Skilled in writing and presenting -- able to craft needed messages so they are clearly expressed and easily understood.
- Ability to work independently on complex problems of varying complexity and scope.
- Very good communication skills.
- Strong Experience in Agile practice
- Minimum 5 years of experience.
- Good to have Databricks certification.
Education:
- Bachelor's degree in Computer Science, Engineering or equivalent demonstrable experience