Databricks Solutions Architect
Databricks Solutions Architect
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
As a Databricks Solutions Architect at DI you will work on a variety of impactful customer technical projects including designing and building scalable reference architectures and productionalising customer use cases within Capital Markets.
What you will be doing:
- Define endtoend data architectures ensuring best practices for data governance access control and cost optimisation using Unity Catalog and Delta Lake
- Optimise query performance storage and compute efficiency for various workloads
- Develop and deploy ETL/ELT pipelines enabling realtime and batch data processing
- Implement best practices for data ingestion and transformation in financial market data environments
- Guide strategic customers in adopting Databricks Lakehouse as a unified data platform for structured and unstructured market data
- Enhance and grow your knowledge among subject matter experts in our learning and development ecosystem
Qualifications :
- Proficient in data engineering data platforms and analytics
- Deep experience with Python SQL and/or Scala
- Knowledge of two or more common Cloud ecosystems (Azure AWS GCP) with expertise in at least one.
- Deep experience with distributed computing with Apache Spark
- Working knowledge CI/CD for production deployments
- Working knowledge of MLOps
- Familiarity with designing and deploying performant endtoend data architectures
- Experience with technical project delivery managing scope and timelines
- Able to communicate complex technical concepts to business stakeholders
- Adaptable to evolving technologies and projects
- At least one Databricks Certification Data or ML Engineering.
Additional Information :
What we offer:
- Flexible working we offer hybrid working so our people can achieve that elusive work/life balance.
- Professional development we offer extensive training ranging from leadership to specific technical skills.
- Progression opportunities we run a biannual promotion process. Monthly 121s with your People Leader provides support to guide you and your career in the right direction.
- International travel opportunities we offer the opportunity to work internationally with teams in Belfast London New York Hong Kong & Singapore
- Healthcare cover provider is dependent on region UK is provided by Benenden Health including 24/7 GP Service & Mental Health Helpline to give you peace of mind when it comes to your health
- Generous referral scheme we love to see referrals and referring a friend means cash for you!
- Regular social events prizes and giveaways our talented social committee work hard all year round to provide exciting events across all regions to promote our value of togetherness
Who We Are:
Simply put we turn big data problems into smart data solutions.
Data Intellect is a leading data and technology consultancy specializing in creating cuttingedge financial and capital markets technology solutions. Our expertise extends to diverse industries including smart energy and healthcare.
Fair employment and equal opportunities
Data Intellect is an equal opportunity employer committed to inclusion and diversity.
If you have a disability accommodations are available on request throughout the assessment and selection processes.
Ready to accept the challenge
Apply now.
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
