Job Description
- Experienced Senior Data Engineer (810 years)
- Proficient across the software development life cycle adept at Data Warehousing ETL Concepts MS SQL Azure Data Factory Azure Data Lake Storage Databricks Amazon Web Services PySpark Spark SQL and Python.
- Develop deploy and manage scalable pipelines on Databricks ensuring robust integration with Databricks Feature Store leveraging online tables for machine learning models.
- Experience of architecture design and development on GCP /AWS/Azure Databricks platform using Lakehouse architecture and utilizing Databricks tools/utilities such as Delta Lake Autoloader Delta Live Tables Unity Catalog Orchestration Analytics/Machine Learning etc.
Key skills:
Data Modelling
Python Pyspak
SQL and SQL Procedure
Databricks This is the key. Proficiency in Databricks
ETL Data Pipeline