Big Data Lead

Primary Tech skills – AZURE Databricks SQL Pyspark

Secondary Tech skills – Synapse ADF

Responsibilities:

•Experience in Pyspark SQL Cloud data warehouse like Azure Synapse databricks

•Experience working with structured and unstructured data

•Extensive knowledge of Data Warehousing concepts strategies methodologies

•Experience in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and realtime data integration

•Experience in data ingestion preparation integration and operationalization techniques in optimally addressing the data requirements

•Experience in relational data processing technology like MS SQL Delta Lake Spark SQL SQL Server

•Experience with Orchestration tools Azure DevOps and GitHub

•Must be team oriented with strong communication collaboration prioritization and adaptability skill