Key Responsibilities:
Design and implement data solutions using Azure services: You will be responsible for designing
and implementing data solutions using Azure services such as Azure Data Factory Azure
Databricks Azure Stream Analytics Azure SQL Database and others.
Data modeling and data warehousing: You will be responsible for creating and implementing
data models and data warehousing solutions using tools like Azure Synapse Analytics.
Data integration: You will be responsible for integrating data from various sources including
structured and unstructured data into Azure data solutions.
Data processing and data analysis: You will be responsible for processing and analyzing data
using Azure services like Azure HDInsight Azure Stream Analytics and Azure Databricks.
Data management and governance: You will be responsible for managing and governing data
using Azure services like Azure Data Catalog Azure Purview and Azure Data Share.
DevOps and automation: You will be responsible for automating data engineering tasks using
Azure DevOps PowerShell and other tools.
Performance optimization and scalability: You will be responsible for optimizing performance
and scalability of Azure data solutions.
Security and compliance: You will be responsible for ensuring that Azure data solutions are
secure and compliant with regulatory requirements.
Collaboration and communication: You will be responsible for collaborating with other data
engineers data scientists and stakeholders to design and implement data solutions that meet
business requirements.
Essentials:
57 years of extensive experience in a Data Engineer role
Experience with Python SQL and SQL databases
Experience with Azure(if not then other cloud platforms)
Experience of the full software development life cycle with industry best practices is crucial
knowledge of Azure CI/CD is preferred
Experience with ETL data inflow and data outflow
Experience building and optimizing data pipelines to and from data warehouses
Experience supporting and working with crossfunctional teams in a dynamic environment
Experience working on evaluating prioritizing and developing product features
Experience working in a startup environment
Nicetohaves:
Knowledge of cookies tracking and compliance
Working in a marketing/salesbased engineering role or a good understanding of the
marketing/sales function
Understanding of Machine Learning algorithms and techniques
data engineering,azure,data warehousing,sql,snowflake,python