Azure Data Engineer
Handson programming experience using ADLS ADF Azure Functions Azure SQL
Must have exp on implementing CI/CD for ADLS ADF Azure Functions
Azure storage options Azure Data Lake Storage Azure Blob Storage Azure VM
Azure data factory ADF Components & Basic Terminology Azure Portal Basics & ADF Creation Basic Pipelines Triggers Copy Activity Data Transformation Components and Mappings with DataFlows Linked Services Datasets Parametrization Integration with Different Sources Security Debugging and Troubleshooting
Azure Git Configurations
Must have exp on either python/pyscript
Ability to read architecture diagrams data models data flows
Database design and development SQL Stored Procedures Performance tuning DB design & optimization
Good to have Snowflake experience.
Experience using Azure DevOps GitHub Visual Studio or equivalent
Emphasis on code quality integration testing performance testing and tuning
Hands on developing and system validation and testing of data pipelines flows and services
Development of technical system and process documentation
Analyzing data to effectively coordinate the installation of new or the modification of existing data
Managing the data pipelines through software development lifecycle.
Monitoring data process performance post deployment until transitioned to operations
Communicating key project data to team members and building cohesion among teams.
Developing and executing project plans.