Job tittle : Azure Data Engineer
Location : New jersey
Duration :12months
Tax terms : C2CW21099
Job Description
- 4 years of experience in Databricks is must*
- IT professional experience in Azure Cloud over 7 years working as Azure Developer
- Worked on multiple projects as developer using Datafactory from data receiving validation transform and then publish
- Worked on Data Factory pipelines and AppLogic after gathering and translating end user requirements
- Ability to recreate existing legacy application logic and functionality into Azure Data Factory/Data Lake SQL Database and SQL Datawarehouse environment
- Good to have:
- Experience managing databases Azure Data Platform services (Azure Data Lake (ADLS) Data factory (ADF) Data Lake Analytics Stream Analytics Azure SQL DW HDInsight/Databricks NoSQL DB) SQL Server Oracle Data Warehouse etc.
- Experience in implementing hybrid connectivity between Azure and onpremise using
- Plan and Develop roadmaps and deliverables to advance the migration of existing solutions onpremise systems/applications to Azure cloud
- Experience with Azure transformation projects and Azure architecture decision making Architect and implement ETL and data movement solutions using Azure Data Factory (ADF) SSIS
- Experience in developing roadmaps and deliverables to advance the migration of existing solutions onpremise systems/applications to Azure clou
- Experience in establishing Data Factory development standards and best practices
Skill sets needed ETL Tools: Azure Data Factory (ADF) Azure Databasemigration service (DMS) ETL SQL server integration services (SSIS) SQL server reporting services (SSRS) ETL extract transformation and load Business Intelligence (BI) BCP.
Azure Cloud: Azure SQL Database Azure Data Lake Azure Data Factory (ADF) Azure SQL Data Warehouse Azure Service Bus Azure analysis service (AAS) Azure Blob storage Azure Search Azure App service Redis cache using pipeline and SSIS infrastructure as a service(IaaS) Database as a service (DBaaS) DataMigration service (DMS) Azure SQL Data Elastic Pools Geo Replication Geo restore JSON ARM template SQL Data Synch Azure Cli Azure SQL Analytics Azure Network components (virtual network network security group User defined Route Gateway Load Balancer etc Virtual .machines Traffic manager VPN