Title : Data Engineer
Experience level : 3 8 years
Position : Consultant / Senior Consultant / Specialist
Requirements:
- 3 8 years of fulltime experience as an Azure Data Engineer with extensive knowledge of ADF ADLS Databricks and Synapse
- Experience using Power BI Desktop with good knowledge of Power Query Power Pivot and Power View
- Able to quickly write SQL for database querying and DAX for creating custom calculations
- Able to develop Extraction pipelines to load the data using ADF or comparable technologies and Transformation and Load pipelines using ADF and Databricks
- Able to design a storage solution on ADLS utilizing Parquet and Delta table formats
- Able to design starschema data models in ADLS Azure SQL and Synapse databases
- Understand data modeling concepts and be able to create effective data models to support reporting needs
- Perform data ETL processes to ensure that data sets are clean accurate and ready for analysis
- Improve the scalability efficiency and costeffectiveness of data pipelines
- Monitor and resolve data pipeline problems to ensure consistency and availability of the data
- Unwavering ability to quickly propose solutions by recalling the latest best practices learned from MVP & Product Team articles MSFT documentation whitepapers and community publications
- Work closely with stakeholders to understand requirements deliver solutions that meet those needs and bridge the gap between technical and nontechnical sides
- Excellent communication presentation influencing and reasoning skills
Primary Skills:
- Data Engineering: Extensive knowledge in Azure SQL TSQL Azure Data Factory Azure Data Lake Azure Databricks Azure Synapse/Data Warehouse SSIS Key Vaults Azure Functions Azure Logic Apps etc
- Reporting: Power BI Desktop PBI Service DAX functions SSRS SSAS (OLAP and Tabular)
- Data Modeling: Design data models for ETL and reporting needs based on the requirements gathered and data discovery conducted in the source systems
- Experience working in Agile environments with continuous integration and continuous deployment and application lifecycle management experience in DevOps CI/CD repos and pipelines and GitHub or Bitbucket
Secondary Skills:
- Experience in detailed design aspects in Azure including design patterns and principles
- Experience with performance tuning of data processing pipelines and cloudbased applications
- Experience in setting up and administering DevOps and GitHub or other automation tools like Jenkins/Puppet/ Ansible/Terraform
- Possess good knowledge of M Vertipaq Analyzer and Power BI Service architecture design and administration
- Certifications in Microsoft Azure Data Analytics and Power BI
Additional Information :
Beware of scams
Our recruiting team may communicate with candidates via our @hitachisolutions.com domain email address and/or via our SmartRecruiters (Applicant Tracking System) domain email address regarding your application and interview requests.
All offers will originate from our @hitachisolutions.com domain email address. If you receive an offer or information from someone purporting to be an employee of Hitachi Solutions from any other domain it may not be legitimate.
Remote Work :
Yes
Employment Type :
Fulltime