Azure Data Engineer
Azure Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
In this role you will be responsible for working with our Business Analytics & Insights (BAI) team. You will collaborate closely with crossfunctional teams to deliver highquality solutions in domains such as Supply Chain Finance Operations Customer Experience HR Risk Management and Global IT.
Job Responsibilities:
- Be part of the technical plan for the migration including data ingestion transformation storage and access control within Azures Data Factory and data lake.
- Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks.
- Develop scalable and reusable frameworks for data ingestion.
- Ensure data quality and integrity throughout the entire data pipeline implementing robust data validation and cleansing mechanisms.
- Work with eventbased and streaming technologies to ingest and process data.
- Provide support to the team resolving technical challenges or issues during the migration and postmigration phases.
- Stay current with advancements in cloud computing data engineering and analytics technologies recommending best practices and industry standards for implementing data lake solutions.
Qualifications :
- 3 to 5 years of IT experience.
- Minimum of 3 years of experience working with Azure Databricks.
- Expertise in Data Modeling and Source System Analysis.
- Proficiency with PySpark.
- Mastery of SQL.
- Knowledge of Azure components: Azure Data Factory Azure Data Lake Azure SQL DW and Azure SQL.
- Experience with Python programming for data engineering purposes.
- Ability to conduct data profiling cataloging and mapping for technical design and construction of technical data flows.
- Experience with data visualization and exploration tools.
Additional Information :
- Strong problemsolving capabilities able to translate business requirements into data science solutions.
- Excellent communication skills with the ability to explain complex concepts to both technical and nontechnical stakeholders.
- Strong team player with excellent interpersonal and collaboration skills.
- Ability to deliver highquality results within specified timelines.
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
Company Industry
Department / Functional Area
Engineering
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
