drjobs Data Engineer العربية

Data Engineer

Employer Active

drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

India

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Job Description

This role will design develop and maintain the data processing platform on Azure. The purpose of the data
platform is to integrate data across the organization to empower and provide business partners vendors and
customers with actionable insights. The right candidate will implement best practices using expertise in Azure
Data Services to build a scalable secure and governed platform. Their expertise will provide continued
Responsibilities / Accountabilities:
Develop pipelines in Synapse that ingest data from a growing number of data sources.
Implement data quality checks and validation processes to ensure accuracy consistency and integrity.
Identify design and integrate process improvements: automate manual processes timely data delivery
and redesigning for future use cases.
Engage business partners to deeply understand the business requirements for all data transformations.
Monitor pipeline operations tasks resource utilization and failures.
Support HA DR Backup and retention policies on all data platforms Ensure compliance with IT General
Controls provide needed information in support of audits and to substantiate process and controls
compliance.
Produce documentation for data models transformations business rules and lessons learned that allows
other staff members to understand the ingestion process and maintain and troubleshoot it
Understand technical requirement of project and convert requirement to junior team members for
execution
Mentoring and leading junior data engineers in best practices and techniques for on time delivery of data
products.
Technical lead in data engineering space
Drive continued development of data engineering skills for junior data engineers
Requirements (education experience competencies and specific job requirements):
10 years of IT experience in Data and Analytics data integration or data ingestion.
3 years of experience in Azure Cloud Services (PaaS & IaaS) Azure Data Factory Azure Synapse
Analytics Azure Analysis Service Application Insights Azure Monitoring Azure Data Lake.
2
Education / Certification:
Bachelor's degree in computer science.
Certifications considered a plus especially those focused on data and analytics
Experience and Skills:
Collaborations across Data intelligence cross functional team
Good experience in tracking and logging end to end software application build using Azure Dev Ops.
Having Data warehousing experience in Business Intelligence Technologies and Database with Extensive
Knowledge in Data analysis TSQL queries ETL and ELT process Reporting services using (Power BI).
Design Enterprise level data warehouse solutions and lead multiple implementations.
Have good experience designing cloudbased solutions in Azure by creating Azure SQL database setting
up Elastic pool jobs and designing tabular models in Azure analysis services.
Have extensive experience in creating pipeline jobs schedule triggers using Azure data factory.
Experienced ability in performance Tuning Query Optimization
Involved in full life cycle of software design process of projects including prototyping proof of concepts
design interface implementation testing and maintenance.
Good experience in maintaining version control using Azure Dev Ops.
Knowledge of SAP source system and BW is a plus.
Emotional intelligence flexible work style and excellent diplomatic skills across all levels of an
organization
Strong oral and written communication skills with a high degree of comfort with varying types of
audiences.
Experience designing and delivering complex solutions on time and with expected quality.

Employment Type

Full Time

Company Industry

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.