drjobs Data Engineer English

Data Engineer

صاحب العمل نشط

drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني
Valid email field required
أرسل الوظائف
drjobs
أرسل لي وظائف مشابهة
drjobs

حالة تأهب وظيفة

سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكتروني

Valid email field required
أرسل الوظائف
موقع الوظيفة drjobs

الهند

الراتب الشهري drjobs

لم يكشف

drjobs

لم يتم الكشف عن الراتب

الوصف الوظيفي

This role will design develop and maintain the data processing platform on Azure. The purpose of the data
platform is to integrate data across the organization to empower and provide business partners vendors and
customers with actionable insights. The right candidate will implement best practices using expertise in Azure
Data Services to build a scalable secure and governed platform. Their expertise will provide continued
Responsibilities / Accountabilities:
Develop pipelines in Synapse that ingest data from a growing number of data sources.
Implement data quality checks and validation processes to ensure accuracy consistency and integrity.
Identify design and integrate process improvements: automate manual processes timely data delivery
and redesigning for future use cases.
Engage business partners to deeply understand the business requirements for all data transformations.
Monitor pipeline operations tasks resource utilization and failures.
Support HA DR Backup and retention policies on all data platforms Ensure compliance with IT General
Controls provide needed information in support of audits and to substantiate process and controls
compliance.
Produce documentation for data models transformations business rules and lessons learned that allows
other staff members to understand the ingestion process and maintain and troubleshoot it
Understand technical requirement of project and convert requirement to junior team members for
execution
Mentoring and leading junior data engineers in best practices and techniques for on time delivery of data
products.
Technical lead in data engineering space
Drive continued development of data engineering skills for junior data engineers
Requirements (education experience competencies and specific job requirements):
10 years of IT experience in Data and Analytics data integration or data ingestion.
3 years of experience in Azure Cloud Services (PaaS & IaaS) Azure Data Factory Azure Synapse
Analytics Azure Analysis Service Application Insights Azure Monitoring Azure Data Lake.
2
Education / Certification:
Bachelor's degree in computer science.
Certifications considered a plus especially those focused on data and analytics
Experience and Skills:
Collaborations across Data intelligence cross functional team
Good experience in tracking and logging end to end software application build using Azure Dev Ops.
Having Data warehousing experience in Business Intelligence Technologies and Database with Extensive
Knowledge in Data analysis TSQL queries ETL and ELT process Reporting services using (Power BI).
Design Enterprise level data warehouse solutions and lead multiple implementations.
Have good experience designing cloudbased solutions in Azure by creating Azure SQL database setting
up Elastic pool jobs and designing tabular models in Azure analysis services.
Have extensive experience in creating pipeline jobs schedule triggers using Azure data factory.
Experienced ability in performance Tuning Query Optimization
Involved in full life cycle of software design process of projects including prototyping proof of concepts
design interface implementation testing and maintenance.
Good experience in maintaining version control using Azure Dev Ops.
Knowledge of SAP source system and BW is a plus.
Emotional intelligence flexible work style and excellent diplomatic skills across all levels of an
organization
Strong oral and written communication skills with a high degree of comfort with varying types of
audiences.
Experience designing and delivering complex solutions on time and with expected quality.

نوع التوظيف

دوام كامل

المهارات المطلوبة

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • البيانات الضخمة
  • مستودع البيانات
  • Kafka
  • Scala

نبذة عن الشركة

الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل. نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا