drjobs Senior Data Engineer

Senior Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

India

Monthly Salary drjobs

INR INR 6500000 - 7500000

Vacancy

1 Vacancy

Job Description

Job Details


The Senior Data Engineer is responsible for orchestrating deploying maintaining and scaling cloud OR onpremise infrastructure targeting big data and platform data management (Relational and NoSQL distributed and converged) with emphasis on reliability automation and performance. This role will focus on developing solutions and helping transform the companys platforms deliver datadriven meaningful insights and value to company.

ESSENTIAL FUNCTIONS:

1) Work with Business Analysts and Product team to gather data requirements
2) Design and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queues
3) Transform the data to create a consumable data layer for various application uses
4) Support Data pipeline with bug fixes and additional enhancements
5) Document Technical design Operational Runbook etc

Qualifications

To perform this job successfully an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge skill and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Education Level: Bachelors Degree
Education Details: Computer Science Information Technology or Engineering or related field

Experience:

  • Total of 10 Years of IT Experience predominantly in Data Integration/ Data Warehouse area
  • Must have at least 5 years of ETL Design and Development experience using Ab Initio
  • 12 years of Data Integration project experience on Hadoop Platform preferably Cloudera
  • AbInitio CDC (Change Data Capture ) experience in a Data Integration/ETL project setting is great to have
  • Working knowledge of HDFS Hive Impala and other related Hadoop technologies
  • Working knowledge in various AWS services is nice to have
  • Sound understanding of SQL and ability to write well performing SQL queries
  • Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals
  • Rigor in high code quality automated testing and other engineering best practices ability to write reusable code components
  • Ability to unit test the code thoroughly and to troubleshoot issues in production environments
  • Must have some working experience with Unix/Linux shell scripting
  • Must be able to work independently and support other junior developers as needed
  • Some Java development experience is nice to have
  • Knowledge of Agile Development practices is required

ab initio,etl design and development,integration,unix/linux shell scripting,aws,data,hadoop,etl,oltp,data warehouse,olap,data integration,other,project,hdfs,agile development,design,code,impala,hive,sql

Employment Type

Full Time

Company Industry

Key Skills

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • Big Data
  • Data Warehouse
  • Kafka
  • Scala
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.