Job Title: Senior Data Engineer (AbInitio) or AbInitio Data Integration Specialist
Client: Health Insurance Company
Duration: 12 Months
Location: Reston VA 20191
General Information
Job Description:
The Senior Data Engineer is responsible for orchestrating deploying maintaining and scaling cloud or onpremise infrastructure targeting big data and platform data management (Relational and NoSQL distributed and converged) with an emphasis on reliability automation and performance. This role will focus on developing solutions and helping transform the companys platforms to deliver datadriven meaningful insights and value.
Essential Functions:
- Work with Business Analysts and Product teams to gather data requirements.
- Design and build Ab Initio data graphs and data pipelines to extract data from various databases flat files and message queues.
- Transform the data to create a consumable data layer for various application uses.
- Support data pipelines with bug fixes and additional enhancements.
- Document technical design and operational runbooks.
Qualifications:
Education Level:
- Bachelors Degree in Computer Science Information Technology Engineering or a related field.
Experience:
- 10 years of IT experience predominantly in Data Integration/Data Warehousing.
- 5 years of ETL Design and Development experience using Ab Initio.
- 12 years of Data Integration project experience on Hadoop platforms preferably Cloudera.
- Experience with Ab Initio CDC (Change Data Capture) in Data Integration/ETL settings.
- Working knowledge of HDFS Hive Impala and other Hadoop technologies.
- Knowledge of AWS services is nice to have.
- Proficient in SQL and ability to write highperformance queries.
- Familiar with OLTP and OLAP data models and data warehouse fundamentals.
- Strong code quality and automated testing practices.
- Experience with Unix/Linux shell scripting.
- Ability to work independently and support junior developers.
- Java development experience is a plus.
- Familiarity with Agile development practices.
#ZR