Data Engineer

Role: Data Engineer

Location: NYC, NY Onsite from day 1

Duration: 12+ Months

Interview : 2 coding rounds, Python, SQL

Must have : Tier 1 IT companies experience only

Please avoid Financial , Insurance and Banking sector profiles.

Job Description:

We are looking for Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on partner needs.

Responsibilities

Partner with leadership, engineers, program managers and data scientists to understand data needs.

Design, build and launch extremely efficient and reliable data pipelines to move data across several platforms including Data Warehouse, online caches and real-time systems.

Build data expertise and own data quality for your areas.

Qualifications

SQL coding - Expert in SQL with good understanding of how relational databases work

Experience querying massive datasets using Presto, Hive etc.

Good Python Programming Experience

Experience with Data Warehousing Architecture

Experience with workflow management engines like Airflow, Data swarm, Luigi etc.

2+ years' experience in custom ETL design, implementation and maintenance

Experience with data quality and validation.

Experience with SQL performance tuning and e2e process optimization