Technical Lead Data
Greater Noida - India
Job Summary
SEI Hiring Manager - Anup Yadav
Data Engineer - dbt & Apache Airflow
Experience: 4-6 years Employment Type: Full-time Function: Data Engineering
Design and develop dbt pipelines and reusable transformation models using complex SQL queries.
Build modular dbt models across staging intermediate and business layers using appropriate materializations such as views tables and incremental models.
Apply dbt concepts including sources ref() tests macros snapshots seeds documentation lineage and environment-specific configuration.
Create and maintain Apache Airflow DAGs to schedule orchestrate monitor and troubleshoot dbt and data-processing workflows.
Define clear task dependencies retry behavior scheduling parameterization logging alerts and failure-handling mechanisms in Airflow.
Write efficient SQL using joins CTEs aggregations window functions subqueries and data-quality validation logic.
Analyze and optimize transformation queries for readability performance scalability and maintainability.
Use Python scripts for workflow utilities validation automation file handling database interaction and operational support.
Work with Oracle databases to understand schemas tables views data types constraints query behavior and connectivity requirements.
Implement data-quality checks unit tests reconciliation controls and pipeline validation before production deployment.
Investigate pipeline failures identify root causes resolve data issues and support re-runs or backfills without introducing inconsistencies.
Participate in requirement analysis technical design code reviews version control deployment activities and production support.
Create and maintain technical documentation for models DAGs dependencies operational procedures and known limitations.
Collaborate with data engineers analysts architects QA teams and business stakeholders to deliver dependable data products.
4-6 years of relevant experience in data engineering analytics engineering ETL/ELT development or a comparable role.
Strong hands-on experience with dbt development and a good understanding of dbt project structure models materializations tests macros snapshots documentation and lineage.
Strong SQL skills including the ability to develop and troubleshoot complex transformation queries.
Working knowledge of Apache Airflow including DAG development task dependencies scheduling retries logging monitoring and operational troubleshooting.
General understanding of Oracle Database concepts SQL execution schemas database objects and connectivity.
Working knowledge of Python scripting for automation and data-processing tasks.
Experience with Git or another version-control system and familiarity with collaborative development practices.
Good analytical debugging problem-solving documentation and communication skills.
Experience with incremental data processing data warehousing concepts dimensional modelling and data lineage.
Exposure to CI/CD practices for dbt and Airflow deployments.
Experience with data-quality frameworks monitoring alerting secrets management and environment configuration.
Familiarity with Agile delivery peer reviews release processes and production support.
Exposure to cloud data platforms or additional relational databases is an advantage.
Competency | Expected Level | Practical Expectation |
dbt | Strong | Develop models tests macros documentation and incremental transformations. |
SQL | Strong | Write and optimize complex queries using joins CTEs aggregations and window functions. |
Apache Airflow | Intermediate | Develop and support DAGs with scheduling dependencies retries logging and alerts. |
Oracle Database | General / Working | Understand schemas objects data types query behavior and connectivity. |
Python | Working | Create scripts for automation validation utilities and data-processing support. |
Git / CI-CD | Working | Use branching pull requests reviews and controlled deployment practices. |
Dbt models and Airflow workflows are delivered with clear structure documentation tests and traceable dependencies.
Transformation logic produces accurate results and meets agreed data-quality and performance expectations.
Pipeline failures are diagnosed promptly and recurring issues are reduced through durable fixes and monitoring.
Code is readable reusable reviewable and aligned with team engineering standards.
Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent practical experience.
Required Experience:
Senior IC
About Company
Coforge is a global digital services and solutions provider that combines AI engineering with deep industry expertise to deliver real world business impact for leading enterprises.