Senior Data Engineer New York NY
Our challenge
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic Team. As a Senior Data Engineer Candidate will play a crucial role in designing implementing and maintaining the application and infrastructure for Credit Risk Capital applications ensuring compliance with regulations such as SACCR and CEM.
The Role
Responsibilities:
- Understand and interpret technical specifications.
- Engage in business requirements discussions with business analysts and users.
- Develop and design applications using Python SQL Server Snowflake and Databricks.
- Develop and maintain data models and schemas to support data integration and analysis.
- Implement data quality and validation checks to ensure the accuracy and consistency of data.
- Execute unit testing (UT) and system integration testing (SIT) with business analysts to ensure highquality testing.
- Provide support for user acceptance testing (UAT) with business users.
- Offer production support and maintain the application platform.
Requirements:
You are:
- Approximately 15 years of IT industry experience.
- Strong communication skills.
- Proficiency in Agile methodology and SDLC processes.
- Experience in design and architecture.
- Experience working in a global delivery model (onshore/offshore/nearshore).
- Strong problemsolving and analytical skills.
- Selfstarter collaborative team player with the ability to work with minimal guidance.
Technical Skills:
- Proficiency in Python SQL Server and relational database concepts.
- Experience with Azure Databricks and Snowflake.
- Knowledge of job scheduling tools (Autosys/ControlM).
- Experience with ETL processes.
- Familiarity with CI/CD pipelines.
Preferred Skills:
- Experience with PySpark.
- Background in financial systems capital markets credit risk or regulatory application development.