Senior Data Engineer (5 Years Experience)
Location: Hybrid Pune (Relocation Preferred)
Budget: 811 LPA
Shift: 8:30 PM 11:30 PM IST (US Time Zone Overlap)
Are you a data wizard with expertise in streaming technologies and a passion for building efficient scalable data platforms If yes we want YOU! Here s your chance to join a dynamic team and make a huge impact!
Key Responsibilities:
- Design develop and maintain an accurate secure and fast data platform
- Engineer adaptable and scalable data pipelines to handle multiple data sources (databases APIs files logs events)
- Implement ETL pipelines and manage delta loading and CDC in Snowflake
- Collaborate with diverse stakeholders to deliver tailored data solutions
- Perform data quality checks and automate quality control for seamless operations
Essential Skills:
- Streaming Tech Proficiency: Kafka AWS MSK AWS Kinesis AWS Data Firehose Snowpipe
- CloudOps Expertise: Knowledge of IaC tools like Terraform & Pulumi
- Proficient in Data Modeling and schema design (Star/Snowflake)
- Experience in AWS Data Pipelines (Lambda Glue Step Functions)
- Advanced SQL & at least one programming language (Python Java )
- Familiar with Looker Tableau and data analysis tools
- A keen eye for detail to catch & resolve data quality issues
- Focus on automation & reuse to simplify tasks
Preferred Experience:
- Fintech or Financial Services Industry
- Knowledge of MLOps
- Handson with Pandas Numpy Scikitlearn Jupyter notebooks
aws,java,building,aws data firehose,pulumi,python,aws kinesis,looker,fintech,pipelines,advanced,data,aws data pipelines,data analysis,data quality,terraform,scikit-learn,tableau,aws msk,data modeling,numpy,snowflake,cdc,snowpipe,automation,jupyter notebooks,pandas,advanced sql,mlops,financial services industry,kafka,design