Description
Job Title : Data Engineer
Location : Bangalore (Hybrid)
Position Overview
- We are looking for an exceptional data engineer to transform optimize test and maintain architectures for enterprise analytics databases data apis as well as optimizing data flow and collection for cross functional teams.
- The mission of the team is to empower decision makers and the broader data communities through trusted data assets and scalable selfserve analytics.
- The focus of work will be engineering new data APIs Tuning data Apis for efficiency and scalability implementing best practises and create Automated tests for API performance result validations.
Responsibilities
- Maintain/develop data APIs efficiency and scalability implementing best practises and create Automated tests for API performance result validations with Python based API technologies such as Flask/Fast API with Snowflake as data source
- Design implement test and maintain data pipelines/ new features based on stakeholders with Snowflake SQL DBT Airflow
- requirements
- Snowflake Query performance optimizations
- Develop/maintain scalable available quality assured analytical building blocks/datasets by close coordination with data analysts
- Contribute to Analytics engineering process
Minimum Qualifications
- Bachelors/ Masters degree in computer science information systems or a related discipline and 5 years in the Data Engineer role
- Data API development experience with efficiency and scalability focus with Python based libraries like Flask/Fast API
- Experience with Snowflake and cost optimizations techniques
- Overall solid programming skills able to write modular maintainable code preferably Python & SQL
- Have experience with workflow management solutions like Airflow
- Have experience on Data transformations tools like DBT
- Built processes supporting data transformation data structures metadata dependency data quality and workload management
- Experience working with Git
- Strong analytical problem solving and interpersonal skills
- Familiar with Scrum
Preferred Qualifications
- API management
- CI/CD (Jenkins)
- AWS environment for example S3 Lambda Glue Cloud watch
- Experience working with remote teams spread across multiple timezones
- Strong organizational skills and attention to detail