Sr Data Engineer
Sr Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
INR INR 7000000 - 9600000
1 Vacancy
Job Description
- 7 years of data engineering experience developing large data pipelines
- Proficiency in at least one major programming language (e.g. Python Java Scala)
- Handson production environment experience with distributed processing systems such as Spark
- Handson production experience with data pipeline orchestration systems such as Airflow for creating and maintaining data pipelines
- Experience with at least one major Massively Parallel Processing (MPP) or cloud database technology (Snowflake Databricks Big Query).
- Experience in developing APIs with GraphQL
- Advance understanding of OLTP vs OLAP environments
- Graph Database experience a plus
- Realtime Event Streaming experience a plus
- Contribute to maintaining updating and expanding existing Core Data platform data pipelines
- Build and maintain APIs to expose data to downstream applications
- Develop realtime streaming data pipelines
- Tech stack includes Airflow Spark Databricks Delta Lake and Snowflake
- Collaborate with product managers architects and other engineers to drive the success of the Core Data platform
- Contribute to developing and documenting both internal and external standards and best practices for pipeline configurations naming conventions and more
- Ensure high operational efficiency and quality of the Core Data platform datasets to ensure our solutions meet SLAs and project reliability and accuracy to all our stakeholders (Engineering Data Science Operations and Analytics teams)
delta lake,pipelines,spark,databricks,python,core data,airflow,database,graphql,aws,snowflake,data engineering,data modeling,technology,apache spark,data
Employment Type
Full Time
Company Industry
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
