About the Role
We are looking for an enthusiastic Data Platform Engineer to join our growing team. In this role you will work closely with senior engineers to build and maintain our data platform supporting data processing and analytics across the company. You will have the opportunity to contribute to key data projects learn cuttingedge technologies and help solve realworld data challenges. This is an exciting role for someone eager to develop their data domain skills in a cloudnative fastpaced startup environment.
Key Responsibilities
* Data Platform Support and Development:
Assist in the design development and maintenance of a scalable data platform that supports both batch and realtime data processing.
* Data Pipeline Development:
Collaborate with senior engineers to develop and manage ETL/ELT pipelines ensuring the timely and accurate ingestion transformation and distribution of data across the company.
* RealTime Data Processing:
Contribute to the implementation of realtime data processing solutions using tools like Apache Kafka and Apache Flink ensuring lowlatency highthroughput data streams.
* Data Storage Management:
Support the optimization of data lakes and warehouses to ensure efficient data storage retrieval and costeffective management.
* Monitoring and Troubleshooting:
Assist in implementing monitoring solutions and frameworks to ensure data accuracy and system reliability. Help identify and resolve performance issues in data pipelines.
* Collaboration and CrossTeam Support:
Work with data scientists analysts and product teams to understand business needs and help deliver scalable data solutions that meet those requirements.
* Data Security and compliance:
Implement data security and compliance measures to ensure data integrity and privacy
* Learning and Growth:
Take ownership of assigned tasks proactively seeking mentorship from senior engineers and continuously improving your skills in data engineering.
Required Qualifications
* 3 years of handson experience in data engineering/ data platform engineering or a related field.
* Experience developing and maintaining data pipelines (ETL/ELT) in cloud environments (AWS preferred).
* Familiarity with distributed data processing frameworks (e.g. Apache Spark) and realtime streaming technologies (Kafka Flink).
* Familiarity with modern data lake architecture and various table formats like Apache Hudi Iceberg delta lake.
* Handson programming experience in Python and/or Java with the ability to write efficient maintainable code.
* Handson SQL and/or NoSQL experience.
* Familiarity with cloud infrastructure management tools such as Terraform or Ansible.
* Strong problemsolving skills with a focus on incremental delivery and adaptability to evolving project needs.
* Good communication skills and a willingness to learn and collaborate with crossfunctional teams.
* Bachelor s/Masters degree in Computer Science Engineering or a related field.
Preferred Qualifications
* Familiarity with DataOps CI/CD and IaC related to data engineering domain.
* Knowledge of Kubernetes is a plus.
* Previous experience in a startup or fastpaced environment is a plus.
Location: Bangalore
Work Policy: Hybrid (Startup Environment)
data engineering,dataops,etl,nosql,aws lambda,elt,apache,ansible,data,python,java,apache flink,apache kafka,kubernetes,ci/cd,sql,terraform,aws,apache spark
Junior Data Engineer
