DATA ENGINEER

3to 5 years of experience in Data Engineering using Python along with Pyspark/Spark - MUST

3-5 years of experience in building big data solutions with pyspark , preferably in Data Analytics space MUST

AWS is must have

Hands on in python data frame as well as Python factory design patterns

Working knowledge in Spark and experience in spark data migration, restructuring and data partitioning

Practical knowledge on NFRs performance improvement in Partitioning and remodeling

Hands on development experience in building distributed Big Data solutions including ingestion, caching, processing, consumption, logging & monitoring

Strong technical communication skills

Hands on Experience developing data engineering solutions in python using: S3, EMR, Glue, Athena, kafka and notebooks