Position: PySpark Glue Developer
Location: Pune Gurgaon
Experience: 46 Years
Key Skills:
Nice to Have:
Responsibilities:
- Design develop and maintain efficient scalable solutions using PySpark and AWS Glue.
- Ensure data quality and integrity through rigorous testing validation and data cleansing processes.
- Integrate data from multiple sources such as databases APIs and external datasets.
- Optimize and tune PySpark jobs for enhanced performance and reliability.
- Document data engineering processes workflows and best practices.
- Demonstrate strong knowledge of databases data modeling and ETL tools.
Required Skills:
- Strong programming skills in Python and proficiency with PySpark and SQL.
- Experience working with relational databases and big data technologies like Hadoop Spark Hive and Impala.
- Excellent communication and collaboration abilities.
Education:
- Bachelors or Masters degree in Engineering/Technology (BE/BTech or ME/MTech).
spark,data modeling,aws glue,glue,etl,impala,sql,pyspark,databases,hadoop,aws,python,hive