Job Title: Java spark with AWS (Snow flake exposure required)
Location : Plano TX / Wilmington DE
Type: C2C/W2/Fulltime
Job Description
- Design develop and maintain scalable data pipelines using Apache Spark and Java.
- Implement data processing workflows and ETL processes to ingest transform and store large volumes of data.
- Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver highquality data solutions.
- Optimize and tune data processing jobs for performance and costefficiency.
- Ensure data quality integrity and security across all data pipelines and storage solutions.
- Develop and maintain data models schemas and documentation.
- Monitor and troubleshoot data pipeline issues ensuring high availability and reliability.
- Handson experience with AWS services including S3 EMR Lambda and Glue. Snowflake
- Experience with SQL and NoSQL databases.
- CICd/ Jules /Spinnaker