Summary: A Data Integration Specialist is needed for a temporary role to support data migration integration and maintenance in Amazon S3 and Amazon Redshift environments. This role will involve designing implementing and securing data pipelines while ensuring data integrity and optimizing processes.
Position Info:
- Title: Data Integration Specialist
- Client: Office of Innovation & Technology
- Duration: 6 Months
- Location: Philadelphia International Airport 2 International Plaza Suite 2000 Philadelphia PA 19113
- Work Mode: Hybrid
Responsibilities:
- Design and implement ETL/ELT data pipelines into Amazon S3 using Azure Data Factory.
- Set up and configure Amazon S3 buckets and create data schemas in Amazon Redshift.
- Establish automated workflows for continuous data migration and ensure data integrity and security.
- Monitor data pipeline performance and reliability performing maintenance as needed.
- Document and improve data integration processes for efficiency and scalability.
Skills/Qualifications:
- Minimum of 3 years of experience in data integration including pipeline creation documentation and maintenance.
- Proficiency with Azure Data Factory AWS S3 AWS Redshift and AWS Lambda.
- Strong SQL and ETL tool experience.
- Expertise in data security data integrity and effective documentation.
- Preferred: Experience with AWS Glue proficiency in Python C# and sparkSQL.