Summary: The role involves implementing and managing data ingestion and pipeline processes on the Google Cloud Platform. This includes designing developing and troubleshooting data workflows while ensuring compliance with technical specifications and business requirements. The position requires collaboration with teams project management and testing of technical solutions.
Position Info:
- Title: Data Engineer
- Client: LL Bean
- Duration: 6 Months
- Location: FREEPORT ME 04033
- Work Mode: Remote
Responsibilities:
- Design and implement data ingestion and pipeline workflows based on business and technical requirements.
- Collaborate with project teams and communicate progress and issues.
- Develop technical solutions through code development and tool configuration.
- Query databases using SQL for analysis and troubleshooting.
- Conduct testing (unit system integration user acceptance) and document results.
- Estimate time for tasks participate in project planning and track financial aspects.
- Review designs configurations and code for quality and security compliance.
Skills/Qualifications:
Required:
- Google Pub/Sub BigQuery Google Dataform Google Cloud Storage
- Data ingestion to BigQuery experience
- Cloud Composer GitHub SQL Software SDLC
- Preferred:
- DBMS connectivity (SQL Server DB2 Oracle) RESTful API and SOAP Webservices experience
- Experience with Jira Confluence Dataflow Terraform Python
- Knowledge of Agile methodologies CI/CD tools and BigQuery query optimization
- Education: 4year Bachelors degree
- Experience: 3 years of relevant professional experience