AWS Data Engineer
AWS Data Engineer
Posted on :
13-10-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Job Title: AWS Data Engineer
Location: St Louis MO Onsite
Duration: Long Term Contract
Description:
- Design develop and maintain scalable data pipelines using Apache Spark and other ETL tools.
- Implement data processing workflows using Apache Airflow to ensure efficient data ingestion and transformation.
- Collaborate with data scientists and analysts to understand data requirements and deliver highquality datasets.
- Write efficient data transformation scripts in Scala and Python to process large datasets.
- Manage data storage solutions on AWS including S3 Redshift and other AWS services.
- Develop and implement CI/CD pipelines to automate data deployment and improve code quality.
- Monitor data pipelines and troubleshoot issues to ensure optimal performance and reliability.
- Document data architecture and workflows to maintain clear communication within the team.
Key Skills:
Data Engineering Data Pipelines Apache Spark ETL Apache Airflow Data Ingestion Scala Python AWS S3 Redshift CI/CD.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
