Data Engineer III
Posted on :
20-09-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This is a remote position.
We are seeking for a Data Engineer III to join our team. As a data engineer you will be focused on developing tools libraries and operations to support data scientists and analysts as they discover new and exciting ways to apply our data.
Responsibilities:
- Develop high volume data processing jobs across various platforms including Redshift Athena Iceberg Spark and Airflow.
- Work closely with Data Scientists to turn theory and methodology into viable products.
- Identify bottlenecks in system performance and make recommendations on improving process efficiency.
- Support and collaborate with data scientists analysts and product managers.
Requirements
- Bachelors degree in Computer Science or related field or equivalent experience.
- Strong understanding of programming concepts with experience in at least 1 OOP language (Python Scala Java).
- Strong background and 3 years of direct experience working with Python.
- Experience with high volume distributed data processing in Spark.
- Strong working knowledge of SQL databases (MySQL / Redshift / Athena / Trino) data modeling and modern data warehouse (lakehouse) management.
- Excellent troubleshooting and analysis skills.
- Excited to learn and work with new technologies in a dynamic environment.
- Strong communication skills both in person and via virtual mediums.
- Strong time management skills and a self driven work ethic.
- Experience with AWS cloud services is a plus.
- Experience with event driven architecture and streaming data pipelines is a plus
- Background check required.
Benefits
Work Location: Remote
5 days working
Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java). Strong background and 3+ years of direct experience working with Python. Experience with high volume distributed data processing in Spark. Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management. Excellent troubleshooting and analysis skills. Excited to learn and work with new technologies in a dynamic environment. Strong communication skills both in person and via virtual mediums. Strong time management skills and a self driven work ethic. Experience with AWS cloud services is a plus. Experience with event driven architecture and streaming data pipelines is a plus Background check required.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
