Data Engineer
Data Engineer
Posted on :
23-11-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Title: Data Engineer
Location: Portland OR (Onsite)
Duration: 6 months
Implementation Partner: Kaleidoscope Innovation
End Client: To be disclosed
JD:
Focus is good communication Python and Spark.
Location: Portland OR (Onsite)
Duration: 6 months
Implementation Partner: Kaleidoscope Innovation
End Client: To be disclosed
JD:
Focus is good communication Python and Spark.
Knowledge of AtScale a Big Big Plus.
Job Responsibility:
- Design and implement scalable data pipelines using PySpark/Python.
- Develop and optimize S L queries for data extraction transformation and loading (ETL) processes.
- Utilize Databricks on AWS to build and manage data workflows.
- Able to read Legacy code and understand it
- Excellent know how on preparing script for data validation
- Monitor and troubleshoot data pipelines to ensure smooth operation.
- Document data processes and workflows for future reference and maintenance.
- Work closely with existing team to understand the requirement and deliver accordingly
Technical Skills:
- Strong proficiency in PySpark and Python programming.
- Extensive experience with S L and database management.
- Handson experience with Databricks on AWS.
- Familiarity with AWS services such as S3 Lambda Glue and Redshift.
- Knowledge of data warehousing concepts and ETL processes.
- Excellent problemsolving skills and attention to detail.
- Strong communication and collaboration skills.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
