Data Engineer
Data Engineer
Posted on :
20-07-2024
Employer Active
The job posting is outdated and position may be filled
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Title Data Engineer (Ideally an expert)
Location Remote
Job Description
- ADF Will be used for ingestion pipeline and orchestration for entire pipeline
- Azure Databricks Will be used for transformation and storage. Resource should have Unity catalog knowledge as OFT is using UC for governance tag and document data assets.
- Python Will be used for writing notebooks in Databricks
- Pyspark Will be used for interfacing with Spark using Python and some data transformation.
- Datamodeling Knowledge is expected for onsite resource. Optional for offshore.
- Healthcare domain knowledge Optional
- CI/CD/DevOps Optional
- Testing using Pytest Let us set the expectations with the resources that they will have to learn Pytest on the job and automate some data validation procedures.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
