drjobs Sr Data Engineer

Sr Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Wilmington, NC - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Sr Data Engineer
Wilmington DE
Knowledge of distributed systems (e.g. Apache Spark or Databricks)
Knowledge of Delta Lake and Lakehouse architecture
Experience with multiple data programming languages (SparkSQL PySpark Pandas)
Experience with Onpremises databases such as SQL server Oracle etc.
Experience with version control (e.g. Git) DevOps CI/CD
Design and build data pipelines using SparkSQL and PySpark in Azure Databricks.
Build and maintain Lakehouse architecture in ADLS / Databricks.
Perform data preparation tasks including data cleaning normalization deduplication type conversion etc.
Work with DevOps team to deploy solutions in production environments.
Collaborate with Data Science and Business Intelligence teams to share key learnings leverage ideas and solutions and to propagate best practices.
Apply change management tools including training communication and documentation to manage upgrades changes and data migrations.

Employment Type

Full Time

Company Industry

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.