drjobs Sr Data Engineer

Sr Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Bellevue - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Role: Sr Data Engineer

Location: Bellevue WA/Remote
Duration: 1 years

Description

We operate in an Azure Databricks Lakehouse. Well need a person with:
Azure experience ADF for orchestration ADLS for storage AzureDevOps for CI/CD
Databricks experience all compute/ETL leverages Databricks and is programmed leveraging Spark (PySpark SparkSQL)
PowerShell experience this is our scripting language of choice
SQL proficiency its used everywhere (TSQL PostgreSQL)
Proficiency with parquet and delta formats
Additionally they will need experience in:
SDLC CI/CD we follow a standard deployment process (dev test prod) that includes peer reviewed code. They need to be comfortable with standard DevOps practices.
Should have a deep understanding of indexes and partitioning.
Should be proficient optimizing code for performance (able to read a DAG determine where CBO is using most resources)
Should be proficient in writing code in a matter that it can run repeatedly and produce the same state (we have a custom SQL Deployment framework)

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.