drjobs Lead Data Engineer

Lead Data Engineer

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Pittsburgh, PA - USA

Monthly Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

Title: Data Engineering Lead

Location: Pittsburgh PA (3 days onsite/hybrid)

Rate: Only W2

Duration: initially through end of 2025 likely extended in 2026 (potential for conversion)

we have an immediate opening for a Data Engineering Lead. This is a very handson Technical Lead role will be doing 7580% handson Data Engineering including design.

The ideal candidate is an experienced Data Engineering Lead with a strong background in Snowflake Python PySpark SQL and Azure cloudbased data solutions. They are a selfmotivated independent problemsolver who is eager to learn new skills and adapt to changing technologies. Collaboration performance optimization and a commitment to maintaining data security and compliance are critical for success in this role.

DaytoDay

  • Serve as the subject matter expert in technologies used for our data strategy in the cloud.
  • Design develop optimize and maintain data architecture and pipelines that adhere to ETL principles and business goals.
  • Solve complex data problems to deliver insights that helps the organizations business to achieve their goals.
  • Create data products for analytics and data scientist team members to improve their productivity.
  • Advise consult mentor and coach other data and analytic professionals on data standards and practices.
  • Foster a culture of sharing reuse design for scale stability and operational efficiency of data and analytical solutions.
  • Lead the evaluation implementation and deployment of emerging tools and process for analytic data engineering to improve the organizations productivity as a team.
  • Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
  • Utilize programming & scripting languages like Python Spark (PySpark) and OpenSource RDBMS and NoSQL databases and Cloud based data warehousing services such as and Snowflake
  • Share your passion for staying on top of tech trends experimenting with and learning new technologies participating in internal & external technology communities and mentoring other members of the engineering community

Primary Skill Set:

  • Bachelors degree in computer science engineering or a related discipline or equivalent work experience required.
  • 710 years of experience in data management services such as the following required.
    • Data Handling: Managing storing and organizing large volumes of data.
    • Data Integration: Combining data from different sources to create a unified view.
    • Data Quality: Ensuring the accuracy consistency and reliability of data.
    • Data Security: Protecting data from unauthorized access and breaches.
    • Data Analysis: Analyzing data to extract meaningful insights and support decisionmaking.
    • Database Management: Working with various database systems to store and retrieve data efficiently.
    • Big Data Technologies: Utilizing tools and technologies like Hadoop Spark and others to process and analyze large datasets.
  • 5 years of advanced Python programming experience is required.
  • 5 years of advanced SQL querying skill is required.
  • 2 years of Big Data technologies like HDFS Spark (PySpark) and various data store technologies from onprem to cloud required.
  • 2 years of Azure Cloud experience required.
  • 2 years experience with enterprise BI Reporting Tools such as PowerBI Tableau or Qlikview (PowerBI preferred).
  • 12 years of Snowflake Cloud Database required.
  • Experience in creating data pipelines to move and transform data on a large scale in an enterprise organization.
  • Strong experience in SDLC DevOps processes CI/CD tools Git etc.
  • Strong analytical skills and attention to detail
  • Improve data quality and performance.

Snowflake,Azure,Python

Employment Type

Full Time

Company Industry

About Company

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.