drjobs Data Engineering Lead

Data Engineering Lead

Employer Active

1 Vacancy
drjobs

Job Alert

You will be updated with latest job alerts via email
Valid email field required
Send jobs
Send me jobs like this
drjobs

Job Alert

You will be updated with latest job alerts via email

Valid email field required
Send jobs
Job Location drjobs

Dangs (India) - India

Salary drjobs

Not Disclosed

drjobs

Salary Not Disclosed

Vacancy

1 Vacancy

Job Description

What we are looking for

Youll build and maintain systems for efficient data collection storage and processing to ensure data pipelines are robust and scalable for seamless integration and analysis. We are seeking an individual who not only possesses the requisite expertise but also thrives in the dynamic landscape of a fastpaced global firm.

What you ll do

  • Design/implement complex and scalable enterprise data processing and BI reporting solutions.
  • Design document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBt and airflow.
  • Ensure strict data compliance security and cost optimization. Rearchitect data solutions for scalability reliability and resilience.
  • Manage data schemas and flow to ensure compliance integrity and security.
  • Deliver endtoend data solutions across multiple infrastructures and applications.
  • Actively monitor and triage technical challenges in critical situations that require immediate resolution.
  • Develop relationships with external stakeholders to maintain awareness of data and security issues and trends.
  • Review work from other tech team members and provide feedback for growth.
  • Effectively mentor and develop your team members.

Must have

  • 812 years of experience in a data engineering role with an engineering degree in background.
  • Expertise in writing SQL and database objects Stored procedures functions and views. Handson experience in ETL/ELT and data security SQL performance optimization and job orchestration tools and technologies e.g. DBt APIs Apache Airflow.
  • Knowledge of data warehouses (Redshift Snowflake Databricks Cloudera).
  • Proficient in Python scripting PySpark and Spark.
  • Experience with data ingestion storage and consumption.
  • Skilled in SQL and data schema management.
  • Excellent leadership communication and interpersonal skills with the ability to build and motivate highperforming teams.
  • Strong project management skills with experience in defining project scope objectives and deliverables developing project plans and managing project budgets and resources.
  • Domain knowledge of the pharma landscape is a plus.

sql,dbt,data schema management,etl,data storage,apache airflow,data warehouse architecture,leadership,job orchestration,spark,data engineering,sql performance optimization,data warehousing,data consumption,aws,pyspark,communication,snowflake,elt,apis,data security,project management,data ingestion,python,interpersonal skills

Employment Type

Full Time

Company Industry

Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.