What we are looking for
Youll build and maintain systems for efficient data collection storage and processing to ensure data pipelines are robust and scalable for seamless integration and analysis. We are seeking an individual who not only possesses the requisite expertise but also thrives in the dynamic landscape of a fastpaced global firm.
What you ll do
- Design/implement complex and scalable enterprise data processing and BI reporting solutions.
- Design document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using DBt and airflow.
- Ensure strict data compliance security and cost optimization. Rearchitect data solutions for scalability reliability and resilience.
- Manage data schemas and flow to ensure compliance integrity and security.
- Deliver endtoend data solutions across multiple infrastructures and applications.
- Actively monitor and triage technical challenges in critical situations that require immediate resolution.
- Develop relationships with external stakeholders to maintain awareness of data and security issues and trends.
- Review work from other tech team members and provide feedback for growth.
- Effectively mentor and develop your team members.
Must have
- 812 years of experience in a data engineering role with an engineering degree in background.
- Expertise in writing SQL and database objects Stored procedures functions and views. Handson experience in ETL/ELT and data security SQL performance optimization and job orchestration tools and technologies e.g. DBt APIs Apache Airflow.
- Knowledge of data warehouses (Redshift Snowflake Databricks Cloudera).
- Proficient in Python scripting PySpark and Spark.
- Experience with data ingestion storage and consumption.
- Skilled in SQL and data schema management.
- Excellent leadership communication and interpersonal skills with the ability to build and motivate highperforming teams.
- Strong project management skills with experience in defining project scope objectives and deliverables developing project plans and managing project budgets and resources.
- Domain knowledge of the pharma landscape is a plus.
sql,dbt,data schema management,etl,data storage,apache airflow,data warehouse architecture,leadership,job orchestration,spark,data engineering,sql performance optimization,data warehousing,data consumption,aws,pyspark,communication,snowflake,elt,apis,data security,project management,data ingestion,python,interpersonal skills