Lead Data Engineer
Lead Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
The Data Engineering team is looking for people who are passionate about data and are looking to bring their expertise in big data and cloud by working in agile delivery environments to resolve engineering challenges of building robust and scalable data systems aligned to our enterprise data strategy.
As a Lead Data Engineer you will be responsible for understanding the business requirements and translate the data engineering and analytics needs to support the development construction and testing of largescale data processing systems based on AWS cloud to help address the disparate data consumption/integration/operation challenges of a growing organization.
By supporting investment professionals you will see firsthand how your contribution is delivering longterm value to the CPP Fund for the benefit of 20 million CPP contributors and beneficiaries. You are encouraged to bring an innovative mindset to tackle complex business requirements in the investment industry.
Rolespecific Accountabilities:
- Design solutions aligned with longterm architecture and technology strategy using Amazon Web Services (AWS) for Cloud development
- Participate in the development life cycle from start to completion requirements analysis development testing and deployment
- Work with data analysts to select and acquire nontraditional datasets and access clean and preprocess data as required by use cases
- Select appropriate datasets and data representation methods
- Collaborate with data analysts to have necessary data pipelines built
- Build train validate and test models using criteria relevant to business objectives
- Work in a fastpaced environment collaborating with data analysts data engineers and architects
- Ensure architecture will support the requirements of CPP Investments business
- Prepare transform combine and manage structured and unstructured data for use by CPP Investments business users
- Recommend ways to improve data reliability efficiency and quality
- Define and shape CPP Investments future technology and research process
Qualifications :
- University degree in Engineering or Computer Science preferred
- Proven ability to work independently as well as to perform effectively in a teamoriented and openconcept environment
- Deep experience working with big data including cleaning/transforming/cataloguing/mapping/ etc.
- Experienced in cloud technology best practices to enable the distribution and analysis of big data on the cloud (formatting/partitioning/etc.)
- Experience of ETL pipelines managing multiple datasets and providing necessary support
- Familiarity working with data lakes using S3/Redshift
- Exposure to big data workflows and analytics tools (Spark/EMR/Databricks/Cassandra).
- Deep proficiency in Python with experience using Spark Pandas or PySpark.
- An understanding of CI/CD pipelines and experience with DevOps
- Experience building flexible solutions that can adapt quickly to changing requirements.
- Ability to work in an entrepreneurial environment and be a selfstarter
- Interests in the financial industry
- Proven attention to accuracy and detail highly organized with the ability to prioritize and multitask
- Exceptional (written and verbal) communication skills and interpersonal skills
- Ability to work in a high performing culture with timesensitive deadlines
- Personable easily interacts with all types of personalities and at all levels with a high degree of professionalism
- Exemplify our Guiding Principles of Integrity Partnership and High Performance
Additional Information :
Visit our LinkedIn Career Page or Follow us on LinkedIn. #LIAC! #LIOnsite
At CPP Investments we are committed to diversity and equitable access to employment opportunities based on ability.
We thank all applicants for their interest but will only contact candidates selected to advance in the hiring process.
Our Commitment to Inclusion and Diversity:
In addition to being dedicated to building a workforce that reflects diverse talent we are committed to fostering an inclusive and accessible experience. If you require an accommodation for any part of the recruitment process (including alternate formats of materials accessible meeting rooms etc.) please let us know and we will work with you to meet your needs.
Disclaimer:
CPP Investments does not accept resumes from employment placement agencies headhunters or recruitment suppliers that are not in a formal contractual arrangement with us. Our recruitment supplier arrangements are restricted to specific hiring needs and do not include this or other website job postings. Any resume or other information received from a supplier not approved by CPP Investments to provide resumes to this posting or website will be considered unsolicited and will not be considered. CPP Investments will not pay any referral placement or other fee for the supply of such unsolicited resumes or information.
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
