2024-7411Data Engineer

Shift: Mid Shift

The Data Engineer III develops implements and maintains data & software solutions that enable business operations to realize company goals and objectives. The incumbent performs complete end to end SDLC including analysis (data analysis) design coding debugging testing and support of software applications. They will be assigned to develop new data integration and transformation software applications/systems enhance/upgrade existing systems or provide production support. They work independently on projects of increased scope and complexity.

• Design and implement ETL processes for data transformation and preparation
• Deploy machine learning models to production environments
• Manage data pipelines for analytics and operational use
• Ensure data accuracy and integrity across multiple sources and systems
• Work in an Agile software development team to deliver new data ETL solutions software and to maintain and support past and future solutions
• Participate in Agile ceremonies and collaborate with the Agile Program Manager (APM) Digital Product Manager (DPM) Business Systems Analyst (BSA) Quality Assurance Analyst (QA) and other Developers to clarify and refine requirements/user stories
• Translate user stories into engineering artefacts and complete software development work which includes application design coding code review and testing
• Keep team and APM apprised of progress
• Works with data & software development peers to ensure that the engineering realization is in accordance with Enterprise Architecture principles and software development best practices.
• Work on performance tuning code optimisation refactoring automation and DevOps (CI/CD) implementation
• Offer suggestions to stakeholders on devising effective and efficient approaches to achieve business objectives
• Manage engineering risks by proactively tracking and communicating issues and devising methods to mitigating them
• Liaise with other teams to coordinate interdependencies and resolve issues
• Supports the resolution of indepth user questions and production issues following support process and SLAs
• Maintain a working knowledge of new technology and software engineering standards practices and tools

Qualifications :

• Minimum 5 years of experience in data engineering & data warehousing with SQLTSQL and Snowflake (SnowSQL)
• Data Modelling
• DevOps: GitHub Actions Harness CI & CD
• Desired: dbt (Jinja) Qlik Data Vault 2.0 Apache Airflow (astronomer)
• Broad expertise in theoretical and practical application of software engineering best practices methods and techniques
• Experience with Agile software development frameworks and processes
• T shaped skill set. In depth knowledge and experience in developing software applications on a specific software platform or technology and broad knowledge of related technologies.
• Desired: Familiarity with Docker Kubernetes and cloud services
• Generative AI (good to have)
• Desired: Advanced knowledge of Python
• Understanding of source code change management primarily using GitHub
• Understanding of continuous delivery integration deployment and tools like GitHub Actions and Harness
• Excellent interpersonal and communication skills. Ability to discuss articulate and simplify technology to nontechnical people.
• Advanced analytical problem solving and organizational skills
• Strong decision making and customer service skills and ability to provide end user/business support when needed
• Knowledge of production support processes such as incident and problem management techniques.

Innovative mindset with adaptable attitude towards change.

Desired Skills:

• Related development experience
• Prior domain experience and expertise in a regulated financial services environment is desirable (specifically in insurance and the London Market)

Additional Information :

• Required knowledge and skills would typically be acquired through a Bachelors degree in Computer Science / Engineering or equivalent work experience

Remote Work :

Yes

Employment Type :

Fulltime