Take ownership of the entire data engineering lifecycle including design implementation performance tuning and monitoring
Manage and work with the firms database managed service provider (MSP) to manage and monitor the firms evolving database requirements
Design develop and maintain scalable data pipelines and ETL processes critical to support business operations and analytics. (Python / SQL)
Optimize and tune data systems for high performance and reliability
Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver highquality data solutions
Implement and manage data storage solutions in cloud environments (AWS Azure Google Cloud)
Ensure data quality and integrity through rigorous testing and validation
Continuously evaluate and integrate new technologies and tools to improve data processing capabilities
Manage distributed scheduled tasks on individual servers to a centralized ruleset
Work with the development team and database MSP to modernize the backup and recovery strategy for 34 SQL servers across different cloud environments
Support the addition of new tenants on the firms production data platform
Qualifications:
Bachelors or Masters degree in Computer Science Engineering Information Technology or a related field from a toptier university.
45 years of relevant professional experience in data engineering
Strong programming skills in SQL and Python.
Proficiency in database administration
Proven experience migrating onprem data and associated processes to cloud platforms (AWS Azure Google Cloud)
Demonstrated ability to design and implement efficient and reliable data pipelines and ETL processes
Strong problemsolving skills and ability to troubleshoot complex data issues
Excellent communication skills and ability to work collaboratively in a team environment
A proactive mindset with a willingness to take ownership and drive projects to completion. Strong organizational skills along with a desire to continually be challenged
Experience with monitoring CI/CD Load Balancing and Testing tools (e.g. Redgate Datadog)
Qualifications:
Bachelors or Masters degree in Computer Science Engineering Information Technology or a related field from a toptier university.
45 years of relevant professional experience in data engineering
Strong programming skills in SQL and Python.
Proficiency in database administration
Proven experience migrating onprem data and associated processes to cloud platforms (AWS Azure Google Cloud)
Demonstrated ability to design and implement efficient and reliable data pipelines and ETL processes
Strong problemsolving skills and ability to troubleshoot complex data issues
Excellent communication skills and ability to work collaboratively in a team environment
A proactive mindset with a willingness to take ownership and drive projects to completion. Strong organizational skills along with a desire to continually be challenged
Experience with monitoring CI/CD Load Balancing and Testing tools (e.g. Redgate Datadog)
Plus
Knowledge of fixedincome or equity data and/or risk management in a fixedincome environment (security master trading position tables) a strong plus
Experience managing and updating technologies such as Jenkins NGINX Celery Octopus TeamCity all strong pluses
Experience with frontend programming languages/tools such as JavaScript TypeScript React or AGGrid a plus
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.