Data Engineer
Data Engineer
Posted on :
27-11-2024
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
This is a remote position.
- Develop and maintain data pipelines: Design develop and optimize ETL pipelines that extract transform and load mortgagerelated data from various sources like JSON XML and databases into scalable data stores.
- Work on data mapping and transformation: Collaborate with domain experts to ensure proper mapping of mortgage data fields (MISMO standards) from thirdparty sources into the companys data schema.
- Architect scalable data solutions: Utilize best in class technology to create efficient scalable data processing systems.
- Collaborate with crossfunctional teams: Work closely with product managers senior engineers and founders to understand the needs and contribute to designing software and data solutions that meet the organization s objectives.
- Ensure data governance and quality: Implement efficient data governance processes ensuring data integrity security and compliance across multiple data sources.
- Realtime data processing: Design systems for realtime data streaming ensuring smooth integration with other systems and services.
- Data pipeline optimization: Monitor and improve the performance of existing data pipelines and resolve datarelated issues in collaboration with backend and database teams.
- Stay updated on technology: Follow advancements in data engineering tools and techniques adopting best practices to improve data processing storage and analysis.
Requirements
- 5 years of experience as a Data Engineer focusing on largescale data solutions.
- Mortgage industry experience: Prior experience working with mortgage data systems financial services.
- Proficiency in data processing tools: Handson experience with cloud services like Snowflake S3 along with Redshift Glue etc.
- Strong SQL/NoSQL skills: Familiarity with databases such as PostgreSQL to ensure accurate data handling and storage.
- Experience with microservices: Knowledge of microservices architecture and realtime data processing using queues and pubsub technologies.
- Knowledge of ETL processes: Deep understanding of ETL workflows with the ability to optimize and troubleshoot data pipelines.
- Programming skills: Experience with programming languages such as Python (or Javascript) for developing data solutions.
- Familiarity with MISMO standards: Knowledge of the MISMO (Mortgage Industry Standards Maintenance Organization) data schema is preferred.
Benefits
- Work Location: Remote
- 5 days working
5+ years of experience as a Data Engineer, focusing on large-scale data solutions. Mortgage industry experience: Prior experience working with mortgage data systems financial services. Proficiency in data processing tools: Hands-on experience with cloud services like Snowflake, S3, along with Redshift, Glue, etc. Strong SQL/NoSQL skills: Familiarity with databases such as PostgreSQL to ensure accurate data handling and storage. Experience with microservices: Knowledge of microservices architecture and real-time data processing using queues and pub-sub technologies. Knowledge of ETL processes: Deep understanding of ETL workflows, with the ability to optimize and troubleshoot data pipelines. Programming skills: Experience with programming languages such as Python (or Javascript) for developing data solutions. Familiarity with MISMO standards: Knowledge of the MISMO (Mortgage Industry Standards Maintenance Organization) data schema is preferred.
Education
Bachelor's degree in Computer Science, Engineering, or related field (or equivalent work experience)
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
