DATA ENGINEER
DATA ENGINEER
Posted on :
20-03-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Hybrid work mode in Madrid
The main responsibilities are
- Lead the design development and maintenance of scalable data pipelines and systems and guidelines according to the customers needs.
- Collaborate with crossfunctional teams to understand data requirements and deliver solutions.
- Ensure the performance security of the data infrastructure and the data quality/integrity. It is essential to follow the best practice of Data engineering.
- Optimize data workflows for performance and efficiency to enrich and transform large volumes of data with complex business rules.
- Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
- Designing and implementing scalable and secure data processing pipelines using Scala Spark Cloud Object Storage (COS).
- Set up CI/CD pipelines to automate deployments unit testing and development management.
- Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
- Write technical documentation (specifications and operational documents) to ensure knowledge capitalization.
- Support the different teams in troubleshoot and resolution of datarelated issues.
- Assure the creation and maintenance of comprehensive documentation of data pipelines systems and processes being accessible to the team members
- Effective communication with team members and stakeholders to ensure alignment on data initiatives.
- Provide technical guidance and mentorship to junior data engineers.
- Foster a culture of continuous learning and improvement within the team.
Qualifications :
Good knowledge of
- Spark on Scala
- CI/CD tools (Gitlab Jenkins)
- S3 storage / COS and parque format
- Strong Knowledge of SQL and NoSQL databases
- Hadoop
- Apache Airflow
Full understanding of
- Shell script
- Software Development Lifecycle (SDLC) awareness
- Agile principles and ceremonies
- Kubernetes containerization
- Elasticsearch and Kibana
Optionally/ as a plus *
- HVault
- Dataiku
- Dremio as tool to virtualize data
Additional Information :
BUSINESS AND TRANSVERSAL SKILLS
- Knowledge of banking industry and processes
- Excellent ProblemSolving skills and attention to detail
- DecisionMaking person
- Business / IT relationship (including IT OPS)
- Strong communication and interpersonal skills.
- Ability to understand explain and support change
- Ability to Deliver / Results driven
- Continuous learning and improvement
LANGUAGES
- English level B2 or higher
- Optionally French level B1
Remote Work :
No
Employment Type :
Fulltime
Employment Type
Full-time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
