Data Engineer
Data Engineer
Posted on :
15-01-2025
Employer Active
1 Vacancy
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Role Responsibilities:
- Design code test debug and document technology solutions for complex projects and programs.
- Review and analyze largescale technology solutions to align with tactical and strategic business objectives as well as enterprise technological environments.
- Evaluate and develop companywide best practices for engineering and technology solutions ensuring alignment with industry standards and new technologies.
- Collaborate with key technical experts and senior technology teams to resolve complex technical challenges and meet project goals.
- Contribute to the development of Data Mesh capabilities to improve data accessibility across disparate platforms such as Hadoop Teradata and SQL Servers.
- Support Data Science functions by preparing prework required for data exploration and analysis.
- Support System Testing User Acceptance Testing (UAT) and endtoend testing activities; develop test automation for batch processes and APIs within a CI/CD environment.
- Work with Agile methodologies writing user stories and participating in Agile ceremonies.
Required Qualifications:
- Extensive experience designing and delivering data solutions in Google Cloud Platform (GCP) leveraging services such as DataProc DataFlow BigQuery and other GCP tools.
- Expertise in Big Data platforms (e.g. MapR Cloudera) using technologies like HDFS Spark PySpark and Hive.
- Proficiency in eventdriven solutions using Java REST APIs Apache Flink and Kafka technologies.
- Experience with relational and NoSQL databases including MongoDB SQL Server Atlas and Azure SQL.
- Strong familiarity with wire formats such as XML JSON Avro and CSV along with serialization/deserialization techniques.
- Knowledge of security protocols (e.g. Kerberos JWT) and their integration into data platforms and solutions.
- Solid understanding of Agile methodologies including writing user stories and participating in ceremonies such as sprint planning and retrospectives.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
