Senior Staff Engineer - Big Data Engineer
Senior Staff Engineer - Big Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
Role: Highly Experienced Senior Developer Palantir
In this role you will be responsible to work with our Business Analytics & Insights (BAI) team. You will work closely with crossfunctional teams to deliver highquality solutions in domains such as Supply Chain Finance Operations Customer Experience HR Risk Management and Global IT.
Responsibilities:
- Develop a comprehensive technical plan for the migration including data ingestion transformation storage and access control in Azures Data Factory and data lake.
- Develop scalable and reusable frameworks for ingesting of data sets.
- Ensure data quality and integrity throughout the entire data pipeline implementing robust data validation and cleansing mechanisms.
- Work with event based / streaming technologies to ingest and process data.
- Provide technical guidance and support to the team resolving any technical challenges or issues that may arise during the migration and postmigration phases.
- Stay up to date with the latest advancements in cloud computing data engineering and analytics technologies and recommend best practices and industry standards for implementing the data lake solution.
Qualifications :
Must have Skills: Data Analysis & Visualization
Good To Have Skills: Power BI (Capable).
- 8 to 10 years of IT experience.
- Minimum 4 years of Experience working with Palantir.
- Experience in Cloud (Azure or Google).
- Experience in Data Modelling & Source System Analysis.
- Familiarity with PySpark.
- Mastery of SQL.
- Ability to conduct data profiling cataloging and mapping for technical design and construction of technical data flows.
- Experience in data visualization/exploration tools
- Experience providing technical leadership and guidance to Teams.
- Strong problemsolving skills and the ability to translate business requirements into actionable data science solutions.
- Excellent communication skills with the ability to effectively convey complex ideas to technical and nontechnical stakeholders.
- Strong team player with excellent interpersonal and collaboration skills.
- Ability to manage multiple projects simultaneously and deliver highquality results within specified timelines.
Nicetohave skills:
- Experience preparing data for Data Science and Machine Learning Personal Attributes.
Remote Work :
Yes
Employment Type :
Fulltime
Employment Type
Remote
Company Industry
Department / Functional Area
Engineering
Key Skills
- Computer Science
- Docker
- Kubernetes
- Python
- VMware
- C/C++
- Go
- System Architecture
- gRPC
- OS Kernels
- Perl
- Distributed Systems
