Onboarding Engineer
Onboarding Engineer
Posted on :
25-09-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Hi Team
Please work on these 2 roles if you have any pipeline please submit for other roles.
Updated Job Description for both the roles:
Role: Onboarding Engineer
Locations: Jersey City NJ
Duration: Fulltime
Salary: 130K
Client: Citibank
For Onboarding we need a developer with Spark/Scala experience who can do ETL development and build pipelines for data extraction and loading into Hive/Cloudera
Essential Skills & Experience
Spark & Scala Expertise:
Strong foundation in Scala: The primary language for Spark development so a solid understanding of its syntax data structures functional programming and common libraries is critical.
Extensive Spark experience: Deep knowledge of Spark core concepts (RDDs DataFrames Datasets) Spark SQL and Spark Streaming for building robust and performant data pipelines.
Familiarity with Spark cluster deployment: Understanding how to configure and run Spark applications in a cluster environment (e.g. YARN Mesos).
ETL Development:
Data Extraction: Experience with various data sources (relational databases APIs flat files etc.) and techniques for extracting data from them.
Data Transformation: Mastery of data manipulation techniques using Spark (aggregation filtering joining etc.) to prepare data for analysis and loading.
Data Loading: Experience with loading data into various target systems including Hive tables databases and data lakes.
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
