HDFS Sr Data Engineer
HDFS Sr Data Engineer
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Not Disclosed
Salary Not Disclosed
1 Vacancy
Job Description
- Take ownership of the entire development process from conception to delivery.
- Collaborate with stakeholders to gather and implement use case details.
- Responsible for FSD and TSD documentation.
- Work closely with support engineers for test case documentation.
- Manage multiple projects and deliver on time.
- Analyze and write SQL queries as needed.
- Write unit tests and ensure all necessary documentation is in place.
- Develop shell scripts and schedule automated jobs.
- Focus on writing optimized code with experience in performance testing being a plus.
- Exhibit strong communication skills.
- Handson experience with the Hadoop ecosystem particularly Spark Kafka Hive and shell scripting.
- Familiarity with Airflow Spark Streaming cloud platforms and Agile methodologies is beneficial.
- Proficiency in Hadoop Spark Hive Airflow Shell scripting Scala and Kafka.
sql,hadoop,shell scripting,kafka,unit testing,hive,performance testing,spark,airflow,scala
Employment Type
Full Time
