Sr Hadoop Admin
Sr Hadoop Admin
Posted on :
11-10-2024
Employer Active
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Share
Send me jobs like this
Job Alert
You will be updated with latest job alerts via emailValid email field required
Send jobs
Job Description
Key Responsibilities:
1. Install configure and manage Hadoop clusters (HDFS MapReduce YARN etc.)
2. Monitor cluster performance identify bottlenecks and optimize resource utilization.
3. Implement and manage Hadoop security (Kerberos ACLs encryption).
4. Develop and maintain scripts for automation (Python Shell).
5. Collaborate with developers to optimize data processing workflows.
6. Troubleshoot Hadooprelated issues and provide Level 3 support.
7. Plan and execute cluster upgrades patches and backups.
8. Ensure data quality integrity and compliance with organizational policies.
9. Document cluster architecture configuration and procedures.
10. Work closely with data engineers analysts and scientists to meet business requirements.
2. Monitor cluster performance identify bottlenecks and optimize resource utilization.
3. Implement and manage Hadoop security (Kerberos ACLs encryption).
4. Develop and maintain scripts for automation (Python Shell).
5. Collaborate with developers to optimize data processing workflows.
6. Troubleshoot Hadooprelated issues and provide Level 3 support.
7. Plan and execute cluster upgrades patches and backups.
8. Ensure data quality integrity and compliance with organizational policies.
9. Document cluster architecture configuration and procedures.
10. Work closely with data engineers analysts and scientists to meet business requirements.
Requirements:
Technical Skills:
1. 3 years of experience in Hadoop administration.
2. Strong understanding of Hadoop ecosystem (HDFS MapReduce YARN Hive Pig Sqoop Flume).
3. Experience with cluster management tools (Ambari Cloudera Manager).
4. Proficient in Linux/Unix and scripting languages (Python Shell).
5. Knowledge of Hadoop security and authentication protocols.
6. Familiarity with data processing frameworks (Spark Flink).
7. Experience with cloudbased Hadoop deployments (AWS Azure GCP).
2. Strong understanding of Hadoop ecosystem (HDFS MapReduce YARN Hive Pig Sqoop Flume).
3. Experience with cluster management tools (Ambari Cloudera Manager).
4. Proficient in Linux/Unix and scripting languages (Python Shell).
5. Knowledge of Hadoop security and authentication protocols.
6. Familiarity with data processing frameworks (Spark Flink).
7. Experience with cloudbased Hadoop deployments (AWS Azure GCP).
Employment Type
Full Time
Key Skills
Report This Job
Disclaimer: Drjobpro.com is only a platform that connects job seekers and employers. Applicants are advised to conduct their own independent research into the credentials of the prospective employer.We always make certain that our clients do not endorse any request for money payments, thus we advise against sharing any personal or bank-related information with any third party. If you suspect fraud or malpractice, please contact us via contact us page.
