Hadoop Developer / Admin
Immediate need
Job Location: McLean VA
Longterm/Ongoing project
Fulltime opportunity available
Job Responsibilities:
- Management and Administration of Hadoop clusters and all other resources in the entire Hadoop ecosystem.
- Deployment and configuration of Hadoop clusters add and remove nodes keep track of jobs monitor critical parts of the cluster configure namenode high availability and other Hadoop management functions.
- Conduct Hadoop cluster performance tuning and optimizations.
- Perform proactive and reactive monitoring of Hadoop clusters.
- Capacity planning and Scaling of Hadoop cluster as needed.
- Monitor Hadoop cluster connectivity and security.
- Backup restore and maintenance of HDFS file system as required.
Required Qualifications:
- 5 years handson administrative experience of Apache Hadoop.
- 3 years of Linux AIX or other UNIX based system administration.
- Solid understanding of Shell Scripting YARN and other Hadoop ecosystem tools.
- Basic administration knowledge of Cloudera Distribution.
- B.S. in Computer Science/Engineering or equivalent relevant experience.
- Must be a team player with positive attitude and ability to collaborate effectively.
Desired Qualifications:
- Working experience with Cloudera distribution.
- Familiarity with Hive and MapReduce modules.
- Knowledge of Azure cloud infrastructure.
- Working knowledge of automation tools like CHEF.
- Familiarity with both relational and NoSQL database systems.
- Familiarity with Data Lakes repository technology.
- Familiarity with Teradata data warehousing systems.