Bigdata Hadoop Developer

Hadoop Developer / Admin

Immediate need
Job Location: McLean, VA
Long-term/Ongoing project
Full-time opportunity available
Job Responsibilities:

• Management and Administration of Hadoop clusters and all other resources in the entire Hadoop ecosystem.
• Deployment and configuration of Hadoop clusters, add and remove nodes, keep track of jobs, monitor critical parts of the cluster, configure name-node high availability, and other Hadoop management functions.
• Conduct Hadoop cluster performance tuning and optimizations.
• Perform proactive and reactive monitoring of Hadoop clusters.
• Capacity planning and Scaling of Hadoop cluster as needed.
• Monitor Hadoop cluster connectivity and security.
• Backup, restore, and maintenance of HDFS file system as required.

Required Qualifications:

• 5+ years hands-on administrative experience of Apache Hadoop.
• 3+ years of Linux, AIX or other UNIX based system administration.
• Solid understanding of Shell Scripting, YARN and other Hadoop ecosystem tools.
• Basic administration knowledge of Cloudera Distribution.
• B.S. in Computer Science/Engineering or equivalent relevant experience.
• Must be a team player with positive attitude and ability to collaborate effectively.

Desired Qualifications:

• Working experience with Cloudera distribution.
• Familiarity with Hive and MapReduce modules.
• Knowledge of Azure cloud infrastructure.
• Working knowledge of automation tools like CHEF.
• Familiarity with both relational and NoSQL database systems.
• Familiarity with Data Lakes repository technology.
• Familiarity with Teradata data warehousing systems.