Kafka Integration Engineer

Role Name: Kafka Integration Engineer - New York City, NY/Alpharetta, GA

Experience: Requires 5-8 years of experience in IT

Required technical Skills: Kafka Integration Engineer

Full Job Description:

• The primary objective of the Kafka Administrator is to develop and maintain the corporate messaging infrastructure ensuring message delivery, security, retention, and recoverability of the topics and messages.
• Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
• Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster

Required Skills:

• Standing up and administer Kafka cluster. Strong experience with Confluent Kafka
• Expertise in Kafka brokers,, Kafka connect, schema registry, KSQL, Rest proxy,
• Must have experience in managing Kafka users and topics
• Solid understanding of Kafka architecture, how to save Kafka space
• Working knowledge of Apache Kafka, AWS MSK, Linux/Unix systems
• Experience in using automation tools
• Hands on commands usage of Kafka and all components
• Ability to perform data related benchmarking, performance analysis and tuning
• Setting up security on Kafka (Setting different security mechanism in Kafka)
• Monitor, prevent and troubleshoot security related issues
• Good skills in Database Design, Data Integration
• Good knowledge of big data ecosystem to design and develop capabilities to deliver solutions using CI/CD pipelines
• 5+ years of solid Kafka Admin experience in managing critical 24/7 applications
• Design, build, assemble, and configure application or technical architecture components using business requirements
• Experience in implementing security & authorization (permission based) on Kafka cluster
• Experience in High availability cluster setup, maintenance and ongoing 24/7 support