Overview:
The Kafka Admin role is crucial for ensuring the efficient and reliable operation of Kafka clusters within the organization. They play a key part in the design implementation and maintenance of Kafka infrastructure enabling seamless data processing and distribution across systems.
Key Responsibilities:
- Manage and configure Kafka brokers topics partitions and replication
- Implement and maintain Kafka clusters for optimal performance and efficiency
- Develop and maintain monitoring and alerting systems for Kafka clusters
- Collaborate with other teams to integrate Kafka into various data pipelines and applications
- Perform capacity planning and implement scaling strategies for Kafka infrastructure
- Create and maintain documentation for Kafka configurations processes and procedures
- Implement security measures and access controls for Kafka clusters
- Troubleshoot and resolve Kafkarelated issues and performance bottlenecks
- Ensure high availability and fault tolerance of Kafka clusters
- Participate in oncall rotation to provide support for Kafka infrastructure
- Conduct performance tuning and optimization of Kafka clusters
- Stay updated with the latest Kafka releases and best practices
- Collaborate with vendors and internal stakeholders for Kafkarelated solutions
- Conduct periodic testing and disaster recovery drills
- Provide technical expertise and guidance to other team members
Required Qualifications:
- Bachelors degree in Computer Science Information Technology or related field
- Proven experience in implementing and managing Kafka clusters
- Proficiency in Linux system administration
- Strong understanding of Kafka internals and architecture
- Experience with automation and scripting using tools like Ansible Chef or Puppet
- Solid knowledge of Kafka monitoring and performance tuning
- Ability to troubleshoot and resolve Kafkarelated issues
- Experience in implementing security controls and SSL encryption for Kafka
- Capability to work in a fastpaced and dynamic environment
- Excellent communication and collaboration skills
- Strong analytical and problemsolving abilities
- Understanding of networking principles and protocols
- Certifications like Confluent Certified Developer or Administrator is a plus
- Experience with related technologies such as Apache ZooKeeper is beneficial
- Experience with cloud platforms like AWS or Azure is desirable
automation,python,data,monitoring,scripting,performance tuning,networking principles,linux system administration,kafka clusters,ssl encryption,security controls,protocols,troubleshooting,cluster management,kafka