Kafka/Kong Administrator

Job :

Job Description:
Mid-level Kafka Administrator with DevOps experience
Position Overview: We are seeking a skilled and experienced Mid-level Kafka Administrator to join our IT operations team. As a Kafka Administrator, you will be responsible for the deployment, configuration, maintenance, and monitoring of our Kafka clusters, ensuring the high availability, reliability, and optimal performance of our real-time platforms. Your role will be crucial in supporting our data engineering and application teams to deliver seamless data integration and processing.
Responsibilities: Kafka Administration1. Cluster Deployment and Configuration:
Deploy and configure Kafka clusters following best practices for scalability, security, and performance.
Collaborate with cross-functional teams to gather requirements and design Kafka infrastructure to meet data streaming needs.
Manage topics, partitions, replication factors, and broker configurations to ensure efficient data distribution and fault tolerance.
2. Monitoring and Performance Optimization:
Implement monitoring and alerting solutions to proactively identify and address performance bottlenecks, resource constraints, and anomalies.
Optimize Kafka configurations, brokers, and consumer/producer applications for optimal throughput and latency.
Conduct regular performance testing, load testing, and capacity planning to ensure clusters can handle anticipated workloads

3. High Availability and Disaster Recovery:
Design and implement high-availability strategies, including failover mechanisms and data replication across multiple data centers or cloud regions.
Develop and maintain disaster recovery plans and procedures to minimize data loss and downtime in the event of failures.
4. Security and Compliance:
Implement and manage security measures such as encryption, authentication, and authorization to ensure data privacy and compliance with industry standards.
Stay updated on security vulnerabilities and patches, applying necessary updates to maintain a secure Kafka environment.
5. Troubleshooting and Issue Resolution:
Diagnose and resolve Kafka-related issues, including performance degradation, data loss, and connectivity problems.
Collaborate with development and data engineering teams to troubleshoot consumer/producer application integration with Kafka.

6. Documentation and Knowledge Sharing:
Maintain thorough documentation of Kafka configurations, deployment processes, and troubleshooting procedures.
Provide training and knowledge sharing sessions to junior team members and other stakeholders.
7. Collaboration and Communication:
Collaborate with cross-functional teams, including data engineers, developers, and system administrators, to ensure smooth integration of Kafka into our data ecosystem.
Communicate effectively with stakeholders to provide updates on Kafka performance, maintenance, and improvements.
8. Certification as a Confluent Certified Administrator for Apache Kafka (CCAAK) preferred. (Internal Note - CCDAK is available for Confluent Cert Dev for Apache Kafka)

9. Experienced in the Kubernetes platform
•  Working knowledge with Kubernetes\Dockers 10. Excellent knowledge of API design standards, patterns, and best practices especially with OpenAPI 2.0, REST, JSON, XML.
11. 5+ years of experience with monitoring and troubleshooting. Should be able to monitor and debug platform or application issues.
Qualifications:
•  Bachelors degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
•  3 years of hands-on experience in administering Apache Kafka clusters in production environments
•  Strong understanding of Kafka internals, including topics, partitions, replication, and consumer/producer APIs.
•  3 years of experience with Kafka ecosystem tools such as Kafka Connect, Kafka Streams, and Schema Registry.
•  Knowledge of Linux systems and shell scripting.
•  Strong DevOps background preferred.
•  3 years of familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud Platform) and containerization (e.g., Docker, Kubernetes)
•  Excellent problem-solving skills and the ability to troubleshoot complex issues efficiently.
•  Strong communication skills and the ability to work collaboratively in a team environment.

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .

Apex Systems is a world-class IT services company that serves thousands of clients across the globe. When you join Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRated's Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico. Kafka/Kong Administrator