In this role, the Kafka Admin will design, build, test, and deploy quality messaging and streaming solutions that are consistent with project objectives, technology architecture standards and departmental best practices. The Kafka admin will design and implement event sourcing strategies, administer enterprise-wide messaging architecture, and provide daily management of Kafka eco-system.
Specific responsibilities include:
- Manage large scale multi-nodes Kafka cluster environments residing on AWS and on-prem Linux Redhat platform.
- Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.
- Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.
- Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
- Research and recommend innovative, and where possible, automate key administration tasks.
- Ability to closely collaborate with product managers and lead engineers.
- Provide guidance in the creation and modification of standards and procedures
- Create topics, setup redundancy cluster, deploy monitoring tools, alerts
- Proactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availability
- Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka cluster
- Provide technical expertise and guidance to production support.
- 5+ years of solid Kafka Admin experience in managing critical 24/7 applications
- Design, build, assemble, and configure application or technical architecture components using business requirements.
- Hands-on experience with Kafka clusters hosted on ROSA in AWS and on-prem Linux RedHat
- Experience in building Kafka pipelines using Terraform, Ansible, Cloud formation templates, shells etc.
- Experience in implementing security & authorization (permission based) on Kafka cluster.
- Aid System Administrators with setting up Kafka platform in provisioning, access lists Kerberos and SSL configurations.
- Experience in setting standards to automate deployments using Kubernetes, Docker, Chef or Jenkins
- Experience in open source and confluence Kafka, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.
- Experience in Kafka Mirror Maker or Confluent Replicator
- Experience in High availability cluster setup, maintenance and ongoing 24/7 support
- Establish best practice standards for configuring Source and Sink connectors.
- Hands on experience in standing up and administrating Kafka platform from scratch which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management (ACL)
- Knowledge of Kafka API (development experience is a plus)
- Knowledge of best practices related to security, performance, and disaster recovery.
- Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.
- Demonstrate a product mindset with an ability to set forward thinking and direction.
- Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations.
- Ability to maintain a positive attitude while working with high demands and short deadlines that leads to working after hours.
- Must have excellent communications and interpersonal skills
Not Required, but Preferred:
- Experience with Oracle Streams and/or another real-time streaming solution is a plus.
- Experience in setting up Prometheus/Grafana or ELK monitoring tools is a plus.
- Experience as Linux (RHEL) /Unix administrator is huge plus.
- Experience in PostgreSQL, SQL Server, No-SQL (Couchbase), Oracle, and AWS Cloud is a plus.
- Understanding of or experience supporting .NET / Java application.
- Understanding of or experience with Programming languages like Python, PowerShell, etc is plus.
Required Skills : Kafka 5+ years AWS MSK (managed Kafka administration, EKS to Kubernetes is MSK to Kafka) - 2-3 years Linux - RHEL/Redhat specifically - replace OpenShift with Linux/RHEL (in JD) - just have to be senior with Linux doesn't have to be 10+ years exp. Terraform, Ansible - 2-3 years - need to be able to script from scratch On-call every 3 weeks
Basic Qualification : Day-to-day responsibilities
• Managing the environment
• Topic creation
• Installing & upgrading the platform
• Troubleshooting issues
• Development issues
Additional Skills : Day-to-day responsibilities
• Managing the environment
• Topic creation
• Installing & upgrading the platform
• Troubleshooting issues
• Development issues
Background Check :Yes
Drug Screen :Yes
Notes :
Selling points for candidate :
Project Verification Info :
Candidate must be your W2 Employee :Yes
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship No
Interview times set No
Type of project :Administration/Support
Master Job Title :Net/Sys Admin: Other
Branch Code :Las Vegas