Spark Engineer

Role: Spark Engineer

Work Location: Charlotte NC

Hybrid

JD

We are seeking an Engineer specializing in Platform Support to ensure the seamless operation and optimization of our infrastructure. The ideal candidate will possess expertise in Spark technologies with a solid understanding of Helm and Kubernetes. This role requires adept problem-solving skills, the ability to collaborate across teams, and a passion for maintaining high-performance systems.

Responsibilities:

• Provide advanced support for the company's platform infrastructure, focusing on Spark technologies.

• Monitor system performance, diagnose and troubleshoot issues, and implement solutions to maintain high availability and reliability.

• Collaborate with DevOps and Engineering teams to deploy and manage applications using Helm and Kubernetes.

• Develop and maintain automation scripts and tools to streamline operational tasks and improve efficiency.

• Design, implement, and optimize CI/CD pipelines for continuous integration and delivery of software applications.

• Conduct regular performance assessments, identify areas for improvement, and implement optimizations to enhance platform scalability and stability.

• Participate in on-call rotation to provide timely resolution of critical incidents and ensure 24/7 system availability.

• Document procedures, configurations, and best practices to facilitate knowledge sharing and ensure operational continuity.

• Stay updated on emerging technologies and industry trends related to platform support and distributed computing.