Job Title: DevOps Engineer III
Location: Jackson, MI
Duration: Long term
Rate: Market
Role Overview:We are looking for a talented and motivated DevOps Platform Engineer to join our team. In this role, you will be crucial in designing, implementing, and maintaining our data platform using Databricks on the Microsoft Azure cloud. You will collaborate with cross-functional teams to ensure the scalability, reliability, and performance of our analytics and data solutions.
Key Responsibilities:Architecture and Design: - Contribute to the strategic technology direction for our data platform.
- Architect scalable and efficient data solutions using Azure Databricks.
Data Pipelines and Integration: - Design, implement, and manage data pipelines.
- Ensure seamless data integration across various systems.
- Optimize data processing workflows.
Infrastructure Automation: - Develop Terraform Infrastructure as Code (IaC) to automate Databricks environment deployments.
- Create a library of scripts for automating MLOps environments.
Performance Monitoring and Tuning: - Monitor and analyze database performance.
- Fine-tune and optimize the data platform.
Collaboration and Communication: - Work closely with interdisciplinary teams, including engineers, data scientists, and business stakeholders.
- Communicate effectively to ensure alignment with business goals.
Required Skills and Experience: - Strong expertise in Databricks and Microsoft Azure.
- Experience with Infrastructure as Code (IaC) and automation tools, preferably Terraform.
- Knowledge of data catalog tools (e.g., Microsoft Purview).
- Excellent problem-solving skills and ability to work in a collaborative environment.
Education: - Bachelor's degree in Computer Science, Engineering, or related field.
- Proven experience as a Platform Engineer or similar role.
Additional Skills: