Lead Data Engineer

Lansing, Michigan

SelectMinds
Apply for this Job
Benefits:

Long Term

Hybrid

Opportunity for advancement

Lead Data Engineer Location: Lansing, MI (Hybrid) Duration: 1+ Year (Possible Extension) Eligibility: Locals to Mid-Michigan Only Interview: Onsite

We are seeking a Lead Data Engineer to lead the development, optimization, and maintenance of high-performance data solutions. This role is crucial in ensuring the stability, scalability, and integrity of mission-critical applications. You will oversee data pipeline development, automation, cloud integrations, and security compliance, all while mentoring and guiding a team of developers.

Key Responsibilities

Lead the design, development, and optimization of scalable AWS-based data solutions.

Develop and enhance ETL processes and data pipelines for efficient data flow.

Implement and manage ElasticSearch for advanced data retrieval and analytics.

Write and maintain clean, efficient Python/Scala code for data processing.

Ensure data integrity, automation, and compliance with security best practices.

Provide technical leadership and mentorship to other developers.

Oversee database modeling and stored procedure development.

Manage Git version control and contribute to CI/CD pipeline development using Azure DevOps (nice to have).

Work within an Agile development framework, implementing Test-Driven Development (TDD) best practices.

Required Skills & Experience 12+ years in complex database system development. 8+ years with Databricks, ElasticSearch, Kibana. 8+ years of experience in Python/Scala programming. 8+ years working with Oracle databases. 5+ years in AWS Cloud-based Application Development. 5+ years in ETL process and data pipeline development. 5+ years working with data warehousing, data visualization, and data integrity. 5+ years experience with CMM/CMMI Level 3 methodologies. 5+ years in Agile methodologies, including TDD. 3+ years of experience or knowledge in CI/CD pipeline development using Azure DevOps (nice to have). Experience with Electronic Health Records (EHR) HL7 solutions (preferred).

Flexible work from home options available.

Date Posted: 13 April 2025
Apply for this Job