Lead Data Engineer We are seeking an experienced and passionate Lead Data Engineer to join our Data Engineering Team. In this critical role, you will develop and manage scalable data pipelines on our Azure cloud-based data platform. You will guide a team of data engineering professionals, demonstrating exceptional technical expertise and leadership, while fostering a culture of innovation, craftsmanship, and continuous improvement.
Key Responsibilities: - Lead and mentor a team of data engineers, providing technical guidance and hands-on support.
- Design, build, and maintain robust data pipelines covering ingestion, integration, transformation, distribution, storage, and data quality management.
- Champion modern engineering practices, including Infrastructure as Code (IaC), automated testing, and advanced observability strategies.
- Collaborate closely with product owners, project managers, architects, and stakeholders to understand business requirements and translate them into effective data engineering and integration solutions.
- Develop and enhance data processes, ensuring robust, scalable, and reusable code aligned with established coding standards and best practices.
- Document data engineering and integration solutions comprehensively to facilitate effective collaboration and maintenance.
- Continuously research emerging technologies, perform proof-of-concepts (POCs), and provide strategic recommendations for implementation.
- Optimize performance through effective tuning and scaling of data services.
- Foster agile methodologies within your team and ensure efficient project delivery.
Qualifications: - Bachelor's degree in Computer Science, Data Science, Information Systems, or related field, or equivalent professional experience.
- 8+ years of experience in data engineering, with a focus on leading data products and engineering teams
Required Skills: - Deep expertise in Azure cloud services, including Azure Data Lake Storage (ADLS), Blob Storage, Azure SQL Database.
- Advanced proficiency in SQL (queries, stored procedures, analytical functions, materialized views).
- Strong hands-on experience building ETL/ELT pipelines and data integration processes.
- Extensive experience with various integration connectors (e.g. APIs, File systems, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST)
- Proficient programming skills in Python.
- Extensive experience in data lake and data warehouse architectures, including experience with Snowflake, Azure Synapse or Azure Databricks.
- Familiarity with DevOps principles, specifically CI/CD methodologies and tools.
- Experience using orchestration tools such as Apache Airflow.
- Strong analytical skills, with proven ability to analyze and optimize data models.
Preferred Skills: - Experience with ETL tools like PySpark, dbt, Azure Data Factory or Fivetran
- Familiarity with BI tools such as Tableau.
- Strong experience with enterprise data integration methodologies and tools.
Personal Attributes: - Exceptional leadership and interpersonal skills, able to engage effectively with cross-functional teams.
- Strong problem-solving capabilities, analytical thinking, and critical reasoning.
- Ability to lead through example, inspire team members, foster professional growth and continuous learning.
- Effective communicator, comfortable presenting ideas and technical solutions clearly to diverse audiences.
Why Join Us at APCO Holdings At APCO Holdings, we are a trusted leader in the automotive industry, providing F&I products and services through our renowned brands, including EasyCare, GWC Warranty and MemberCare. With over 35 years of experience, we've protected more than 11 million drivers and paid out over $3.5 billion in claims, underscoring our commitment to excellence and customer satisfaction.
This role will be critical in driving the successful execution of complex data engineering initiatives, supporting scalable and secure data pipelines, and helping build a modern data ecosystem for one of the nation's leading automotive F&I products and services companies.