LeadStack Inc. is an award-winning, one of the nation's fastest-growing, certified minority-owned (MBE) staffing services provider of contingent workforce. As a recognized industry leader in contingent workforce solutions and Certified as a Great Place to Work, we're proud to partner with some of the most admired Fortune 500 brands in the world.
Job Details:
Job title: Databricks Lead
Location: Blue Ash, OH or Charlotte, NC
Duration: 12+ Months - potential extension
Pay range: $70/hr - $90/hr on W2
Job Summary:
We are seeking a seasoned Databricks Technical Lead to join our HR Systems Engineering team. This role is key in enhancing the experience of over 420,000 associates by leading the design, build, and optimization of our data platform, APIs, and cloud-based solutions. As a product-centric leader within an agile delivery framework, you'll align technical delivery with business value in a high-impact, high-visibility environment.
Required Qualifications:
- 10+ years of experience in data engineering, big data, or API development, including 3+ years in a leadership role
- Deep experience with Azure Databricks, Apache Spark, Azure SQL, Delta Lake
- Strong coding skills in Python, Scala, and SQL
- Expertise in building and managing REST, GraphQL, gRPC APIs and microservices
- Experience with Azure Data Factory (ADF), Azure Synapse Analytics, Terraform/Bicep, CI/CD pipelines
- Solid understanding of data security, privacy regulations (GDPR, CCPA, HIPAA), RBAC, and encryption
- Familiarity with containerization (Docker, Kubernetes) and event-driven architecture
- Exposure to Informatica (PowerCenter, IICS) for ETL/ELT
- Proven leadership in agile environments (Scrum, Kanban, SAFe)
- Strong communication and collaboration skills
Preferred Qualifications:
- Microsoft Certified: Azure Solutions Architect Expert or Databricks Certified Data Engineer
- Experience with Oracle HCM database models and APIs
- Knowledge of HR Analytics, Azure API Management, Event Hub
- Exposure to machine learning workflows in Databricks
Core Responsibilities:
Databricks & Big Data Architecture:
- Design & implement scalable pipelines using Apache Spark, Delta Lake, and Azure-native services
- Optimize ETL/ELT workflows for performance and cost efficiency
- Ensure best practices for data governance, security, and compliance
Azure SQL & Cloud Migration:
- Lead migration from Azure SQL to Databricks
- Build automated migration workflows using ADF, Informatica, and Databricks
- Integrate migrated data into downstream APIs and analytics platforms
API & Services Development:
- Develop secure and scalable RESTful APIs, GraphQL, and gRPC services
- Integrate APIs with data lakes, Oracle HCM, and enterprise applications
- Implement API monitoring, OAuth, JWT, and Azure API Management
HR Data Domain & Security:
- Manage HR data domain with high focus on security and privacy
- Implement RBAC, data masking, and compliance frameworks
- Enable secure data sharing for HR reporting and analytics
Product-Centric & Agile Delivery:
- Champion a product mindset, aligning technical work with business needs
- Drive agile delivery with Scrum/Kanban methodologies
- Lead backlog grooming, prioritization, and continuous improvement
Leadership & Collaboration:
- Mentor and lead a team of data engineers
- Collaborate cross-functionally with HR, security, architecture, and business stakeholders
- Promote automation, DevOps, and Infrastructure-as-Code (IaC)
- Stay current with trends in Azure, Databricks, and cloud engineering