Lead Principal Software Engineer - Data Platform Location: San Francisco, CA (Remote OK - US only)
Comp: $230K-$280K base + equity
Join Our Team: We are seeking a talented Lead Principal Software Engineer to spearhead the creation of a cutting-edge, scalable data platform at our rapidly expanding, product-focused tech company. This is a high-impact position where you will serve as the foremost individual contributor on the Data Platform team, responsible for shaping the technical vision and developing infrastructure that underpins real-time analytics, machine learning, and extensive data processing.
Your collaboration with Engineering, Product, Security, and Compliance leaders will be crucial in designing a cloud-native data architecture utilizing tools such as Kafka, Iceberg, ClickHouse, Tinybird, and Snowflake. If you are passionate about building scalable systems, addressing complex streaming and batch challenges, and steering the long-term architecture, this is the perfect opportunity for you.
Why You Should Consider This Role: - Become a key member of an expanding Data Platform team
- Take complete ownership of architecture and technical direction
- Engage with real-time data challenges and petabyte-scale solutions
- Work with a modern tech stack (Kafka, Iceberg, ClickHouse, Snowflake, etc.)
- Contribute to the platform that empowers AI/ML and analytics across the organization
Your Responsibilities: - Architect and construct the company's next-generation data platform from the ground up
- Design systems for scalability, low latency, streaming, batch processing, and fault tolerance
- Lead strategic decisions regarding data modeling, governance, ingestion, and warehousing
- Establish engineering best practices and mentor senior engineers
- Ensure alignment of platform design with long-term product and business objectives
- Optimize the technology stack for performance, cost-effectiveness, and reliability in the cloud
What You Bring to the Table: - 8+ years of experience in data engineering or platform infrastructure roles
- A minimum of 5 years in a Principal-level position or equivalent
- In-depth knowledge of Kafka and real-time data pipelines
- Extensive hands-on experience with ClickHouse, Iceberg, Snowflake, or similar tools
- Strong grasp of cloud-native architectures (AWS, GCP, or Azure)
- Experience in building systems with a focus on compliance, governance, and scale
- Proven track record in managing petabyte-scale data environments
- Excellent communication skills and a team-oriented mindset
- Bonus: Previous experience in AI/ML infrastructure or preparing for IPO-level growth