Principal Software Engineer

Fremont, California

Discover International
Apply for this Job
Principal Software Engineer - GenAI

We are looking for an experienced Software Engineer to help build the next generation of tools powering GenAI development. You'll join a small, highly collaborative team creating a lightweight, high-impact platform for tracking, evaluating, and improving AI-driven applications - from LLM agents to retrieval-augmented generation (RAG) systems and beyond.

This role is hands-on: you'll ship core features, design integrations with popular open-source libraries, scale backend systems, and work closely with users shaping the future of GenAI tooling. If you're passionate about building for developers, working fast, and solving real-world problems at the edge of AI innovation, this is the opportunity for you.

Key Responsibilities:
  • Architect and deliver clean, reliable client libraries designed for developer-first workflows
  • Build seamless integrations with popular LLM frameworks (e.g., LangChain, LlamaIndex, Instructor) to expand product capabilities
  • Design scalable backend systems to ensure high availability, low latency, and efficient data processing for GenAI applications
  • Develop interactive, user-facing features including AI evaluation dashboards, prompt testing environments, and dataset management tools
  • Collaborate directly with technical users to gather insights, validate product assumptions, and prioritize future improvements
Requirements:
  • 4+ years of professional software engineering experience, with a strong foundation in building production systems
  • Fluency in Python
  • Experience developing AI/ML-powered applications or tooling, either professionally or through personal projects
  • Strong product intuition and the ability to ship quickly while maintaining high code quality
  • Comfortable working independently in a fast-evolving technical landscape; startup or early-stage experience is a plus
  • Bonus: Expertise in distributed systems, performance tuning, or large-scale data infrastructure (e.g., OLAP systems)
Date Posted: 11 May 2025
Apply for this Job