About the Role
Moloco is a machine learning company operating at massive scale (we ingest 10 petabytes of training data per day) and our models are blazingly fast (returning predictions in 10 milliseconds or less); and a profitable unicorn (we're valued at $2B & been profitable for the last 13+ quarters).
On the cloud infrastructure team, you'll be owning near-real-time big data processing. This team provides cloud infra platforms, tooling, and processes that enable cloud infra producers and consumers in the Demand Side Platform (DSP) team to build new DSP features, solutions, and data rapidly and at greater scale.
What you'll do
- Solve large-scale problems Moloco spends $XXXM on cloud infra services annually. We're looking for an experienced engineer to look for opportunities to reduce cost.
- Build and Onboard Value-Add Cloud Infra Platforms, both in-house developed and fully-managed by third party vendors, which augment and fill gaps in services provided by public clouds (for example Kafka, Pinot, Airflow, etc).
- Optimize the Cloud Infra Platform for performance, scalability, availability, stability to minimize cost of ownership to Moloco.
- Optimize traffic serving and data processing pipelines with different goals including latency, cost, and throughput.
- Turn unstructured logs, messages, and events into structured data that can be utilized for analytics, machine learning, and more.
What you'll need to succeed
- BS in Computer Science or related fields (MS strongly preferred)
- 7+ years of hands-on experience in software engineering
- Infrastructure platform and/or cost work experience
- Extensive experience working at scale (our data pipeline ingests 10 petabytes of new data per day, retraining 1,000 ML models every day, we serve hundreds of billions of requests per day)
- Excellent software development skills and fluency in at least one programming language (preferably Java, Go, or Python)
- Outstanding problem-solving skills
- Bias for action; ability to inspire a team
- Experience in Cloud/Big Data platforms (e.g., AWS, GCP, Beam, Spark, etc.)
- Experience in distributed computing / cloud computing / high performance computing