Machine Learning Engineer II

Fiddler Labs Inc. seeks to hire a Machine Learning Engineer II to perform the following duties:
1. Maintain and implement a scalable, asynchronous data-ingestion pipeline with the analysis of virtual memory management and a comprehensive load test benchmarking framework.
2. Design and develop the label-updating API with high reliability and in-time aggregation metrics through the support of S3 file system, and transaction processing with concurrency control and failure recovery mechanisms.
3. Support user integrations of Large Language Models (LLM) including LangChain and LlamaIndex.
4. Implement Natural Language Processing (NLP) monitoring solutions for mining text data, and provide information retrieval, text summarization and text evaluations.
5. Design and re-engineer the queries API with PostgreSQL backend to support lower latency, real-time timeseries data by optimizing indexing and storage analysis of the database model and system architecture.
6. Build a scalable and distributed cloud computing platform to help enterprises monitor and analyze algorithms and models, including predictive machine learning (ML) models and LLM across text and images.
7. Develop new types of metrics and evaluation frameworks using PyTorch to improve data reliability, security, and protection.
8. Provide quality analysis of LLM and deep learning approaches, including RAG-based and transformer-based (Attention) models.
9. Collaborate with product and customer facing teams to enhance and expand product, while recommending and implementing engineering best practices.
10. Coding, debugging, and diagnosing abnormalities in Python to improve functionality and ensure the design, application, and maintenance of existing software meets quality standards.
11. Support customer deployment with reliable data migration plans and upgrading tests using knowledge of cloud and network infrastructure (AWS, Google Cloud, and Kubernetes).
12. Design and maintain the test frameworks, including various tools that can empower the team to automate test cases effectively.
The position requires experience with or academic exposure to:
a. Memory management, virtual memory, file systems, protection, security, and distributed systems
b. Network infrastructure, cloud computing and load balancing
c. Transaction processing (both concurrency control and failure recovery)
d. Storage and indexing aspects, query execution and optimization, and SQL-based database systems
e. Natural language processing and machine learning
f. Deep learning for sequence processing and their application
g. Methods for text mining, including information retrieval, open-domain information extraction, and text summarization (both extractive and generative)
h. Experience with common architectures including Attention
Masters degree or foreign educational equivalent in Computer Science, Computer Engineering, or a closely related field.
Please copy and paste your resume in the email body (do not send attachments, we cannot open them) and email it to candidates at (link removed) with reference in the subject line.

Thank you.