About the Role
As an AI Research Engineer, you will be instrumental in developing our evaluation frameworks and agent orchestration systems. You'll work directly with the founding team to build standardized cloud environments for AI workflow execution.
Key areas of focus:
- Evaluation framework development and standardization
- Agent workflow orchestration and execution environments
- Performance measurement and benchmarking systems
- Distributed computation infrastructure
Responsibilities
- Design and implement core components of our evaluation infrastructure
- Build and optimize distributed systems for running AI model evaluations
- Create efficient pipelines for processing and analyzing large-scale evaluation data
- Work directly with customers to understand their needs and improve our platform
Requirements
- 3+ years of experience in building AI/ML infrastructure or distributed systems
- Strong programming skills in Python and systems programming languages (Go/Rust)
- Experience with modern AI/ML frameworks (PyTorch, TensorFlow, etc.)
- Familiarity with cloud platforms (AWS/GCP/Azure) and container orchestration (Kubernetes)
Nice to Have
- Experience with AI model evaluation and benchmarking
- Contributions to open-source AI/ML tools or infrastructure