​
Welcome to Pi Labs

Pi Labs develops state-of-the-art language models for LLM evaluation and search. Our core technology is Pi Scorer, a deterministic, fast foundation model that scores text against rubrics of natural-language questions.

​
Why Pi Scorer?

Traditional LLM evaluation is expensive, slow, and inconsistent. Pi Scorer solves these problems by providing:
  • Flexible Judges: Create custom rubrics with natural language questions. Score anything from factual accuracy to writing style, creativity, or domain-specific criteria.
  • Low cost, low latency: Our optimized models deliver consistent results at scale. Process large datasets quickly without compromising on quality.
  • Integrations: Connect Pi Scorer to your existing workflow with integrations for Google Sheets, PromptFoo, Braintrust, and more.
  • Pi Studio: A web-based development environment for AI quality. Track model performance over time, calibrate your rubrics, and gain insights into your AI system’s behavior.

Quick Start Guide

Get up and running with Pi Scorer in minutes. Learn the basics of scoring text with custom rubrics.

API Reference

Complete documentation for all endpoints, parameters, and SDK methods.

Writing Rubrics

Master the art of creating effective scoring criteria with natural language questions.

Tuning & Calibration

Optimize your rubrics for better accuracy and reliability through systematic tuning.

Integrations

Connect Pi Scorer with LangChain, OpenAI, observability tools, and more.

Interactive Notebooks

Explore hands-on examples and tutorials in Jupyter notebooks.