PROJECTS

LMSYS Org develops open datasets, models, systems, and evaluation tools for large models.

MODELS

FastChat-T5

Base: Flan-T5

Size: 3B

A commercial-friendly, compact, yet powerful chat assistant fine-tuned from Flan-T5.

Vicuna

Base: LLaMA

Size: 7B, 13B

An open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.

EVALUATION

Chatbot Arena

A benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. It comes with a leaderboard based on Elo ratings.

SYSTEMS

FastChat

An open and scalable platform for training, finetuning, serving, and evaluating LLM-based chatbots.