LMSYS ORG

ProjectsBlogAboutDonationsChatbot Arena

Projects

Blog

About

Donations

Chatbot Arena

PROJECTS

LMSYS Org develops open datasets, models, systems, and evaluation tools for large models.

MODELS

FastChat-T5

Base: Flan-T5

Size: 3B


A commercial-friendly, compact, yet powerful chat assistant fine-tuned from Flan-T5.

Vicuna

Base: LLaMA

Size: 7B, 13B


An open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.

EVALUATION

Chatbot Arena


A benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. It comes with a leaderboard based on Elo ratings.

SYSTEMS

FastChat


An open and scalable platform for training, finetuning, serving, and evaluating LLM-based chatbots.