LMSYS Org
The Large Model Systems Organization develops large models and systems that are open, accessible, and scalable.
Vicuna
A chatbot impressing GPT-4 with 90%* ChatGPT quality, available in 7B/13B/33B sizes.
Chatbot Arena
Scalable and gamified evaluation of LLMs via crowdsourcing and Elo rating systems.
SGLang
A fast serving engine for LLMs and VLMs.
LMSYS-Chat-1M
A large-scale real-world LLM conversation dataset.
FastChat
An open platform for training, serving, and evaluating LLM-based chatbots.
MT-Bench
A set of challenging, multi-turn, and open-ended questions for evaluating chatbots.
Arena Hard Auto
An automatic pipeline converting live data to high-quality benchmarks for evaluating chatbots.
RouteLLM
An open-source framework for serving and evaluating LLM routers.