LMArena

About LMArena

LMArena is a web-based platform that allows users to compare large language models through pair-wise anonymous match-ups: users input prompts, two unnamed models respond, and the crowd votes for the better answer; the identities are only revealed after voting, enabling transparent, large-scale evaluation of model quality. It aggregates these votes into leaderboards and rankings, enabling contributors of models to benchmark performance against peers and gain feedback from real-world usage. Its open framework supports many different models from academic labs and industry, fosters community engagement through direct model testing and peer comparison, and helps identify strengths and weaknesses of models in live interaction settings. It thereby moves beyond static benchmark datasets to capture dynamic user preferences and real-time comparisons, providing a mechanism for users and developers alike to observe which models deliver superior responses.