OpenCompass Website ^HOT      OpenCompass Toolkit ^{TRY IT OUT}

 

What is OpenCompass ? OpenCompass is a platform focused on understanding of the AGI, include Large Language Model and Multi-modality Model.

We aim to:

• develop high-quality libraries to reduce the difficulties in evaluation
• provide convincing leaderboards for improving the understanding of the large models
• create powerful toolchains targeting a variety of abilities and tasks
• build solid benchmarks to support the large model research
• research on inference of Large Model(analysis, reasoning, prompt engineering.)

OpenCompass

• OpenCompass is an LLM evaluation platform, supporting a wide range of models (LLaMA, LLaMa2, ChatGLM2, ChatGPT, Claude, etc) over 80+ datasets.
• https://github.com/open-compass/opencompass

VLMEvalKit

• VLMEvalKit is a toolkit for evaluating large vision-language models (LVLMs), currently supporting ~20 LVLMs and five multi-modal benchmarks.
• https://github.com/open-compass/vlmevalkit

CompassVerifier

• CompassVerifier is an accurate and robust lightweight verifier model for evaluation and outcome reward.
• https://github.com/open-compass/CompassVerifier

CompassJudger

• CompassJudger-2: Towards Generalist Judge Model via Verifiable Rewards
• https://github.com/open-compass/CompassJudger