LM Evaluation Harness

Other AI ToolsNew rating0 reviews367 views

The industry-standard framework for evaluating generative language models on 60+ benchmark tasks.

evaluationsbenchmarkseleutheraiopen-source

Maintained by EleutherAI, the Evaluation Harness powers the Hugging Face Open LLM Leaderboard, running MMLU, GSM8k, HumanEval, and ARC benchmarks uniformly across models.

Similar Tools & Alternatives

Explore other leading solutions in Other AI Tools.

All Other AI Tools tools →

vLLM

★ New (0) • free

High-throughput and memory-efficient LLM serving engine featuring PagedAttention algorithm.

Read more Compare

FastChat

★ New (0) • free

Open platform for training, serving, and evaluating LLM chatbots, powering LMSYS Chatbot Arena.

Read more Compare

SambaNova Cloud

★ New (0) • freemium

Ultra-fast inference platform running full 405B models at full 16-bit precision at blazing speeds.

Read more Compare

Text Generation Inference (TGI)

★ New (0) • free

Rust, Python, and gRPC server for text generation inference used in production at Hugging Face.

LM Evaluation Harness

Similar Tools & Alternatives

Community Reviews (0)

No reviews yet