L

llm-evaluation

Single-header C++17: A/B test prompts or models with Welch's t-test, Cohen's d and custom scorers. Part of llm-cpp.

Single-header C++17: run a prompt N times, measure consistency, compare models or prompts and score responses. Part of llm-cpp.