C

circuit-breaker

Put a queue, deduplication, a circuit breaker and a dead-letter queue in front of any LLM API (Anthropic, OpenAI, llama.cpp, vLLM), so repeated prompts cost one call and outages fail fast. Rust library, HTTP server and CLI.

Single-header C++17: exponential backoff with jitter, provider failover and a circuit breaker for LLM calls. Part of llm-cpp.

Classifier-driven model router for pi and Oh My Pi (omp). Routes each prompt through a System-One classifier (Jev or Laya) to the best model, with circuit breaking and fallback chains.