V

vllm

useful Gentoo overlay Curated ebuilds, AI, tools & science

A modular experimentation framework for evaluating LLM orchestration strategies over real 5G network capabilities.

Experiments with Subliminal Learning

Extreme KV Cache Compression for LLM Inference — C++17/CUDA implementation of TurboQuant (arXiv 2504.19874). 7.5x compression, <2% quality loss.

https://ayinedjimi-consultants.fr