Projects with this topic
Sort by:
-
An inference-memory layer for vLLM: the conversation's history in host RAM, the GPU as a bounded working set · KV-cache offload for LLM inference, Intel GPU and SYCL/oneAPI engineering, C++ and native ports with parity proof, GPU inference optimisati
Updated