I

inference

A self-hosted AI platform — inference, tool use, browser automation, image generation, speech synthesis, transcription, object storage, agentic code execution, and more — behind a single OpenAI-compatible endpoint. One docker-compose up.

Mock embedded inference-accelerator runtime a small C++/Python SDK and Linux daemon used as a test fixture for build automation and CI tooling.

Intelligent VRAM/RAM swapping for LLM inference - Extension of KVortex | Offloading intelligent VRAM/RAM pour l'inference

https://ayinedjimi-consultants.fr

Automated LLM Benchmarking on GPU - tokens/sec, latency percentiles, VRAM profiling, multi-format support (HuggingFace, GGUF, GPTQ)

https://ayinedjimi-consultants.fr

Extreme KV Cache Compression for LLM Inference — C++17/CUDA implementation of TurboQuant (arXiv 2504.19874). 7.5x compression, <2% quality loss.

https://ayinedjimi-consultants.fr

In this project, we discard the hypothesis of a discrete distribution for the probability of the words and look for the proper correction to exchangeability to better attribute books to authors.

Evaluation of Fast, Faster and Mask R-CNN regarding their inference times