
· Abraham · Alyss AI
Ollama, vLLM, or SGLang?
I just couldn't resist testing it for myself on my RTX 3080 12GB.

I just couldn't resist testing it for myself on my RTX 3080 12GB.

Exploring the evolution towards a modular architecture, latency challenges, and the integration of LangGraph, MCP, and SGLang.

An act of personal resistance, a legacy of love, and a stake in digital sovereignty in the age of AI.