// tag archive

#context length

2 articles // sorted by date

Inference speed optimization decision stack for local LLM on consumer GPU and Android hardware

How to Improve LLM Inference Speed Without Buying New Hardware

Your local model is slow. Before you buy anything, work through this sequence. Most inference speed problems are configuration problems, not hardware problems.

Diagram comparing full GPU inference speed versus partial CPU offload performance in local LLM inference on consumer hardware

AI Productivity & Workflows

LLM Inference Explained: Tokens Per Second, VRAM, and What You Can Actually Control

You ran a local model and it's generating at three tokens per second. Here is why, and what you can…

May 1, 2026 Read →