Tag

local-ai

4 essays tagged local-ai.

Primer · 6 min

AI on your own machine, explained like you're new here

What "running AI locally" actually means, what a container is, and why people do this at all — the plain-language version, with animated diagrams instead of jargon.
Benchmark · 7 min

What local models actually cost you, measured on two consumer GPUs

Six open models from 0.5B to 7.6B, measured for real on an RTX 3070 and a GTX 1660 SUPER — throughput, memory, cold starts, and which ones actually get the arithmetic right.
Guide · 8 min

Run AI on your own box: a practical map of local models

What actually happens when you run AI on your own hardware — what you need, what it costs, where it wins, and where the cloud still wins. No hype either way.
Voices · 4 min

Should AI run on your machine or in someone's cloud?

Four camps, one question — where should AI run? A round-up of the strongest arguments from each side of the local-vs-cloud AI debate, and where this site stands.

All essays