> ## Content Index
> Fetch the complete content index at: https://vanta-plus.planethemes.com/llms.txt
> Use this file to discover other available public pages before exploring further.

# On-device small language models
- URL: https://vanta-plus.planethemes.com/on-device-small-language-models/
- Published: 2026-09-24T09:00:00.000Z
- Updated: 2026-09-24T09:00:00.000Z
- Description: A 3B model on a phone won't write your novel. It will summarise, classify and redact without your data leaving the device.
- Author: Elena Ruiz
- Tags: AI, #Import 2026-10-23 17:46

The interesting models of 2026 are not the biggest ones. They are the ones small enough to run where the data already is.

## What fits in a pocket

| Task                 | Good fit on device? | Why                                |
| -------------------- | ------------------- | ---------------------------------- |
| Summarise a note     | Yes                 | Short context, forgiving output    |
| Classify an email    | Yes                 | Closed set of labels               |
| Redact personal data | Yes                 | Data never leaves the phone        |
| Long research report | No                  | Needs retrieval and a bigger model |

## Latency is a feature

A round trip to a hosted model costs hundreds of milliseconds before the first token. On device, the first token arrives before the user's finger leaves the button. For autocomplete and inline actions, that difference decides whether the feature feels native.

## Measure before you ship

Small models fail quietly. Build a fixed set of real examples, run it on every model update, and read the failures by hand. The eval is the product spec.