Open source voice assistant Android 12+ MIT

Nothing leaves your phone.

Offwire is a hands-free voice assistant that runs Gemma 4 entirely on your phone. No account, no cloud. Turn on airplane mode and keep talking.

  • 0 serversSpeech, model and voice run on the device
  • 0.26 sTime to first token on a Pixel 9 Pro
  • 1 downloadThen it works with no signal

Illustration. The reply is spoken clause by clause as it streams.

Privacy

Everything runs on the device.

Cloud assistants send what you say to a server to answer it. This one answers on the phone itself. Here is exactly what that means.

  • On device

    Speech, model and voice stay local

    Speech recognition, the language model and the spoken voice all run on the phone. There is no server on the other end.

  • Offline

    One download, then airplane mode

    The only network use is fetching the models once: the Gemma 4 E2B file (about 2.6 GB, from Hugging Face) and an optional voice model (about 190 MB). After that it works with every radio off.

  • Anonymous

    No account, no analytics

    No sign-in, no account, no analytics. The app has nothing to identify you with and nowhere to report to.

  • Encrypted

    Notes are encrypted at rest

    Things you ask it to remember are saved on the device with AES-256-GCM, using an Android Keystore key that cannot be exported.

Check it yourself

The code is open, so the promise is checkable. By project rule, a single class, NetworkClient, is the only code allowed to open a connection.

Every request it makes is written on the device to network-log.jsonl. Read the class, then read the log.

Demo

Hear it for yourself.

How it works

Six stages, one phone.

Your voice goes in at the microphone and a spoken answer comes out of the speaker. Every stage in between is a model running locally.

  1. Input

    Microphone

    Listens hands-free. Nothing to tap while you drive or walk.

  2. Voice activity

    Silero VAD

    Detects when you start and stop speaking.

    ONNX Runtime
  3. Speech to text

    Parakeet TDT 110M

    NVIDIA's int8 model turns your speech into text.

    sherpa-onnx
  4. Language model

    Gemma 4 E2B

    Writes the reply on the phone's GPU and streams it out token by token.

    Google LiteRT-LM
  5. Text to speech

    Kyutai Pocket TTS

    Speaks each clause as it arrives. You can use the Android system voice instead.

    sherpa-onnx
  6. Output

    Speaker

    The answer, out loud, without looking at the screen.

It talks while it thinks

Replies are spoken clause by clause as they stream, so you hear the start of an answer before the model has finished writing it.

Interrupt it mid-sentence

Start talking and it stops to listen. Barge-in works the way it does with a person.

Optional wake word

In wake word mode it listens for a wake phrase. Speech that isn't addressed to it is never sent to the model.

Speed

Measured on a real phone.

One device, one model, one date. These are measurements from a single setup, and other phones will differ.

Pixel 9 Pro · Gemma 4 E2B · LiteRT-LM 0.18.1 · GPU · median of 3 runs · measured Oct 31, 2026
Time to first token
0.26s
First spoken clause ready
0.32to0.81s
Decode
16.1to17.5tokens per second
Engine load
2.5s27 s one-time GPU compile on first launch after install

Decode is faster than the reply can be spoken. In progressAn on-screen speed readout showing time to first token and tokens per second, so you can see the numbers on your own phone.

What to expect

Built for drives and walks.

A voice-first assistant and brainstorming partner for the times your hands and eyes are busy. It is a small model: quick, private and sometimes wrong.

Good at

  • Thinking out loudTalk through an idea on the road and have something push back.
  • Remembering thingsAsk it to remember something and it saves a note on the device. It answers later questions from those notes.
  • Working with no signalAnywhere the model is already on the phone, signal or not.
  • Eyes-free useLarge print, strong contrast, follows your phone's font size, and usable without looking at the screen.

Honest limits

  • It has no internetIt can't look anything up: no news, weather, scores or search.
  • It can be wrongGemma 4 E2B is a small model. Check anything that matters.
  • It isn't a coding toolIt is made for conversation, and it is the wrong tool for writing code.
  • It has one toolsave_note. It saves notes and answers from them, and that is all it can act on.

In progressA small tool router, so the model calls a tool only when you ask for one.

PlannedAn on-device code sandbox: the model writes a little JavaScript and runs it offline in a hidden browser view, for exact math, quick stats and small data jobs like parsing or converting.

PlannedImage understanding: show it a photo, a screenshot or a document and ask about it by voice. Input only, no image generation.

Get started

Build it today.

Android
12 or newer
Storage
About 3 GB free
Memory
A recent phone with 8 GB RAM or more is recommended
Models
Download once over Wi-Fi: about 2.6 GB, plus about 190 MB for the optional voice
iOS
Planned

APK on GitHub ReleasesComing with the first release. Until then, build from source.

Build from source
$ git clone https://github.com/chrishonson/gemma-voice
$ cd gemma-voice
$ ./gradlew :app-console:installDebug

Connect a phone with USB debugging on. The first launch downloads the model, then compiles it for the GPU once.

Open source

Read it, run it, improve it.

Offwire is a personal project released under the MIT license. Issues and pull requests are welcome. These are the places help counts most:

Device testing

Run it on a phone other than a Pixel 9 Pro and report what you measure.

Tool routing evals

Test cases that show when the model should call a tool and when it should just answer.

iOS

The app is Kotlin Multiplatform and an iPad build exists in development.

  • Kotlin Multiplatform
  • Compose Multiplatform
  • Strict MVI
  • LiteRT-LM
  • sherpa-onnx
  • ONNX Runtime