# Jarvis
**A 100% private AI voice assistant that lives on your computer** (works offline). Talk naturally as if Jarvis is a third person in the room โ say its name anywhere in your sentence and get conversational, context-aware responses. It remembers everything, always knows the current location and time, can search the web, read your screen, control Chrome, track nutrition, and much more with support for unlimited MCPs and tools without context rot. Sensitive info is automatically redacted before anything is saved to disk.
๐ 100% local processing. No subscriptions. No data harvesting. Automatic redaction of sensitive info. Free offline dictation included.
<p align="center">
<img src="https://img.shields.io/badge/License-Non--Commercial-blue.svg" alt="License">
<img src="https://img.shields.io/badge/Python-3.11+-3776AB.svg?logo=python&logoColor=white" alt="Python 3.11+">
<img src="https://img.shields.io/badge/Platform-macOS%20%7C%20Windows%20%7C%20Linux-lightgrey.svg" alt="Platform">
<img src="https://img.shields.io/badge/Privacy-100%25%20Local%20%26%20Offline-green.svg" alt="100% Local">
</p>
<p align="center">
<img src="docs/img/face.png" alt="Jarvis Face" width="400">
</p>
<p align="center">
<img src="docs/img/memory-viewer-diary.png" alt="Memory Viewer - Diary" width="280">
<img src="docs/img/memory-viewer-knowledge.png" alt="Memory Viewer - Knowledge Graph" width="280">
<img src="docs/img/memory-viewer-meals.png" alt="Memory Viewer - Meals" width="280">
</p>
## Why Jarvis?
**๐ Your data stays yours** - 100% local AI processing. No cloud, no subscriptions, no data harvesting. Automatic redaction of sensitive info. This is non-negotiable.
**๐ฃ๏ธ A third person in the room** - Unlike voice assistants that only respond to rigid commands, Jarvis understands conversations. It maintains a short temporary rolling context of what's being discussed, so when you ask "Jarvis, what do you think?" it knows exactly what you're talking about. Have it chime into discussions with friends, help debug code while you talk through problems, or weigh in on decisions.
**๐ง Never forgets** - Unlimited memory across conversations. Adapts tone naturally to the topic. Learns your preferences over time.
**๐๏ธ Free dictation** - Hold a hotkey, speak, release โ your words appear in any app as text. Like WisprFlow, but free, offline, and private. No subscription, no cloud transcription.
**๐ Extensible** - MCP integration connects Jarvis to thousands of tools: smart home, GitHub, Slack, databases, and more. Smart tool selection means adding more tools won't slow things down.
**๐ Transparent progress** - We track what works (and what doesn't) with automated evals. [See current accuracy โ](EVALS.md)
**๐ง Known limitations:** Jarvis is under active development. Primary development happens on macOS. Windows/Linux support may lag behind. We're building in the open, [issues](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues) and [contributions](https://github.com/authrain-cloud-abdullahformuli/jarvis/pulls) welcome!
- Voice-only for nowโno text chat interface yet ([#35](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues/35))
- No mobile apps ([#17](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues/17))
- "Stop" commands during speech sometimes get filtered as echo ([#24](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues/24))
- Dictation is not available on macOS 26+ (Tahoe) due to a pynput incompatibility ([#172](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues/172))
<details>
<summary><strong>See it in action</strong> (example conversations)</summary>
**Chiming into conversations** (the magic moment):
```
๐ค Alice: I wonder what the weather will be like tomorrow
๐ค Bob: Yeah, we should check before planning the picnic
๐ค Alice: Jarvis, what do you think?
๐ Heard: "What do you think Jarvis?"
๐ง Intent (wake word): directed โ "what do you think about the weather for the picnic"
โจ Working on it: what do you think about the weather for the picnic
๐งฐ Tool: getWeatherโฆ
๐ฌ Generating response...
๐ค Jarvis
Tomorrow looks great for a picnic! Sunny with highs around 22ยฐC...
```
Jarvis understood the entire conversation and gave a contextual answer โ no need to repeat the question.
**Browser automation via MCP:**
```
๐ Heard: "Open YouTube Jarvis."
๐ง Intent (wake word): directed โ "open YouTube"
โจ Working on it: open YouTube
๐ฌ Generating response...
๐ค Jarvis
I have opened YouTube for you.
```
**Health-aware advice:**
```
๐ Heard: "Should I order pizza tonight considering my health goals Jarvis?"
๐ง Intent (wake word): directed โ "should I order pizza tonight considering my health goals"
โจ Working on it: should I order pizza tonight considering my health goals
๐งฐ Tool: fetchMealsโฆ
๐ฌ Generating response...
๐ค Jarvis
Looking at your week โ you mentioned wanting to lose 5kg by June...
Today you've had about 860 calories so far. Given your 1,800 calorie target,
you've got room for pizza! But maybe consider thin crust to save calories.
```
**Personalised news search:**
```
๐ Heard: "What are some news from today that might interest me Jarvis?"
๐ง Intent (wake word): directed โ "what are some news from today that might interest me"
โจ Working on it: what are some news from today that might interest me
๐งฐ Tool: searchMemoryโฆ
๐งฐ Tool: webSearchโฆ
๐ฌ Generating response...
๐ค Jarvis
Here's a quick snapshot of today's headlines...
```
**Natural wake word placement** (say "Jarvis" anywhere):
```
๐ Heard: "Give me a random topic to discuss Jarvis."
๐ง Intent (wake word): directed โ "give me a random topic to discuss"
โจ Working on it: give me a random topic to discuss
๐ฌ Generating response...
๐ค Jarvis
How about the Fermi Paradox? Given the vast number of stars...
```
**Echo detection** (Jarvis ignores its own speech):
```
๐ค Jarvis
I have opened YouTube for you.
๐ Listening for follow-up (3s)...
๐ Heard: "I have opened YouTube for you."
๐ Heard (echo): "i have opened youtube for you."
๐ค Returning to wake word mode
```
</details>
## Quick Install
### 1. Install Prerequisites
| Platform | Requirement |
|----------|-------------|
| **All** | [Ollama](https://ollama.com/download) (default), or any OpenAI-compatible server you already run (LM Studio, Jan, llama.cpp, vLLM, oMLX, LocalAI, โฆ) โ see [Configuration โ LLM Provider](#configuration) |
### 2. Download Jarvis
Get the latest from [GitHub Releases](https://github.com/authrain-cloud-abdullahformuli/jarvis/releases):
| Platform | Download | Run |
|----------|----------|-----|
| **Windows** | `Jarvis-Windows-x64.zip` | Extract โ Run `Jarvis.exe` |
| **macOS** | `Jarvis-macOS-arm64.zip` | Extract โ Move to Applications โ Right-click โ Open |
| **Linux** | `Jarvis-Linux-x64.tar.gz` | `tar -xzf` โ Run `./Jarvis/Jarvis` |
Jarvis starts listening automatically โ just say "Jarvis" and talk!
<p align="center">
<img src="docs/img/setup-wizard-initial-check.png" alt="Setup - Initial Check" width="200">
<img src="docs/img/setup-wizard-model.png" alt="Setup - Model Selection" width="200">
<img src="docs/img/setup-wizard-whisper.png" alt="Setup - Whisper" width="200">
<img src="docs/img/setup-wizard-dictation.png" alt="Setup - Dictation" width="200">
<img src="docs/img/setup-wizard-mcp.png" alt="Setup - MCP Servers" width="200">
<img src="docs/img/setup-wizard-complete.png" alt="Setup - Complete" width="200">
</p>
<p align="center">
<img src="docs/img/logs.png" alt="Real-time Logs" width="500">
</p>
## Features
- **Conversational Awareness** - Understands ongoing discussions. Ask "Jarvis, what do you think?" and it knows what you're talking about. Works naturally in multi-person conversations.
- **Unlimited Memory** - Never forgets. Searches across all your conversation history. Memory Viewer GUI included.
- **Adaptive Tone** - Automatically surgical for code, pragmatic for business, encouraging for wellbeing โ no manual mode switching
- **Smart Tool Selection** - Embedding-based relevance filtering picks only the tools needed per query โ add unlimited MCP tools without performance degradation
- **Built-in Tools** - Screenshot OCR, web search (DuckDuckGo โ Brave โ Wikipedia fallback chain with auto-fetch), weather, file access, nutrition tracking, location awareness, plus a tool-discovery escape hatch the agent uses to widen its own toolset mid-reply
- **Knowledge Graph Memory** - Self-organising memory that learns from conversations, auto-splits by topic, and surfaces relevant knowledge automatically
- **Natural Voice** - Say "Jarvis" anywhere in your sentence, interrupt with "stop", follow up without repeating the wake word
- **Dictation Mode** - Free, offline alternative to WisprFlow โ hold a hotkey, speak, release to paste text into any app
- **MCP Integration** - Connect to thousands of external tools (Home Assistant, GitHub, Slack, etc.)
## System Requirements
| Hardware | VRAM | Model |
|----------|------|-------|
| Low-VRAM / CPU | 2GB+ | `qwen3.5:0.8b` |
| Most users | 8GB+ | `gemma4:e2b` (default) |
| Better quality | 16GB+ | `gemma4:e4b` |
| High-end | 24GB+ | `gpt-oss:20b` |
> **Note:** VRAM requirements include the fast model (`gemma4:e2b`) which is always loaded alongside the chat model for voice intent classification and other real-time work. The default chat model shares this, so no extra VRAM is needed.
The setup wizard will guide you through model selection and installation on first launch.
## Configuration
Most users won't need to change anything. Open **โ๏ธ Settings** from the tray menu to configure Jarvis through a graphical interface โ no JSON editing required. Settings are saved to `~/.config/jarvis/config.json`.
<p align="center">
<img src="docs/img/settings-window.png" alt="Settings Window" width="500">
<img src="docs/img/settings-mcp.png" alt="Settings - MCP Servers" width="500">
</p>
<details>
<summary><strong>LLM Provider (Ollama or OpenAI-compatible)</strong></summary>
By default Jarvis runs everything locally through [Ollama](https://ollama.com): no API keys, nothing leaves your machine. If you already run an OpenAI-compatible server you can point Jarvis at it instead. Your data still only travels to the servers you control.
Pick the provider in the Setup Wizard's first step, or under **โ๏ธ Settings โ ๐ LLM Provider**. No JSON editing required. On the OpenAI-compatible page the wizard does the legwork for you: it auto-detects running local servers, offers a one-click preset for your app, and when you press **Connect** it loads the server's model list and checks the chosen model for chat, tool calling, and embeddings, so you know it works before you finish setup.
Tested local servers (all run on your own machine):
| App | Default base URL | Notes |
|-----|------------------|-------|
| LM Studio | `http://localhost:1234/v1` | Chat, tool calling, and embeddings. |
| Ollama (OpenAI API) | `http://localhost:11434/v1` | The native Ollama path is the default; the OpenAI shape works too. |
| Jan | `http://localhost:1337/v1` | Chat and tool calling. |
| llama.cpp (`llama-server`) | `http://localhost:8080/v1` | Tool calling depends on the model. |
| LocalAI | `http://localhost:8080/v1` | Feature support depends on the backend model. |
| vLLM | `http://localhost:8000/v1` | Tool calling depends on the model. |
| oMLX (Apple Silicon) | varies | No embeddings endpoint, so memory uses keyword search unless you route embeddings to Ollama (below). |
For reference, the underlying config keys are:
```json
{
"llm_provider": "openai_compatible",
"llm_base_url": "http://localhost:1234/v1",
"llm_api_key": "",
"llm_chat_model": "your-served-model-name"
}
```
- `llm_base_url`: your server's OpenAI API base URL.
- `llm_api_key`: only if your server requires one; leave empty otherwise.
- `llm_chat_model`: whatever model name your server exposes.
- `fast_model` (optional): the small, quick model used for real-time work (voice intent, tool routing, quick classifications). Leave empty for automatic: `gemma4:e2b` on Ollama, your chat model on an OpenAI-compatible server. Set it to pin a dedicated small model.
**Embeddings** (used for memory search) can run on a different backend. If your chat server has no embeddings endpoint, memory falls back to keyword search. To keep full semantic memory, route embeddings to Ollama (the wizard offers this automatically when it detects a server that cannot embed):
```json
{
"embedding_provider": "ollama",
"embedding_model": "nomic-embed-text"
}
```
Leave `embedding_provider` empty to use the same provider as chat. With no working embeddings, memory search degrades gracefully to keyword search.
</details>
<details>
<summary><strong>Speech Recognition (Whisper)</strong></summary>
#### Language Modes
- **Multilingual** (default, 99 languages): `"whisper_model": "medium"`
- **English Only** (slightly better English accuracy): `"whisper_model": "medium.en"`
#### Model Sizes
| Model | English | Multilingual | Download | VRAM | Speed |
|-------|---------|--------------|----------|------|-------|
| Tiny | `tiny.en` | `tiny` | ~75 MB | ~1 GB | ~10x |
| Base | `base.en` | `base` | ~140 MB | ~1 GB | ~7x |
| Small | `small.en` | `small` | ~465 MB | ~2 GB | ~4x |
| **Medium** | `medium.en` | `medium` | ~1.5 GB | ~5 GB | ~2x |
| Large V3 Turbo | - | `large-v3-turbo` | ~1.5 GB | ~6 GB | ~8x |
Speed is relative to the original large model. [Source](https://github.com/openai/whisper)
#### GPU Acceleration (Windows)
If you have an NVIDIA GPU, Jarvis can use CUDA for much faster speech recognition. The Windows installer offers an optional CUDA download during setup. For development:
```bash
pip install nvidia-cublas-cu12 nvidia-cudnn-cu12
```
CUDA is detected automatically โ no configuration needed.
#### Hallucination Filters
Whisper sometimes produces confident but false transcriptions during silence or background noise (e.g. news-show intros, music). Two thresholds filter these out before they reach the intent judge:
- `"whisper_min_confidence": 0.3` โ drops segments whose `avg_logprob`-derived confidence falls below this value. Raise if you see low-confidence noise leaking through; lower if real speech is being dropped.
- `"whisper_no_speech_threshold": 0.5` โ drops any segment whose `no_speech_prob` is at or above this value, regardless of `avg_logprob`. Catches the case where Whisper is confident about a hallucinated phrase but its own no-speech signal says the audio was silent. Applies to both the faster-whisper and MLX backends.
Both thresholds are exposed in the Settings window under *Whisper*.
</details>
<details>
<summary><strong>Voice Interface (Advanced)</strong></summary>
**LLM Intent Judge** - Jarvis uses a small LLM for intelligent voice intent classification (echo detection, query extraction, stop commands). On the default Ollama setup this is `gemma4:e2b`, installed automatically alongside your chosen chat model during setup. On an OpenAI-compatible provider the judge uses your served chat model instead, so there is nothing extra to install. The intent judge cannot be disabled but gracefully falls back to simpler text matching if the LLM server is unavailable.
**Tool Router** - When `"tool_selection_strategy": "llm"` (the default), Jarvis asks the fast model to pick which tools are relevant for each query, shrinking the tool catalogue the chat model sees. It's already warm and small enough not to stall the turn. Other strategies: `"keyword"` (fast, no LLM), `"embedding"` (nomic-embed-text), `"all"` (no filtering).
**Task-list Planner** - Before the agentic loop, Jarvis runs a short planning pass that decomposes multi-step queries into an ordered list of sub-tasks. For small models (`gemma4:e2b` class), each planned step is directly resolved to a concrete tool call without relying on the chat model to re-plan turn-by-turn. This significantly improves multi-step reliability. Config options:
```json
{
"planner_enabled": true, // set to false to disable the planner entirely
"planner_timeout_sec": 6.0 // per-call timeout for plan and step-resolver LLM calls
}
```
</details>
<details>
<summary><strong>Small-Model Digest Passes (Advanced)</strong></summary>
Small chat models (~2B, e.g. `gemma4:e2b`) degrade sharply as their prompt grows. Jarvis runs two cheap distil passes to keep the prompt tight:
- **Memory digest** โ boils diary + graph recall into a short relevance-filtered note before injecting it as background context.
- **Tool-result digest** โ boils a raw tool payload (especially webSearch UNTRUSTED WEB EXTRACT blocks) into a short attributed fact note before it reaches the main reply model.
Both digest passes auto-enable for small models (โค7B) and stay off for large models. For small models, tool-result digest also prevents large fetch_web_page payloads from blowing the context window. Override in `~/.config/jarvis/config.json`:
```json
{
"memory_digest_enabled": null, // null = auto-on for SMALL, false to force off, true to force on
"tool_result_digest_enabled": null, // null = auto-on for SMALL, false to force off, true to force on
"llm_digest_timeout_sec": 8.0 // tight ceiling shared by both passes
}
```
Field logs show `๐งฉ Memory digest: โฆ` and `๐งฉ Tool digest: โฆ` lines when a pass ran, so you can see when the substrate was replaced.
</details>
## Dictation Mode โ Free WisprFlow Alternative
Hold a hotkey to record speech, release to paste the transcription into any app. Works everywhere โ your editor, browser, chat, terminal. Completely local, completely free.
<p align="center">
<img src="docs/img/dictation-history.png" alt="Dictation History" width="400">
<img src="docs/img/setup-wizard-dictation.png" alt="Setup Wizard - Dictation" width="400">
</p>
| Platform | Default hotkey |
|----------|---------------|
| **Windows** | Ctrl + Win |
| **macOS** | Ctrl + Option |
| **Linux** | Ctrl + Alt |
- ๐ **100% offline** โ your speech never leaves your machine (unlike cloud dictation services)
- ๐ง **Shared Whisper model** โ uses the same speech recognition as voice input, no extra memory
- โก **Zero latency startup** โ no server round-trip, transcription starts the moment you release
- ๐ **Universal paste** โ works in any app that accepts `Ctrl+V` / `Cmd+V`
- ๐ **Non-intrusive** โ main voice listener pauses automatically during dictation
- โ **Hands-free mode** โ double-tap the hotkey to keep recording without holding; press again or hit Escape to stop
- ๐งน **Filler word removal** โ optional LLM-powered cleanup removes "um", "uh", "like", "you know" while preserving meaning
- ๐ **Custom dictionary** โ define `"wrong -> right"` replacements for jargon, names, and technical terms
- ๐ **History window** โ browse, copy, or delete past dictations from the system tray
- ๐๏ธ **Easy setup** โ configure dictation during the setup wizard or anytime in Settings (hotkey dropdown, filler removal toggle, custom dictionary editor)
Customise the hotkey in Settings or `config.json`:
```json
{
"dictation_hotkey": "ctrl+alt",
"dictation_filler_removal": true,
"dictation_custom_dictionary": [
"jarvis -> Jarvis",
"pytorch -> PyTorch"
]
}
```
> **Note:** macOS requires Accessibility permissions for the global hotkey. Linux requires X11 (limited Wayland support).
<details>
<summary><strong>Text-to-Speech</strong></summary>
**Piper TTS (default)** - Neural TTS that auto-downloads on first use (~60MB):
- Works out of the box - no setup required
- High-quality British English male voice (en_GB-alan-medium)
- Fast local synthesis with exact duration tracking
To use different Piper voices, download from [HuggingFace](https://huggingface.co/rhasspy/piper-voices) and set:
```json
{
"tts_piper_model_path": "~/.local/share/jarvis/models/piper/en_GB-alan-medium.onnx"
}
```
**Chatterbox** - AI voice with emotion control (requires running from source):
```json
{ "tts_engine": "chatterbox" }
```
Voice cloning with Chatterbox - add a 3-10 second .wav sample:
```json
{
"tts_engine": "chatterbox",
"tts_chatterbox_audio_prompt": "/path/to/voice.wav"
}
```
</details>
<details>
<summary><strong>Location Detection</strong></summary>
Jarvis can provide location-aware responses (weather, local time, etc.) using a local GeoLite2 database โ no cloud geolocation services are used.
**IP detection chain** (in order of preference):
1. **Manual IP** โ configure `location_ip_address` in settings
2. **UPnP** โ queries your local router (no traffic leaves LAN)
3. **Socket heuristic** โ determines which interface routes externally (no data sent)
4. **OpenDNS DNS query** โ single `myip.opendns.com` lookup to `208.67.222.222` (only external query)
If your ISP uses carrier-grade NAT (CGNAT), Jarvis automatically resolves your true public IP via the same OpenDNS DNS query. This can be disabled:
```json
{
"location_cgnat_resolve_public_ip": false
}
```
**Setup:** Register for a free [MaxMind GeoLite2](https://www.maxmind.com/en/geolite2/signup) account, download the City database (MMDB format), and save it to `~/.local/share/jarvis/geoip/GeoLite2-City.mmdb`. The setup wizard will guide you through this.
</details>
<details>
<summary><strong>MCP Tool Integration</strong></summary>
Connect Jarvis to external tools via [MCP servers](https://github.com/topics/mcp-server):
```json
{
"mcps": {
"github": {
"command": "npx",
"args": ["-y", "@modelcontextprotocol/server-github"],
"env": { "GITHUB_TOKEN": "your-token" }
}
}
}
```
**Popular integrations:**
- **Home Assistant** - Voice control for smart home
- **Google Workspace** - Gmail, Calendar, Drive, Docs
- **GitHub** - Issues, PRs, workflows
- **Notion** - Knowledge management
- **Slack/Discord** - Team communication
- **Databases** - MySQL, PostgreSQL, MongoDB
- **Composio** - 500+ apps in one integration
See [full MCP setup guide](#mcp-integrations) below.
</details>
## MCP Integrations
> **Session persistence:** each MCP server is launched once and its stdio session is kept open across tool calls. Stateful servers (e.g. browser automation, where the server owns a long-running Chrome process) work correctly. If you have a server you'd rather not keep resident, set `"idle_timeout_sec": 300` on its config entry and Jarvis will free it after that long without activity. If a server's tools legitimately run long (e.g. delegating a task to an external CLI agent), set `"timeout_sec": 600` to raise its 120-second default call timeout.
<details>
<summary><strong>Home Assistant</strong> - Smart home voice control</summary>
1. Add MCP Server integration in Home Assistant (Settings โ Devices & services)
2. Expose entities you want to control (Settings โ Voice assistants โ Exposed entities)
3. Create Long-lived Access Token (Profile โ Security โ Create token)
4. Install proxy: `uv tool install git+https://github.com/sparfenyuk/mcp-proxy`
5. Add to config:
```json
{
"mcps": {
"home_assistant": {
"command": "mcp-proxy",
"args": ["http://localhost:8123/mcp_server/sse"],
"env": { "API_ACCESS_TOKEN": "YOUR_TOKEN" }
}
}
}
```
"Jarvis, turn on the living room lights" / "set bedroom to 72ยฐ" / "run good night scene"
</details>
<details>
<summary><strong>Google Workspace</strong> - Gmail, Calendar, Drive, Docs, Sheets</summary>
```json
{
"mcps": {
"google_workspace": {
"command": "npx",
"args": ["-y", "google-workspace-mcp"],
"env": {
"GOOGLE_CLIENT_ID": "your-client-id",
"GOOGLE_CLIENT_SECRET": "your-client-secret"
}
}
}
}
```
Setup: [taylorwilsdon/google_workspace_mcp](https://github.com/taylorwilsdon/google_workspace_mcp)
</details>
<details>
<summary><strong>GitHub</strong> - Repos, issues, PRs, workflows</summary>
```json
{
"mcps": {
"github": {
"command": "npx",
"args": ["-y", "@modelcontextprotocol/server-github"],
"env": { "GITHUB_TOKEN": "your-token" }
}
}
}
```
</details>
<details>
<summary><strong>Notion, Slack, Discord, Databases</strong></summary>
**Notion:**
```json
{ "mcps": { "notion": { "command": "npx", "args": ["-y", "@makenotion/mcp-server-notion"], "env": { "NOTION_API_KEY": "your-token" } } } }
```
**Slack:**
```json
{ "mcps": { "slack": { "command": "npx", "args": ["-y", "slack-mcp-server"], "env": { "SLACK_BOT_TOKEN": "xoxb-...", "SLACK_USER_TOKEN": "xoxp-..." } } } }
```
**Discord:**
```json
{ "mcps": { "discord": { "command": "npx", "args": ["-y", "discord-mcp-server"], "env": { "DISCORD_BOT_TOKEN": "your-token" } } } }
```
**Databases:** [bytebase/dbhub](https://github.com/bytebase/dbhub) (SQL), [mongodb-mcp-server](https://github.com/mongodb-js/mongodb-mcp-server) (MongoDB)
</details>
<details>
<summary><strong>Composio</strong> - 500+ apps in one integration</summary>
```json
{
"mcps": {
"composio": {
"command": "npx",
"args": ["-y", "@composiohq/rube"],
"env": { "COMPOSIO_API_KEY": "your-key" }
}
}
}
```
Get API key at [composio.dev](https://composio.dev)
</details>
## Troubleshooting
<details>
<summary><strong>Common issues</strong></summary>
**First startup takes a bit** - Jarvis pre-warms the Whisper, chat, and intent-judge models before announcing "Listening!" so the first engagement feels instant. This adds a few seconds on cold start and is bounded at 60 s โ if Ollama is slow, Jarvis will start listening anyway and load the models on demand.
**Jarvis doesn't hear me** - Check microphone permissions, speak clearly after "Jarvis"
**Responses are slow** - Ensure you have enough VRAM (8GB+ for default model; see System Requirements for other models)
**Windows: App won't start** - Extract full zip first, check Windows Defender
**macOS: "App can't be opened"** - Right-click โ Open, or System Settings โ Privacy & Security โ Allow
**Linux: No tray icon** - `sudo apt install libayatana-appindicator3-1`
**Jarvis keeps deflecting on questions it answered before** - small models can record their own past failures into the diary, which then primes future sessions to repeat them. New writes are scrubbed automatically; to clean historical entries, open the Memory Viewer, switch to the Diary tab, and click **Clean up deflection narration** in the sidebar Maintenance section. Only sentences that narrate the assistant's failures are removed; the rest of each entry stays.
</details>
## For Developers
<details>
<summary><strong>Running from source</strong></summary>
```bash
git clone https://github.com/authrain-cloud-abdullahformuli/jarvis.git
cd jarvis
# macOS
bash scripts/run_macos.sh
# Windows (with Micromamba)
pwsh -ExecutionPolicy Bypass -File scripts\run_windows.ps1
# Linux
bash scripts/run_linux.sh
```
Running from source enables Chatterbox TTS (AI voice with emotion/cloning). Piper TTS works in both bundled and source modes.
</details>
<details>
<summary><strong>Privacy hardening</strong> (stay 100% offline)</summary>
```json
{
"web_search_enabled": false,
"wikipedia_fallback_enabled": false,
"brave_search_api_key": "",
"mcps": {},
"location_auto_detect": false,
"location_cgnat_resolve_public_ip": false,
"location_enabled": false
}
```
Verify: `sudo lsof -i -n -P | grep jarvis` (should only show 127.0.0.1 to Ollama)
</details>
<details>
<summary><strong>Web search fallback chain</strong></summary>
When DuckDuckGo is rate-limited or returns nothing fetchable, Jarvis walks
a small fallback chain before giving up rather than confabulating:
1. **Brave Search** โ opt-in, requires `brave_search_api_key`. Free tier:
2,000 queries/month. Get a key at
[api.search.brave.com](https://api.search.brave.com/app/keys).
2. **Wikipedia** โ zero-config, on by default, uses the Wikipedia host
matching the language Whisper auto-detected on the utterance (so a
Turkish question gets a Turkish answer). Disable with
`wikipedia_fallback_enabled: false`.
3. **Honest failure** โ if every provider fails, the reply tells you the
search was blocked rather than making something up.
The whole chain is bounded by a ~20s wall-clock deadline so a stalled
provider can't run out the voice-assistant latency budget.
</details>
## Privacy & Storage
- **100% offline** - No cloud services required
- **Auto-redaction** - Emails, tokens, passwords automatically removed
- **Local storage** - Everything in `~/.local/share/jarvis`
## License
- **Personal use**: Free forever
- **Commercial use**: [Contact us](mailto:authrainmedia@gmail.com)
## Author & Maintainer
**Abdullah Formuli**
- GitHub: [@authrain-cloud-abdullahformuli](https://github.com/authrain-cloud-abdullahformuli)
- X / Twitter: [@abdullahformuli](https://x.com/abdullahformuli)
## Support & Community
[Report issues](https://github.com/authrain-cloud-abdullahformuli/jarvis/issues) ยท [Discussions](https://github.com/authrain-cloud-abdullahformuli/jarvis/discussions)