Jarvis
User GuidemacOS · Apple Silicon
JARVIS
Just A Rather Very Intelligent System
User Guide
A voice assistant for Mac with its own neural network.
Folders, movies, mail and documents — in a single sentence.
Mac · Apple SiliconРусский · EnglishWorks offline
jarvisapp.techOctober 2026
Jarvis · User GuideContents

Contents

What this guide is about

Jarvis lives on your Mac and does everything himself: finds and opens files, plays movies, reads mail and documents, and answers out loud. This guide explains how to install and set him up, how to connect an external AI, and how to talk to him.

Jarvis, open downloads — this is how spoken phrases are marked; you can change the words, Jarvis understands natural speech. ⌘D — keys. Yellow numbered circles on screenshots refer to the list under the picture.

jarvisapp.tech
Jarvis · User Guide01 · What Jarvis is

Section 01

What Jarvis is

It is a shell for your Mac in the spirit of Jarvis from “Iron Man”: a golden sphere in the centre, with the clock, weather, mail and folders around it — all run by a live voice assistant. He hears, thinks and speaks right on your computer, with no internet.

Hearing

Understands speech on the Mac

Speech recognition runs on the computer itself. Jarvis answers only to his name and never mistakes a movie soundtrack for a command.

Brain

His own neural network — or any external one

The built-in Gemma model is fine-tuned on real Jarvis commands and thinks in about a second and a half. If you prefer — ChatGPT, Claude, Gemini, DeepSeek or Alice.

Voice

Answers in a living voice

The neural voice Karen: a brisk business-like pace, no robotic intonation. Answers are short and to the point, one to three sentences.

Hands

Does everything himself

Folders, movies, mail, documents, the browser. Anything that changes or deletes files — only after your “yes”.

The main screen. Jarvis has just said hello: “Good afternoon, sir! What a nice day — nobody bothered you today, no new mail.” The widgets orbit the sphere.

Two rules that are never broken. Jarvis copies, moves, renames and deletes only with your consent — and first says what and where. Deleting means the Trash only: there is no permanent deletion in the program at all.
jarvisapp.tech
Jarvis · User Guide02 · Installation

Section 02

Installation

What you need

RequirementDetails
A Mac with an Apple processorM1 or newer. Jarvis does not run on Intel Macs.
Memory24 GB recommended. The brain, hearing, voice and the 3D scene live in memory at the same time: the main build takes about 19 GB when idle, the lighter “Jarvis 12B” — about 16 GB. With an external brain (ChatGPT, Claude…) you need 13 GB less.
Microphone and speakersBuilt-in or a Bluetooth headset. If sound goes to headphones, Jarvis listens through their microphone.
CameraNeeded only for gesture control. An iPhone camera (Continuity Camera) works too.
InternetOptional. Needed for the weather, the browser and external brains, if you choose them.

How to install

  1. Open the disk image Jarvis.dmg and drag Jarvis into the Applications folder.
  2. First launch — with the right mouse button. The app is signed locally, without a developer certificate, so the first time macOS will not open it with a double click. Right-click the icon → “Open” → “Open”. After that it opens as usual.
  3. Allow access. macOS will ask about the microphone and speech recognition — without them Jarvis cannot hear a command. The camera is needed the first time you turn on gestures, access to the Mail app — for the mail widget.
  4. Answer the four questions of the first-launch wizard (next section) — and Jarvis will say hello.
After an update, permissions are asked again. macOS permissions are tied to the app signature, and it changes with every new build. This is normal: click “Allow” once, and that is it.

Two builds

Jarvis

Main

The Gemma 26B brain: understands long requests better, does the sums itself, never mixes up the parties in a contract. For a Mac where Jarvis is the main program.

Jarvis 12B

Light

The Gemma 12B brain, 4 GB less memory. For working alongside browsers and heavy programs. Voice, hearing and graphics are the same.

Both builds install side by side and share the same settings, so they cannot run at the same time. Together with Jarvis, a small program “Jarvis — Wake” is placed in your Applications folder — it listens for claps while Jarvis is closed (section 11).

jarvisapp.tech
Jarvis · User Guide03 · First launch

Section 03

First launch

On the first launch Jarvis asks four questions. All of it can be changed later in the settings — the “Address” row, the “Change…” button.

The first-launch wizard. The chosen options are highlighted in gold. At the bottom — an example of how Jarvis will greet you.

1 · Language

Русский or English. Everything switches at once: speech recognition, the voice, commands and help. You can also switch by voice: switch to Russian, then переключись на английский.

2 · Who will use it

A man or a woman. This decides which forms of address the next question offers.

3 · How to address you

For a man: sir (default), Mr + surname or by first name. For a woman: ma’am (default), miss — for a young woman, Mrs + surname — for a married one, or by first name. Just like Jarvis with Tony Stark.

4 · Who will do the thinking

Built-in — on this Mac. The Gemma model runs on the computer: no internet, nothing leaves the machine. Takes about 13 GB of memory.

External — ChatGPT, Claude… After launch the settings open by themselves at the “Brain” section, where you enter a key. How to get one and where to put it — section 05.

Press “Start” — Jarvis will load, say hello and give a short briefing.
jarvisapp.tech
Jarvis · User Guide03 · First launch

03.1Boot screen and greeting

Every launch starts with the boot screen: the rings spin up, in the lower left corner the node check runs line by line, and the wide bar under the sphere fills as loading goes on. At the top — a greeting for the time of day. Usually this takes 5–10 seconds: that is how long it takes to bring up the brain, hearing and voice.

The J.A.R.V.I.S. boot screen. Lower left — the boot log: file system, speech recognition, voice synthesis, workspace, language model, greeting.

What happens next

  • Intro music — if enabled in the settings: Jarvis’s own theme or your file. It fades as soon as Jarvis starts speaking.
  • The greeting out loud and as a line under the clock: “Good afternoon, sir!..”. The line disappears once the phrase is spoken.
  • The briefing: how much is unread in Mail and messengers (by the badge numbers in the Dock, the contents are not read) and what the weather is.
  • The microphone turns on by itself. Otherwise answering to his name would make no sense. You can see the state on the “Hearing” indicator under the clock.

The program window

Jarvis opens full screen. It is an ordinary macOS program: you can minimise it, switch to another and come back. The window position is remembered.

Quit the program like any other (⌘Q) or by voice: Good night, Jarvis. He will say goodbye and exit. All farewell and wake phrases are in section 11.

Called his name during the briefing? The briefing is skipped — Jarvis listens to you right away.
jarvisapp.tech
Jarvis · User Guide04 · Settings

Section 04

Settings

Opened with the gear button in the upper right corner or with ⌘,. Changes apply immediately; the “Done” button simply closes the panel. Settings are shared by both builds.

Graphics and look

Graphics quality, Pick graphics automatically, Frames per second, Render scale and Save the GPU while the brain thinks — section 04.1. Layout for the “Grid” view: arc, grid, spiral. Main screen: orbit, callouts, classic. Folders: around the sphere or as a grid.

Gestures and files

Gesture sensitivity · show hidden files · content previews · mirror the camera.

Brain — who thinks

The most important row: here you choose who answers your requests — the built-in Gemma or an external AI (ChatGPT, Claude, Gemini, DeepSeek, Alice, Claude Code). Next to it — the model, the key field and the “Check” button. Details in section 05. Below: Fine-tuned brain (the adapter for the built-in model), Notice interesting things in what is open, Turn the movie down when I speak.

Parental control and the guide

Parental control — the child’s age and the parent’s password (section 04.2). User guide — four buttons: open this book right inside Jarvis, open the copy on the Desktop, save the PDF anywhere, or open it on the website.

Intro music

Jarvis’s theme, your own file, or off. For your own file — from which second, how long to play, the “Clip” button to listen, music volume.

Name and waking

Answer to names — a comma-separated list, the first one is the main. Answer out loud to the name — “Yes, sir?”. Wake by claps: enable, restart, start at login. Fall asleep after silence — how many seconds after answering Jarvis waits for a command without the name (section 11).

Speech

Address and the “Change…” button (the same wizard). Language of commands and answers. Assistant voice: Karen (main), Karen-2, Serena, Vivian — for Russian and English. Manner of speech: calm, neutral, fast. Liveliness of intonation, pace, pauses between phrases, answer volume and the “Check” button — a test phrase. Audio devices — where the sound goes and where we listen from.

At the bottom of the panel

“Voice commands” — the built-in help. “Download the hand model” — if the hand model is missing.

jarvisapp.tech
Jarvis · User Guide04 · Settings

04.1Graphics: quality, frames and resolution

Jarvis picks the graphics for your computer himself: he looks at the GPU, memory and the monitor’s refresh rate. On a Mac with an Apple processor that is the maximum — 200 % and as many frames as the monitor can show. If the program feels heavy, the graphics can be set by hand.

Settings → graphics. The auto-pick box is ticked, so the fields below show what was chosen and are locked. In the frame — what Jarvis found: the GPU, the monitor’s refresh rate and the result.

The rows in order

Graphics qualityMaximum frame rate · Cinematic (plus depth of field) · Balanced · Performance.
Pick automaticallyOn by default. While the box is ticked, Jarvis decides himself; untick it to choose by hand.
Frames per secondAuto — same as the monitor · 30 · 60 · 120. More frames — smoother, but a higher load on the GPU.
Render scaleThis is the graphics resolution. 100 % — the lightest · 150 % · 200 % — Retina, the sharpest. The window is always full screen anyway.
Save the GPU while the brain thinksWhile the brain prepares an answer, the scene runs at 30 frames: the answer comes sooner. The screen does not freeze.

How Jarvis picks by himself

ComputerQualityScaleFrames
Mac with an Apple processor (M1 and newer)Maximum frame rate200 %same as the monitor — 60 or 120
Discrete graphics cardBalancedby the screen60
Integrated Intel graphics and othersPerformance100 %60

What to choose if it stutters

  1. Untick “Pick graphics automatically”.
  2. Frames per second — 60. Almost as smooth to the eye, and the GPU load is noticeably lower.
  3. Render scale — 150 %. The picture is a touch softer, but lighter. 100 % is the lightest option for older Macs.
  4. Quality — “Balanced” or “Performance” if that did not help.
Changes show at once. No need to restart Jarvis. The load is easy to watch in the “Load” widget on the main screen: the CPU, video and RAM rings.
To restore the defaults — tick “Pick graphics automatically” again. The manual values are kept and come back if you untick it later.
jarvisapp.tech
Jarvis · User Guide04 · Settings

04.2Parental control

If a child uses the computer, turn on parental control. Jarvis will stop opening websites and carrying out requests that are not right for the age, and web search becomes safe. Turning the control off or changing the age takes the parent’s password.

Settings → “Parental control”. The age, the on/off box, the parent’s password and the “Apply” button. Below — what is on right now.

How to turn it on

  1. Open the settings (⌘,) and find the row “Parental control — a child at the computer”.
  2. Choose the age: 6+, 12+ or 16+, and tick the box.
  3. The first time the field is called “Make up a parent password”: enter a password of at least 4 characters.
  4. Press “Apply”. The line “Parental control is on: 12+” appears.

What is closed for each age

Topic6+12+16+
Adult content, gambling and bettingclosedclosedclosed
Drugs, weapons, gore, darknetclosedclosedclosed
Dating sitesclosedclosedopen
Safe search (Yandex, Google, Bing) and YouTube restricted modealways on while the control is on

What it looks like

  • In the built-in browser a closed site does not open: instead there is a notice “closed by parental control”.
  • To a spoken request to find or open such a thing Jarvis replies: “This is closed by parental control” — and names the topic.
  • Other browsers Jarvis will not launch on request, so the control cannot be bypassed through him.
  • Movie and file names are checked by explicit words; Jarvis does not know the age rating of the movie itself.

Change the age or turn it off

Choose another age or untick the box, enter the parent’s password and press “Apply”. Without the password the changes are not saved: “The parent password did not match”. The password is stored on the Mac only in encrypted form.

This controls what Jarvis does, not the whole Mac. A child can open Safari or another program by themselves, bypassing Jarvis. To restrict the whole computer, also turn on “Screen Time” in macOS System Settings.
jarvisapp.tech
Jarvis · User Guide05 · The brain and external AI models

Section 05

The brain and external AI models

The brain decides what to do with your request: open a folder, find a file, read a letter, answer. By default the built-in Gemma does the thinking. Instead of it you can connect ChatGPT, Claude, Gemini, DeepSeek, Alice or Claude Code. Whoever thinks — Jarvis does everything himself, and the confirmation rules do not change.

Connecting an external brain — step by step

  1. Get a key on the website of the chosen model (where exactly — the table on the next page). The key is a long string of letters and digits. Copy it whole.
  2. Open the settings (⌘,) and in the row “Brain — who thinks” pick the model from the list. Until there is a key, the name is marked “needs a key”, and the built-in one keeps thinking.
  3. In the “Model” row pick a variant: “smarter” or “faster”. The default one is fine to start with.
  4. Paste the key into the “Key …” field and press “Save”. The field clears and shows “saved ✓”.
  5. Press “Check”. Jarvis asks the model a short question and shows whether it answered and in how many seconds. If all is well, he says: “Working with Claude, sir”.
  6. Press “Done”. From now on the external model thinks. The built-in one is unloaded from memory and frees about 13 GB.

The “Brain” rows in the settings after choosing Claude: the list of brains and the “Check” button, the model, the key field with the “Save” button and a hint where to get the key.

To go back to the built-in brain — pick “Built-in — Gemma on this Mac” in the same list. The first answer after the switch takes longer: the model is loading again.

How it feels in use

Built-in — Gemma

No internet, free

Fine-tuned on thousands of real Jarvis commands (the “Fine-tuned brain” switch). Thinks for 1.5–5 seconds. In the main build it is Gemma 26B, in the light one — Gemma 12B.

External — ChatGPT, Claude and others

Smarter in long reasoning

A step takes 7–9 seconds, needs the internet and is billed by the model’s tariff. For everyday commands — folders, movies, volume — there is no difference: short phrases run without the brain at all.

What goes to the external model. The text of your request, a brief description of what is open on the screen, and the excerpts from documents or letters needed for the answer. Speech recognition and the voice stay on the Mac; whole files are never sent. The key is stored encrypted in the macOS Keychain and is never shown back — to replace it, just paste a new one.
jarvisapp.tech
Jarvis · User Guide05 · The brain and external AI models

05.1Where to get a key and which model to choose

BrainWhere to get the keyModels in the listBilling
Claude
Anthropic
console.anthropic.com → sign in → API Keys → “Create Key” → copy.Opus 5.5 — smarter · Sonnet 5.5 — faster · Haiku 4.5 — the fastestBy request volume; the card is linked on the Anthropic website.
Claude CodeNo key needed: works under your Claude Code sign-in on this Mac. If the list says “sign in needed” — in Terminal run claude, enter /login, then “Check”.Sonnet (default) · Opus · HaikuIncluded in the Claude subscription.
ChatGPT
OpenAI
platform.openai.com → API keys → “Create new secret key”.GPT-5 · GPT-5 mini — fasterSeparate from the ChatGPT Plus subscription: it does not cover keys.
Gemini
Google
aistudio.google.com → Get API key.Gemini 2.5 Pro · Gemini 2.5 Flash — fasterThere is a free tier.
DeepSeekplatform.deepseek.com → API keys.DeepSeek V3 · DeepSeek R1 — reasons longerCheaper than the rest.
Alice
YandexGPT
Yandex Cloud console → service account → API key. Besides the key you need the folder ID (starts with b1g…) — the settings have a “Yandex Cloud folder” row for it.YandexGPT Pro · YandexGPT Lite — fasterBy Yandex Cloud tariffs.

If something went wrong

What Jarvis showsWhat it means and what to do
“… — needs a key” in the listThe key is not saved yet. Paste it into the field and press “Save”.
“… not connected yet — the built-in one thinks”The choice is remembered, but there is no key. It starts working as soon as you paste the key.
“The key did not match”The key was not copied whole or was revoked on the website. Create a new one and paste it again.
“… is not responding right now”No internet, the limit or the balance ran out. Check the “Network” widget and your account on the model’s website.
“Claude Code: sign in needed”Terminal → claude → /login → “Check” in the settings.
“The built-in model is not installed”The model files were not found — reinstall Jarvis from the disk image.
Only the built-in model is affected by the switch “Fine-tuned brain — the adapter trained on Jarvis commands”: external ones do not need it. Everything else — reading documents, notes, mail, movies — works the same with any brain.
Tip. Start with the built-in Gemma: it is free and needs no network. Connect an external brain when you need long reasoning or your Mac’s memory is taken by browsers — with an external brain Jarvis is 13 GB lighter.
jarvisapp.tech
Jarvis · User Guide06 · The main screen

Section 06

The main screen

In the centre — the golden sphere with the clock. Around it, widgets drift slowly along a tilted orbit, and along the inner one — the icons of programs running in the background. Everything is alive: the sphere pulses when Jarvis speaks, the far half of the orbit passes behind the sphere.

1 2 3 4 5 6 7 8 9 10 11 12
1The sphere and the clock. The time, under it — the day of the week and the date. The sphere is a living hologram of golden streams.
2Indicators: Hearing · Brain · Voice · Network. A blue dot — all is well, grey — off, red — an error.
3Places. Home, Desktop, Documents, Downloads, Pictures, Music, Movies, Applications. A click opens the folder.
4System. Battery, free disk space, how much memory Jarvis takes and the swap.
5Devices. The Bluetooth headset with its charge, where the sound goes, external drives.
6Load. The input language, the microphone state and three rings: CPU, GPU, memory.
7Mail. The latest letters from the Mail app and the unread count. Read only.
8Network. Whether there is internet and through what: the weather, the browser and the external brain depend on it.
9Weather. Temperature around the clock, feels like, wind, humidity and a hint for the evening.
10Background programs. Hologram icons on the inner orbit: Safari, Mail, Messages… They turn gold under the pointer.
11Navigation. Back, forward, up and the name of the current place — “Main screen” or the folder name.
12Filter and buttons. Search by name (⌘F), new folder (⌘N), microphone (V), gestures (G), settings (⌘,).
jarvisapp.tech
Jarvis · User Guide06 · The main screen

06.1The widgets up close

Weather. The city is detected automatically; ask for another by voice: weather in Kazan tomorrow. Updated from Open-Meteo; if the network fails, it retries after 20 seconds, 1 and 2 minutes.

Mail. Letters come from the Mail app. A click on a letter opens it in a window inside Jarvis; if Mail is closed, iCloud Mail opens instead. Ask: what is in the letter from accounting?

Load. RU/EN — the input language. Next to it — the microphone state: “speaking”, “listening”, “mic off”. Rings: CPU, video, RAM. Spikes to 100% at the moment of an answer are normal.

System. Battery charge, free disk space, memory taken by Jarvis, and the swap. If the swap grows — close heavy programs, switch to the 12B build or to an external brain.

Network. A green dot — the internet is there. Files, hearing, voice and the built-in brain work without a network too.

Devices. Connected Bluetooth devices with their charge, the current audio output, external drives. By voice: send the sound to the headphones.

Places. Quick access to the main folders. The same by voice: open documents, and back: main screen or ⌘D.

Buttons at the top. Filter by name, new folder, microphone (lit while Jarvis listens), gestures in front of the camera, settings.

Three views of the main screen

Chosen in the settings, the “Main screen” row. Orbit — the widgets revolve around the sphere (default). Callouts — panels at the sides with golden lines from the sphere. Classic — panels in the corners. The colours are the same everywhere: gold — the frame and the essentials, blue — all is well, red — errors.

jarvisapp.tech
Jarvis · User Guide07 · Folders

Section 07

Folders

A folder opens full screen: its core in the centre, the contents drifting around it along the orbit, and a golden lead running from the ring to every item. To enter a folder: say open downloads, click a place, or double-click a folder. To go back: main screen, the “Home” button or ⌘D.

1 2 3 4 5 6 7 8 9 10 11
1The path. “Home › Downloads”. A click on any link goes there; the arrows — back, forward, up.
2The folder name and its path on disk.
3Summary: how many items, the total size, how many are new today, the largest file. The strip on the right — what appeared over 30 days.
4Breakdown by type: photos, video, archives, folders, spreadsheets… A click on a type keeps only that type.
5“Grid” — switch to the ordinary grid of cards (the “Arc”, “Grid” or “Spiral” layout from the settings).
6The folder core: the name and the number of items. For nested folders the core shows the breakdown arcs and the size.
7A file card: an icon or a preview, the name, size and type. The card comes alive under the pointer.
8The details panel of the selected item: type, size, when modified, what is inside.
9“Open folder” and “Show in Finder”.
10The status line: how many items, folders, what is selected and the frame rate.
11The voice panel: what Jarvis heard and what he answered (section 10).
jarvisapp.tech
Jarvis · User Guide08 · Files

Section 08

Files

The cards behave like in Finder, only prettier. Everything can be done with the mouse, the keyboard or by voice — the result is the same. The simplest way is to tell Jarvis what you need.

A document. The real macOS icon, name, size, type.

Photos and video are shown with a preview of the contents.

A folder: a ring with the item count. Turns gold when you drag onto it.

What you can do

ActionWith the mouse and keysBy voice
SelectClick; ⌘ — add, ⇧ — a range; ⌘A — allselect all pictures · select donald
OpenDouble click or Enteropen the report · open the note in a text editor
Move or copyDrag onto a folder or a place; while dragging ⌥ — copy, ⌘ — movemove this to the desktop · copy the note to archive
Rename · new folder⌘R · ⌘Nrename the note to important · create a folder reports
Compress · unpack · pathRight button — the context menucompress this · unpack the archive · copy the path
To the Trash⌘⌫delete this — only after your “yes”
Find by name⌘F — the filter in the current folderfind the contract on the computer — across the whole Mac
If there are several programs, Jarvis asks which one to open with and remembers the answer for that file type. Photos, video, PDF and text open in a window inside Jarvis (next page).
Smart little things. If a name is taken, the copy gets the name “file copy.txt”. A folder cannot be put inside itself. The progress bar counts bytes, not the number of files.
jarvisapp.tech
Jarvis · User Guide08 · Files

08.1Viewing and hologram windows

Photos, video, music, PDF and text open right here — in a window with a hologram frame. The main window stands in the centre, the others wait as thumbnails along the edges; a click on a thumbnail’s title brings it back to the centre. Windows never overlap and never slide off the screen.

A viewing window. Upper left — the type and name of the file, on the right — minimise, maximise, close. On the main screen one window fits between the widgets, and only the clock hides behind it.

What opens inside

  • Photos — at full size.
  • Video and music — the built-in player with seeking, pause and full screen (section 14).
  • PDF — the built-in viewer.
  • Text — notes, .md, .txt.
  • Letters, web pages, WhatsApp and Telegram — in windows too (section 15).

Window commands

close the windowthe current one
close all windowsall at once
minimise · maximiseor Esc — minimise
biggerenlarge the window
show it hereopen the selected item in a window
show the placesslide out the side panel
Esc minimises, it does not close. One accidental key press should not cost you a movie. To bring the window back — click its thumbnail at the bottom.
jarvisapp.tech
Jarvis · User Guide09 · Mouse, trackpad and keyboard

Section 09

Mouse, trackpad and keyboard

Mouse and trackpad

ActionWhat it does
Hoverthe card comes alive: light runs along the outline, a glint across the preview
Click · double clickselect · open
Dragmove onto a folder, into a place on the left or onto a path link at the top
Wheel · two fingersscroll the rows
Two fingers sideways · pinch on the trackpadrotate the scene · zoom in and out (in the “Grid” view)
Right buttonthe context menu

Keyboard

Moving around
← → ↑ ↓between cards; with ⇧ — select
Enter · ⌘↓open
Spacelook up close
⌫ · ⌘↑one level up
⌘[ · ⌘]back · forward
⌘Dthe main screen and back to the folder
Home · Endto the start · to the end
PgUp · PgDnpage by rows
Files
⌘C ⌘X ⌘Vcopy · cut · paste
⌘A · Escselect all · clear the selection
⌘N · ⌘Rnew folder · rename
⌘⌫to the Trash
⌘Ffilter by name
Assistant and view
Vmicrophone: listen / do not listen
Ggestures in front of the camera
Bthe built-in browser
Hhide and show the side panel
1 2 3arc · grid · spiral
0return the camera to the start position
Escminimise the hologram window
⌘,settings
⌘Qquit Jarvis
On the main screen the file keys do nothing — there are no cards there, and ⌘⌫ will not send to the Trash what you cannot see. Enter a folder, and everything turns on.
jarvisapp.tech
Jarvis · User Guide10 · Voice

Section 10

How to talk to Jarvis

Speak as you would to a person. One sentence — what to find, where to look and what to do with it. If several options fit, Jarvis does not guess — he asks.

The name rule

A command starts with the name: Jarvis, open downloads. Without the name Jarvis does not react — so a movie soundtrack and other people’s conversations never become commands. The name alone, without a command, gets a short “Yes, sir?”, and he keeps listening.

After a command is done Jarvis listens for another 10 seconds without the name: “Done, sir. Any further instructions?”. Small things — volume, pause, minimise — he does silently. How he wakes and falls asleep — section 11.

Interrupting

While Jarvis is speaking, say Jarvis, stop, enough, not that or let me clarify, I need… — he falls silent and listens. Just to cut the answer short: quiet.

If several were found

Jarvis shows a numbered list and asks. Answer the first, number three, the last, name the file (february), say all or cancel. You can also click the options with the mouse.

Numbers and names

Names can be said in your language even if the file is written differently: “donald” finds donald_face.png. Numbers are understood as words: “version fifteen” → v15. Formats — by ear: “pdf”, “word”, “excel”, “jpeg”.

Anything risky — only after a “yes”. Before copying, moving and deleting Jarvis says what and where, and waits for your “yes”. “No” cancels. While he is answering, the microphone is closed for him, so he does not hear his own voice.

The voice panel

Listening — the microphone is open. On the right — the sound level and a cross that closes the panel; V or the microphone button turn hearing off completely.

Command → Thinking → Answering. At the top — what he heard, below — the answer. While the brain searches, you can see what exactly: “Searching the documents…”. Longer than three seconds — he says “Let me look”.

Done — what exactly was done: not just “done”, but “Noted. The note is in Documents, in the Jarvis folder”.

jarvisapp.tech
Jarvis · User Guide11 · Waking and sleep

Section 11

Waking and sleep

Jarvis has three states: closed, waiting for his name, and listening. From closed he is woken by two claps and a phrase, from waiting — by his name, and a farewell closes him.

Jarvis is closed — claps

  1. Clap your hands twice — sharply, one after another. A short silence is needed before the first clap.
  2. A quiet signal sounds — the claps were heard, Jarvis is waiting for the phrase.
  3. Within six seconds say the wake phrase (the list on the right). The long variant triggers on its first words already.
  4. Jarvis opens: the boot screen, intro music, the greeting and the briefing — what came in and what the weather is.

The claps are heard by a small background program, “Jarvis — Wake” (next page). Its microphone only watches the loudness, and the phrase is recognised on the Mac; nothing is recorded or sent anywhere. While Jarvis is open, it lets go of the microphone.

Phrases that wake him after the claps

Wake up, sleepyheadWake up, sleepyhead, we have a lot of workПросыпайся, соня Wake up, JarvisWake up, FridayПросыпайся, Джарвис

Any name from the settings (“Answer to names”) works. “On Friday” is a weekday, not a call. To check whether the program hears the claps, look at the icon in the menu bar: it says “Waiting for ‘Wake up, sleepyhead’”.

Jarvis is open — the name

JarvisJarvis, open downloadsFridayДжарвис

The name alone — “Yes, sir?”, after that the command can be said without the name. The name together with a command — straight to work. How many seconds after answering he waits for a command is set by “Fall asleep after silence” (45 s by default); then he waits for the name again. This is the “sleep” of hearing: the microphone works, but reacts only to the name.

How to stop, put to sleep and close

PhraseWhat happens
quiet · stop · enoughHe falls silent and cuts the answer short. Keeps listening.
stop listening · turn off the microphoneHearing is off completely — he will not even answer to his name until you press V or the microphone button.
Good night, JarvisA short farewell — and the program closes. The name is required, at the start or the end of the phrase. If Jarvis is already listening after “Yes, sir?”, the name is not needed. Polite words do not get in the way: “All right, Jarvis, thanks for the work, good night”. But words about something else break the farewell: “while the music plays”, “good night, kids” — not a command.
Bye, Jarvis · Jarvis, see you soon · see you tomorrow · see you · goodbye
Jarvis, shut down · power off · close down · finish up
Спокойной ночи, Джарвис · Пока, Джарвис · Джарвис, выключайсяThe same in Russian.
After the farewell the “Jarvis — Wake” program keeps listening for claps. In the morning — two claps and “Wake up, sleepyhead”, and Jarvis is back.
jarvisapp.tech
Jarvis · User Guide11 · Waking and sleep

11.1The “Jarvis — Wake” program

Installs itself on the first launch of the built Jarvis: into the user’s Applications folder (visible in Launchpad and Spotlight) and as a shortcut on the Desktop. It starts at login and lives as an icon in the menu bar — Jarvis himself can be closed meanwhile.

The menu bar icon

What is in it

The state (“Waiting for ‘Wake up, sleepyhead’”, “Jarvis is open”, “paused”), Pause — stop listening for a while, Open Jarvis — without claps, Restart, Log and Turn off.

Jarvis settings

The “Wake by claps” row

Next to it — the state: running, off or not installed. The buttons Turn off / Turn on and Restart; the switch “Claps — start at login”.

How to clap so that it works

Intro music, greeting and briefing

07:30

Claps and “Wake up, sleepyhead”

Jarvis opens, the intro music plays: Jarvis’s theme, your own file (in the settings — from which second and for how long) or off. The music yields to the voice: it fades as soon as Jarvis starts speaking.

07:31

Greeting and briefing

A greeting for the time of day, then the briefing: how much is unread in Mail and messengers and what the weather is. “Someone managed to write”, “lots of work” or “a nice day — time to make coffee”. Called by name — the briefing is skipped.

Daytime

Commands by name

Called — “Yes, sir?”. Done — “Done, sir. Any further instructions?” and he listens for another 10 seconds without the name. If you have already answered his question, he does not finish the unsaid part afterwards.

23:30

Farewell

Good night, Jarvis — a short farewell, and the program closes until morning. Without the name these words do nothing: a movie soundtrack will not close the program.

jarvisapp.tech
Jarvis · User Guide12 · Voice commands

Section 12

Voice commands: files and folders

These are examples, not formulas: Jarvis understands natural speech — “where is the contract”, “check whether there are such files there”, “new folder reports”. The full list is always at hand: say what can you do or press “Voice commands” in the settings.

Find and act at once

find the movie Harry Potter on the computer and play it
find the document letter in pdf format and open it
find the report on the mac and move it to downloads
find the contract on the computer and delete it
find donald — only in the current folder

Where to look: “on the computer”, “on the mac”, “everywhere” — across the whole home via Spotlight; without these words — in the current folder. Type: movie, video, photo, document, music, archive, folder, program, spreadsheet, presentation. Format: “in pdf format”, “with the docx extension”.

Open

open downloads · documents · desktop
open the folder archive · go to reports
open the note in a text editor
up · back · forward · refresh
home · main screen

Programs

open the program music
open the program music and play the moonlight sonata
open the movie in QuickTime
close the program mail

Move and copy

copy the note to archive
move this to the desktop
copy all movies to downloads
copy · cut · paste

Change

create a folder reports
rename the note to important
duplicate this · copy the path
compress this · unpack the archive
show in Finder

Delete — to the Trash only

delete this · delete the report
He first says what he is deleting and asks. Does it only after your “yes”.

Selection and order

select all pictures · select donald
select all · clear the selection
sort by size · by date · by name · by type
show only video · show everything
show hidden files · hide hidden files

View and details

grid · arc · spiral · zoom in · centre
how many files are in this folder · where am I
what is here · the size of this
jarvisapp.tech
Jarvis · User Guide12 · Voice commands

12.1Windows, sound, movies, documents and the internet

Windows and the screen

close the window · close all windows
minimise · maximise · bigger
show it here · show the places
go back to the main screen

Sound and volume

turn it up · quieter · volume 40 percent
mute the sound · unmute
send the sound to the headphones · to the speakers
turn off the microphone · stop listening

Movies and music

play “Distant Stars” · play the movie The Hobbit
pause · continue · full screen
skip 20 seconds · back · to the 45th minute · from the start
switch to the original · bring back the Russian dub · another audio track
all videos on the computer

Weather

what’s the weather · what about tomorrow · weather in Kazan

Mail and documents

what came in the mail? · what is in the letter from accounting?
what is the total in the renovation estimate? — found in the documents
remember: car inspection on October 14 at 10 am
when is the car inspection? — answered from the note
what is in this document? · what is the article about?

Internet

find a cartoon about a cat on youtube and play it
search the internet for the weather in Moscow
open the site habr.ru · open youtube
open the first one · page back · close the browser
open mail · open WhatsApp · open Telegram

Assistant

what can you do · quiet
turn on gestures · turn off gestures
switch to Russian · переключись на английский
Good night, Jarvis · Bye, Jarvis
Short phrases — instantly. A command of up to seven familiar words (“open downloads”, “turn it up”, “weather”) is carried out by a strict rule in a fraction of a second, without waiting for the brain. Long and unusual requests go to the brain — 1.5–5 seconds on the built-in one and 7–9 on an external one.
Polite words do not get in the way. “Please open the downloads folder for me” is the same as “open downloads”. Questions and turns of phrase are understood too: “where is the contract”, “check whether there are such files there”.
In Russian — word for word. After switch to Russian the same commands work: «найди на компьютере фильм Гарри Поттер и запусти его», «скопируй заметку в архив», «удали это» — and ask for confirmation in the same way.

The built-in help. Opens with the phrase what can you do or the “Voice commands” button in the settings.

jarvisapp.tech
Jarvis · User Guide13 · Second brain

Section 13

Second brain: documents and notes

Ask about the contents without naming the file — Jarvis finds the answer in your documents and tells you where it came from. No answer — he says so and never makes anything up. Works with any brain, built-in or external.

“Jarvis, what is the total in the renovation estimate?” — “By the estimate — 486,000 ₽: materials 212,000, labour 274,000. That is from ‘Renovation estimate.xlsx’.” While he searches, the panel shows: “Searching the documents…”.

How it works

  • Searches the Documents, Desktop and Downloads folders through macOS search — builds no index of its own, uses no memory, answers in a fraction of a second.
  • Reads PDF and scans (recognises the text), Word, RTF, Excel, PowerPoint, web pages and plain text.
  • In a long document finds the most relevant passages — even from the middle of a fifty-page report.
  • Answers strictly by the text and names the source document.

Reads what is open

Opened a letter, a PDF or an article in the browser — ask what is this about? or what does the letter ask for?. If you turn on “Notice interesting things in what is open” in the settings, Jarvis points out the main thing himself whenever you open something — no more than once in 40 seconds and never interrupting you.

“Remember that…”

Say Jarvis, remember: car inspection on October 14 at 10 am.

  • A note appears in the folder Documents › Jarvis › Notes — an ordinary text file with the date in its name. It is visible in Finder; old notes are never overwritten.
  • A week later ask when is the car inspection? — Jarvis answers from the note.
  • Notes can be opened and edited like any file.
jarvisapp.tech
Jarvis · User Guide14 · Movies and sound

Section 14

Movies and sound

Movies play in the built-in player, in a window inside Jarvis. It handles sound that ordinary players stay silent on, and puts the Russian track first.

“Jarvis, play ‘Distant Stars’.” The movie opened in a window; the panel says “Playing ‘Distant Stars’”. Speak during the movie — the sound goes down so that Jarvis can hear you.

What the player can do

  • Any sound. AC3, E-AC3, DTS and TrueHD — what usually lives in MKV — are decoded inside Jarvis and stay in sync with the picture.
  • Tracks. Russian by default, otherwise the main one. Switch by voice: switch to the original, bring back the Russian dub, put on the Vizgunov translation.
  • Seeking. skip 20 seconds, back (10 seconds), to the 45th minute, from the start. Pause, continue, full screen — by voice or with the player buttons.
  • Titles out loud — by meaning. “Distant Stars”, not “Distant.Stars.2024.1080p.BluRay.x264.mkv”. On screen — the full name.

Volume and ducking

  • turn it up · quieter · volume 40% · mute the sound · unmute.
  • Turn the movie down when I speak — the setting is on by default: as soon as you start speaking the sound goes down, and comes back after the answer.
  • Sound on Bluetooth headphones? Jarvis listens to you through their microphone.

If it did not play

A rare format that could not be read — Jarvis offers to open it in IINA or VLC: “‘…’ does not play here. Play it in IINA?”. Answer “yes”. To open in an external player right away: open the movie in IINA.

Protected video (Netflix and the like) does not play inside — it needs a separate player or Safari.
jarvisapp.tech
Jarvis · User Guide15 · Mail, messengers and the internet

Section 15

Mail, messengers and the internet

The “Mail” widget. The latest letters from the Mail app; in the right corner — how many are unread.

Mail

Jarvis reads letters from the Mail app — read only, he never sends or deletes anything. Ask what came in the mail? or what is in the letter from accounting? — he reads it and points out the main thing: “They ask you to sign the act by Friday”. A click on a letter in the widget opens it in a window; if Mail is closed — iCloud Mail opens inside Jarvis.

The briefing after the greeting

Unread items are counted by the badge numbers in the Dock: Mail, Messages, Telegram, WhatsApp, Viber, Slack and other running programs. The contents are not read and no permissions are needed.

Messengers

iCloud Mail, WhatsApp and Telegram open in windows inside Jarvis — these are their web versions, the sign-in is kept between launches: open WhatsApp. SMS and iMessage have no web version, so open messages launches the Messages app.

The built-in browser

The B key or by voice. The page opens inside Jarvis, in a holographic frame. Site names are understood in any form: “on youtube”, “on vk”, “in wikipedia”.

PhraseWhat happens
find a cartoon about a cat on youtube and play itsearch and play the first result
find a concert on vksearch on the site
search the internet for the weather in Moscowweb search
open the site habr.rugo to the address
open the first one · pause · full screenplayback control
page back · close the browsernavigation
Sites Jarvis knows by name

YouTube, VK, VK Video, RuTube, Wikipedia, Yandex, Google, DuckDuckGo and Maps. Any other — by address: “open the site …”.

The browser lives in a separate session. The file window is cut off from the network, and the internet is only where you asked for it. Video on websites plays; protected video (Netflix) does not.
jarvisapp.tech
Jarvis · User Guide16 · Gestures in front of the camera

Section 16

Gestures in front of the camera

Files can be handled by hand: the camera sees your hand and the cursor repeats its movements. Turn it on with the G key, the palm button at the top or the phrase turn on gestures. The first time, macOS asks for camera permission.

GestureAction
✋ Open palmmove the cursor — it follows the tip of the index finger
👌 Pinchgrab an item; a pinch on empty space and a drag — rotate the scene
Release the pinchput it down; over a folder — move it inside
☝︎ Point and hold for 0.85 sopen
✌︎ Two fingerstoggle between copy and move
👍 Thumb upconfirm
✊ Fist, hold for 0.5 sclear the selection
✋ A sharp move to the leftone level up
Two hands pinched, move apartzoom in and out

Tips

  • The mouse always wins. Move the mouse — control returns to it; let it rest — the hand works again.
  • Sensitivity in the settings: how small a hand movement crosses the whole screen.
  • Mirror the camera — if the movements feel “backwards”.
  • Even light on the hand and a plain background help a lot.

The iPhone camera

An iPhone near the Mac appears in the list as an ordinary camera (Continuity Camera) and is offered first. If the iPhone is asleep or far away — pick the built-in camera in the drop-down list on the gesture panel.

The hand model

Recognition of 21 hand points runs on the Mac, without a network. If the model file is missing, a simplified tracker works — the cursor and grabbing without individual fingers; the full version comes back with the “Download the hand model” button in the settings (about 7 MB, once).

jarvisapp.tech
Jarvis · User Guide17 · Safety and privacy

Section 17

Safety and privacy

Jarvis does a lot, but nothing behind your back.

Files

Only after a “yes”

Copying, moving, renaming and deleting — only with your consent. Jarvis first says what and where, then waits for the answer. “No” cancels.

Trash

No permanent deletion

“Delete” always means “to the Trash” — through the macOS system mechanism. Anything deleted can be brought back from the Trash.

Hearing and voice

On your computer

Speech is recognised and synthesised on the Mac. Recordings go nowhere. While Jarvis speaks, his own voice is marked as echo and does not count as a command.

Files

Cut off from the network

The file window physically cannot reach the internet. The browser works in a separate session and goes online only where you asked.

What goes to the internet

WhatWhere and why
WeatherThe city name — to the Open-Meteo service. Without a network the widget is simply empty.
The built-in browserOnly the pages you opened yourself or asked to find.
An external brainOnly if you chose it: the text of the request and the excerpts from documents or letters needed for the answer. The built-in Gemma sends nothing.
Safe searchWith parental control on, family mode is added to Yandex, Google and Bing queries, and YouTube gets restricted mode.
Mail and messengersThe windows with web versions go to their own sites, like an ordinary browser. The mail widget reads letters from the Mail app locally.
External brain keys are stored encrypted in the macOS Keychain and are never shown back, even in the settings.
Logs in the Library/Logs/Jarvis folder help with troubleshooting and contain no phrases of yours — only events.
jarvisapp.tech
Jarvis · User Guide18 · If something is wrong

Section 18

If something is wrong

What happenedWhat to do
Does not open after installationRight-click the icon → “Open” → “Open”. Needed once: the app is signed locally.
Does not react to the nameLook at the “Hearing” indicator under the clock and the line in the “Load” widget: if it says “mic off” — press V. Check the permissions: System Settings → Privacy & Security → Microphone and Speech Recognition. After an update they are asked again. Sound on Bluetooth headphones — Jarvis listens through their microphone, speak into them.
Takes a movie for a commandThis should not happen: commands are by name only. Make sure “Turn the movie down when I speak” is on, and say the name clearly, in a pause.
The external brain does not answerSettings → “Brain — who thinks” → “Check”. The notes “needs a key”, “the key did not match”, “not responding right now”, “sign in needed” are explained in section 05.1.
Everything is slow, the GPU is loadedSettings → untick “Pick graphics automatically” → 60 frames and 150 % scale (section 04.1). To restore — tick the box again.
A site says “closed by parental control”Parental control for a child is on. Change the age or turn it off — in the settings, with the parent’s password (section 04.2).
The answer is on screen, but there is no voiceThe voice ran out of memory at the peak. Jarvis repeats the phrase himself after the memory is freed; a short warning appears on screen. Close heavy programs, switch to the 12B build or to an external brain.
Thinks for a long timeShort requests run instantly, long ones go to the brain (1.5–5 s on the built-in one, 7–9 s on external ones). The first answer after changing the voice or the brain takes longer — that is a one-off.
Video without sound or not playingSay play it in IINA or open in VLC. Protected video (Netflix) does not play inside.
The weather is emptyNo internet — the “Network” widget shows it. Jarvis retries after 20 seconds, 1 and 2 minutes.
Gestures do not workCamera permission: System Settings → Privacy → Camera. The hand model is needed — “Download the hand model” in the settings. Do not move the mouse: it takes over control.
Claps do not wake himThe “Jarvis — Wake” icon in the menu bar shows the state; in the settings — “Restart”. Clap sharply, twice, with a pause of silence before the first clap; say the phrase within six seconds after the signal (section 11).
Both builds are installed, but only one startsBy design: the settings are shared, they do not run together. Close one, open the other.
Where the logs areThe Library/Logs/Jarvis folder in your home folder: jarvis.log, voice-worker.log, ear-worker.log. Your phrases are not there.
The fastest way to check that all is well: say Jarvis. The reply “Yes, sir?” means hearing, brain and voice are in place.
jarvisapp.tech
Jarvis · User GuideCheat sheet

On one page

Cheat sheet

Wake up, sleepyhead

After two claps, when Jarvis is closed.

Jarvis

The reply “Yes, sir?” — and he listens.

Jarvis, open downloads

The folder full screen. Back: “main screen” or ⌘D.

find the contract on the computer and open it

Searches the whole Mac; with several matches — asks.

move this to the desktop

Says what and where, and waits for your “yes”.

delete the report

To the Trash only, and only after a “yes”.

play “Distant Stars”

The movie in the built-in player, the Russian track first.

turn it up · pause · full screen

Small things are done silently.

what is the total in the renovation estimate?

An answer from your documents with the source named.

remember: car inspection on October 14

A note in Documents › Jarvis › Notes.

what is in the letter from accounting?

Reads it and points out the main thing.

Good night, Jarvis

Says goodbye and closes. Also “Bye, Jarvis”, “see you soon”, “shut down”.

Keys worth remembering

V listen · G gestures · B browser · ⌘D main screen · ⌘, settings
Enter open · Space look up close · ⌘⌫ to the Trash · Esc minimise the window · ⌘Q quit

An external brain in a minute

⌘, → “Brain — who thinks” → choose ChatGPT, Claude, Gemini, DeepSeek or Alice → paste the key from the model’s website → “Save” → “Check” → “Done”. Back to the built-in one — in the same list. Details — section 05.

Jarvis is an independent project, developed on voluntary contributions. Versions for iPhone, Android and Windows are in the works.
Project website: jarvisapp.tech
jarvisapp.tech