sumitaich1998/jarvisvr

task-decomposition

Break a user goal into a small DAG of independent sub-tasks and decide which specialist should own each. Use when a request bundles multiple intents (e.g. "what's this AND the weather AND start a timer").

원문 언어: 영어

identify-object

Identify a real-world object the user is looking at or asking about, using the latest passthrough vision frame and gaze. Use for "what is this?", naming objects on a desk, or labeling things in the room.

원문 언어: 영어

web-research

Look up current information on the web (weather, facts, news, prices) and summarize it. Use for "search for…", "what's the weather", "look up…", or any knowledge question. May delegate per-source summarization to sub-agents.

원문 언어: 영어

caption-conversation

Show live, rolling captions of speech Jarvis hears — for accessibility, noisy rooms, or meetings — with optional translation. Use for "caption this", "turn on subtitles", "caption what they're saying", or "subtitle this meeting". Triggers: caption, captions,…

원문 언어: 영어

draft-message

Draft a message, email, or reply in the user's voice and show it for review before anything is sent. Use for "text Sarah that I'm running late", "draft an email to the team", "reply saying yes", or composing a note to someone. Triggers: text, message, email,…

원문 언어: 영어

live-translate

Translate a live two-way conversation between two languages in real time, showing both sides on a translator panel. Use for "translate this conversation", "help me talk to them in Spanish", or interpreting back-and-forth speech. Triggers: translate…

원문 언어: 영어

control-media-playback

Play, pause, seek, and adjust audio or video, and react to transport controls. Use for "play some music", "pause", "skip ahead 30 seconds", "turn it up", or "play that video". Triggers: play, pause, resume, stop, skip, seek, rewind, volume, louder, quieter,…

원문 언어: 영어

create-image

Generate images from a text prompt and display them with prompt, status, and progress. Use for "make an image of…", "generate a picture of…", "imagine…", or visualizing a concept/mood. Triggers: generate image, make a picture, draw, imagine, create art,…

원문 언어: 영어

set-soundscape

Play looping ambient soundscapes for focus, relaxation, or sleep — rain, café, forest, white noise — with an optional audio-reactive visualizer. Use for "play some rain sounds", "café ambience", "white noise to focus", or "ocean waves to sleep". Triggers:…

원문 언어: 영어

measure-space

Measure real-world distances, spans, areas, or angles between points in the room and show a measuring tape. Use for "how far is that?", "how wide is this desk?", "measure the wall", or "what's the distance between these?". Triggers: measure, how far, how…

원문 언어: 영어

remember-location

Save a named place (parking spot, hotel, "home", a room) and recall or navigate back to it later. Use for "remember where I parked", "save this as home", "take me back to my seat", or pinning a spot to return to. Triggers: remember where I parked, save this…

원문 언어: 영어

show-map

Show an interactive 3D map centered on a place, with markers, or a volumetric globe for world-scale views. Use for "show me a map of…", "where is…?", "put Tokyo on a map", or plotting multiple locations. Triggers: map, show me where, on a map, location of,…

원문 언어: 영어

wayfind

Give wayfinding directions to a destination and show a navigation arrow with distance and ETA. Use for "take me to…", "how do I get to…?", "directions to the kitchen", or guiding to a saved place or calendar event location. Triggers: take me to, directions,…

원문 언어: 영어

agent-routing

Route a single sub-task to the best specialist agent (or sub-agent) by matching it against the JarvisVR roster's roles, skill descriptions, and tool sets. Use after task-decomposition for each node, or directly for a one-shot request that clearly belongs to…

원문 언어: 영어

clarify-intent

Ask one targeted clarifying question only when a goal is genuinely ambiguous AND that ambiguity blocks planning or routing. Use before task-decomposition when a request is under-specified (missing city, which device, which timer) or could map to very…

원문 언어: 영어

result-synthesis

Merge the specialists' results into one coherent spoken reply and coordinate the final spatial layout, closing out a multi-agent turn. Use after the team's sub-tasks finish (or partially fail) to produce a single agent.speech{final} and hand compositing to…

원문 언어: 영어

task-decomposition

Break a user's goal into a small DAG of sub-tasks for the JarvisVR specialist team, then emit it as an orchestration.plan. Use whenever a request needs more than one capability or agent, e.g. "what's on my desk and the weather in Tokyo, and start a 5-minute…

원문 언어: 영어

describe-surroundings

Describe the user's surroundings from the passthrough camera — the main objects and layout of the space — and label a few of them in place. Use for "what's around me?", "describe this room", "what's on my desk?", scene overviews, or accessibility narration.…

원문 언어: 영어

identify-object

Identify a real-world object the user is looking at or pointing to, using the latest passthrough vision frame and gaze, then label it in place. Use for "what is this?", "what am I holding?", naming an object on a surface, or labeling a single thing in the…

원문 언어: 영어

locate-remembered-object

Remember where an object is, and later recall its last-seen location with a marker and a navigation arrow. Use for "remember where my keys are", "where did I leave my phone?", "where are my glasses?", or pinning a spot for later. Triggers: where did I leave,…

원문 언어: 영어

read-and-translate-sign

Read text visible in the passthrough camera (a sign, menu, label, or document) and optionally translate it into the user's language. Use for "read this", "what does this say", "translate this sign/menu", or OCR of something in view. Triggers: read this, what…

원문 언어: 영어

capture-note

Quickly capture a note to long-term memory and show it back, or pin a sticky note in space. Use for "note that…", "take a note", "remember that…", "what are my notes?", or jotting an idea hands-free. Triggers: note, take a note, jot down, remember that, save…

원문 언어: 영어

manage-calendar

Show the user's schedule and answer agenda questions — today's events, what's next, free time. Use for "what's on my calendar?", "what's my next meeting?", "am I free at 3?", or a daily briefing's agenda section. Triggers: calendar, agenda, schedule, my day,…

원문 언어: 영어

manage-tasks

Maintain a checkable to-do list — add, complete, reprioritize, and review tasks — as an interactive hologram. Use for "add a task", "what's on my list?", "mark X done", "show my to-dos", or planning the day. Triggers: task, to-do, todo, add to my list, mark…

원문 언어: 영어

manage-timers

Start, stop, and run countdown timers and Pomodoro focus sessions, and react to the user's timer controls. Use for "set a 5-minute timer", "cancel the timer", "start a pomodoro", egg timers, focus sessions, and pause/resume/reset taps. Triggers: timer,…

원문 언어: 영어

set-reminders

Set time- or context-based reminders and surface them when due. Use for "remind me to…", "at 6pm remind me…", "in 20 minutes remind me…", or "when I get home, remind me…". Triggers: remind me, reminder, don't let me forget, at <time>, in <duration>, when I…

원문 언어: 영어

market-briefing

Give a quick markets briefing — quotes for a watchlist and an optional trend chart. Use for "how are my stocks?", "price of AAPL", "market briefing", or a morning summary's finance section. Triggers: stocks, markets, ticker, quote, price of, my watchlist,…

원문 언어: 영어

news-digest

Pull current headlines (optionally about a topic) and present a scrollable news feed with short summaries. Use for "what's the news?", "headlines about AI", "catch me up on…", or a morning briefing's news section. Triggers: news, headlines, what's happening,…

원문 언어: 영어

summarize-source

Condense a single source — a URL, article, document, or pasted text — into key points the user can read at a glance. Use for "summarize this", "TL;DR", "give me the key points", or as a summarizer sub-agent merging one of several sources. Triggers: summarize,…

원문 언어: 영어

web-research

Look something up on the web and present a sourced answer, optionally opening the top result in a spatial browser. Use for factual questions, definitions, how-to lookups, comparisons, and "search for…/look up…/find information on…". Triggers: search, look up,…

원문 언어: 영어

control-lighting

Control smart lights — on/off, brightness, and grouping by room — via a smart home panel. Use for "turn on the lights", "dim the living room to 30%", "lights off", or "warm up the bedroom lights". Triggers: lights, lamp, brightness, dim, brighten, turn on/off…

원문 언어: 영어

manage-climate

Adjust thermostats and climate — set temperature, raise/lower, and manage blinds for passive cooling — via a smart home panel. Use for "set it to 21", "make it warmer", "what's the thermostat at?", or "close the blinds". Triggers: temperature, thermostat,…

원문 언어: 영어

run-home-scene

Apply a named multi-device scene that sets several devices at once (lights, climate, blinds, locks) to a mood or routine. Use for "movie night", "good morning", "I'm leaving", "bedtime", or any one-word routine that should change the whole room. Triggers:…

원문 언어: 영어

secure-home

Check and control home security — locks, cameras, and sensors — with explicit confirmation for anything that reduces security. Use for "lock the front door", "is the door locked?", "show the front camera", or "arm the house". Triggers: lock, unlock, door,…

원문 언어: 영어

annotate-reality

Place world-anchored labels, callouts, pins, and boxes onto real objects and locations so information sticks to the physical world. Use for labeling things in the room, pinning a spot, boxing a detected object, or step-by-step "point at the X" guidance.…

원문 언어: 영어

compose-workspace

Arrange multiple holograms into a comfortable spatial layout — anchor, space, and orient them so nothing overlaps or blocks the user. Use when several widgets are on screen, when results from multiple agents need placing, or for "tidy this up", "arrange…

원문 언어: 영어

declutter-space

Tidy the user's space by closing, collapsing, or consolidating holograms that are stale, duplicated, or in the way. Use for "clean this up", "close everything", "too much clutter", "hide these", or auto-tidying before a new layout. Triggers: declutter, clean…

원문 언어: 영어

present-data

Choose the right visualization for a dataset and render it — table, chart, network graph, or globe — then place it well. Use when an agent has structured data to show, for "chart this", "show it as a table", "graph these relationships", or comparisons.…

원문 언어: 영어

configure-llm

View and change the active LLM provider, model, and API key, and hot-swap between providers from the in-headset settings. Use for "switch to GPT-4o", "use a local model", "change the model", "set my API key", or "which model are you?". Triggers: model,…

원문 언어: 영어

manage-privacy

Control perception privacy — camera, microphone/ambient audio, and gaze — and show what's currently being captured. Use for "stop watching", "turn off the camera", "stop listening", "are you recording?", or "what can you see/hear?". Triggers: privacy, stop…

원문 언어: 영어