name	screen-awareness
description	Screen activity monitoring for contextual help. Observes apps, documents, and workflows silently.
metadata	{"author":"fae","version":"1.0"}

Screen Awareness

You are receiving a [PROACTIVE SCREEN OBSERVATION] from the scheduler. Use the screenshot tool to observe.

Observation Protocol

Use screenshot to capture the current screen.
Note: focused app name, document or page title, general activity.
Store as a brief text summary in memory with source: screen_context metadata.
This is an ephemeral context record — it supersedes the previous screen context observation.

Rules

NEVER speak. Screen awareness is purely passive context-building.
Ignore sensitive content: banking apps, password managers, private messages, anything financial or medical. Do not store these observations.
Be concise: Store only what's useful for future context. "User is writing Swift code in Xcode, file: PipelineCoordinator.swift" — not a paragraph.

Contextual Help Detection

If the user appears stuck (same error dialog or problem visible across 3+ consecutive observations), note this for proactive help when they next speak. Do not interrupt unprompted.

Research Opportunities

If a browsable topic is detected (user reading about a technology, researching a subject), note it for potential overnight research.

Más de este repositorio

mismo repositorio

collaborate

saorsa-labs/fae

Collaborate over x0x — contacts, messages, spaces, boards, files, presence, trusted-machine port forwards, and replicated stores. Use for sharing cards, connecting people, or cross-device work.

2026-07-153

capability-discovery

saorsa-labs/fae

Guide for surfacing one relevant Fae capability that the user hasn't set up yet. Warm, specific, one thing at a time.

2026-07-153

self-diagnostic

saorsa-labs/fae

Deep pipeline diagnostic — every model, system specs, audio config, speaker state. Flags missing or broken components. Use for diagnose, debug, or health check.

2026-07-153

training-data-bridge

saorsa-labs/fae

Extract training signals from Fae's memory — SFT examples, DPO correction pairs, engagement scores, and interest-weighted sampling.

2026-07-153

cloud-brain-setup

saorsa-labs/fae

Set up (or turn off) a cloud brain for harder questions via OpenRouter — privacy-first, plain language. Use when the user wants a bigger or smarter brain or mentions the cloud.

2026-07-053

first-launch-onboarding

saorsa-labs/fae

A warm first conversation for someone meeting Fae for the first time — getting to know their name, where they live, and what they care about, showing one thing live, and explaining how to talk to her.

2026-07-053

name	screen-awareness
description	Screen activity monitoring for contextual help. Observes apps, documents, and workflows silently.
metadata	{"author":"fae","version":"1.0"}

Screen Awareness

You are receiving a [PROACTIVE SCREEN OBSERVATION] from the scheduler. Use the screenshot tool to observe.

Observation Protocol

Use screenshot to capture the current screen.
Note: focused app name, document or page title, general activity.
Store as a brief text summary in memory with source: screen_context metadata.
This is an ephemeral context record — it supersedes the previous screen context observation.

Rules

NEVER speak. Screen awareness is purely passive context-building.
Ignore sensitive content: banking apps, password managers, private messages, anything financial or medical. Do not store these observations.
Be concise: Store only what's useful for future context. "User is writing Swift code in Xcode, file: PipelineCoordinator.swift" — not a paragraph.

Contextual Help Detection

If the user appears stuck (same error dialog or problem visible across 3+ consecutive observations), note this for proactive help when they next speak. Do not interrupt unprompted.

Research Opportunities

If a browsable topic is detected (user reading about a technology, researching a subject), note it for potential overnight research.