realtime

Stars10

Forks3

UpdatedApril 9, 2026 at 09:49

Skill for the Realtime area of tone. 194 symbols across 26 files.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Source

tonehq

tonehq/tone

View GitHub Repository View Creator Repositories

Download

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	realtime
description	Skill for the Realtime area of tone. 194 symbols across 26 files.

Realtime

194 symbols | 26 files | Cohesion: 71%

When to Use

Working with code in pipecat/
Understanding how process_frame, function_call_result_callback, push_interruption_task_frame_and_wait work
Modifying realtime-related functionality

Key Files

File	Symbols
`pipecat/src/pipecat/services/openai/realtime/events.py`	ServerEvent, SessionCreatedEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemAdded (+42)
`pipecat/src/pipecat/services/openai/realtime/llm.py`	_calculate_audio_duration_ms, _truncate_current_audio_response, _handle_evt_speech_started, stop, cancel (+30)
`pipecat/src/pipecat/services/grok/realtime/events.py`	ServerEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemAdded, ConversationItemInputAudioTranscriptionCompleted (+29)
`pipecat/src/pipecat/services/grok/realtime/llm.py`	_truncate_current_audio_response, _handle_evt_speech_started, stop, cancel, _disconnect (+23)
`pipecat/src/pipecat/services/openai_realtime_beta/openai.py`	_calculate_audio_duration_ms, _truncate_current_audio_response, _handle_evt_speech_started, retrieve_conversation_item, init (+1)
`pipecat/src/pipecat/services/llm_service.py`	function_call_result_callback, stop, cancel, _cancel_sequential_runner_task, init
`pipecat/src/pipecat/services/ultravox/llm.py`	stop, cancel, _disconnect, init
`pipecat/src/pipecat/turns/user_turn_processor.py`	_on_broadcast_frame, _on_user_turn_started, _on_user_turn_stopped
`pipecat/src/pipecat/processors/frame_processor.py`	push_interruption_task_frame_and_wait, broadcast_frame, broadcast_frame_instance
`pipecat/src/pipecat/services/deepgram/stt.py`	_start_metrics, _on_speech_started, _on_utterance_end

Entry Points

Start here when exploring this area:

process_frame (Function) — pipecat/tests/test_frame_processor.py:86
function_call_result_callback (Function) — pipecat/src/pipecat/services/llm_service.py:601
push_interruption_task_frame_and_wait (Function) — pipecat/src/pipecat/processors/frame_processor.py:750
broadcast_frame (Function) — pipecat/src/pipecat/processors/frame_processor.py:773
broadcast_frame_instance (Function) — pipecat/src/pipecat/processors/frame_processor.py:786

Key Symbols

Symbol	Type	File	Line
`ServerEvent`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	485
`SessionCreatedEvent`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	499
`SessionUpdatedEvent`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	511
`ConversationCreated`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	523
`ConversationItemAdded`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	535
`ConversationItemDone`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	549
`ConversationItemInputAudioTranscriptionDelta`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	563
`ConversationItemInputAudioTranscriptionCompleted`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	579
`ConversationItemInputAudioTranscriptionFailed`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	595
`ConversationItemTruncated`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	611
`ConversationItemDeleted`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	627
`ConversationItemRetrieved`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	639
`ResponseCreated`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	651
`ResponseDone`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	663
`ResponseOutputItemAdded`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	675
`ResponseOutputItemDone`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	691
`ResponseContentPartAdded`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	707
`ResponseContentPartDone`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	727
`ResponseTextDelta`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	747
`ResponseTextDone`	Class	`pipecat/src/pipecat/services/openai/realtime/events.py`	767

Execution Flows

Flow	Type	Steps
`Start → _run_handler`	cross_community	9
`Start → Create_task`	cross_community	9
`Start → Get_time`	cross_community	9
`Start → _run_handler`	cross_community	9
`Start → Create_task`	cross_community	9
`Start → Get_time`	cross_community	9
`Start → FramePushed`	cross_community	9
`Process_frame → _run_handler`	cross_community	8
`Process_frame → Create_task`	cross_community	8
`Process_frame → Get_time`	cross_community	8

Connected Areas

Area	Connections
Cartesia	41 calls
Tests	14 calls
Daily	13 calls
Services	11 calls
Foundational	6 calls
Processors	5 calls
Smallwebrtc	4 calls
Whisper	4 calls

How to Explore

gitnexus_context({name: "process_frame"}) — see callers and callees
gitnexus_query({query: "realtime"}) — find related execution flows
Read key files listed above for implementation details

More from this repository

same repository

code-review

tonehq/tone

Use this skill when the user asks to "review my changes", "code review", "review before commit", "/code-review", or wants SOLID, security, performance, accessibility, or error handling analysis on current git changes. Accepts an optional base branch argument (defaults to main).

2026-07-1610

generate-feature-docs

tonehq/tone

Generates feature documentation for a Next.js page by analyzing component source, service imports, Jotai atoms, and navigation paths. Output placed in e2e/ux_flow_docs/<page-name>.md and consumed by /generate-tests for comprehensive test coverage.

2026-06-1810

generate-tests

tonehq/tone

Generates a new Playwright e2e spec file by reading a page component's source code, then runs it. Use when a page has NO existing spec file and you need to create one from scratch.

2026-06-1810

test-cases

tonehq/tone

Skill for the Test-cases area of tone. 250 symbols across 60 files.

2026-06-0310

test-cases

tonehq/tone

Generate and maintain pytest test cases for FastAPI endpoints by reading the APIs.md documentation and tracing actual controller/service code. Creates one test file per controller with comprehensive coverage (success, failure, validation, auth, edge cases). Use this skill when the user asks to generate tests, create test cases, write API tests, add pytest coverage, or mentions "test my APIs". Also triggers on "generate tests", "write test cases", "add test coverage", or "pytest for my endpoints".

2026-06-0310

create-component

tonehq/tone

Creates a new shared UI component using shadcn/ui with the project's theme. Handles shadcn setup verification, theme token mapping, and generates production-ready components following project conventions.

2026-05-2310

Realtime

194 symbols | 26 files | Cohesion: 71%

When to Use

Working with code in pipecat/

Understanding how process_frame, function_call_result_callback, push_interruption_task_frame_and_wait work

Modifying realtime-related functionality

Key Files

File

Symbols

pipecat/src/pipecat/services/openai/realtime/events.py

ServerEvent, SessionCreatedEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemAdded (+42)

pipecat/src/pipecat/services/openai/realtime/llm.py

_calculate_audio_duration_ms, _truncate_current_audio_response, _handle_evt_speech_started, stop, cancel (+30)

pipecat/src/pipecat/services/grok/realtime/events.py

ServerEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemAdded, ConversationItemInputAudioTranscriptionCompleted (+29)

pipecat/src/pipecat/services/grok/realtime/llm.py

_truncate_current_audio_response, _handle_evt_speech_started, stop, cancel, _disconnect (+23)

pipecat/src/pipecat/services/openai_realtime_beta/openai.py

_calculate_audio_duration_ms, _truncate_current_audio_response, _handle_evt_speech_started, retrieve_conversation_item, init (+1)

pipecat/src/pipecat/services/llm_service.py

function_call_result_callback, stop, cancel, _cancel_sequential_runner_task, init

pipecat/src/pipecat/services/ultravox/llm.py

stop, cancel, _disconnect, init

pipecat/src/pipecat/turns/user_turn_processor.py

_on_broadcast_frame, _on_user_turn_started, _on_user_turn_stopped

pipecat/src/pipecat/processors/frame_processor.py

push_interruption_task_frame_and_wait, broadcast_frame, broadcast_frame_instance

pipecat/src/pipecat/services/deepgram/stt.py

_start_metrics, _on_speech_started, _on_utterance_end

Entry Points

Start here when exploring this area:

process_frame (Function) — pipecat/tests/test_frame_processor.py:86

function_call_result_callback (Function) — pipecat/src/pipecat/services/llm_service.py:601

push_interruption_task_frame_and_wait (Function) — pipecat/src/pipecat/processors/frame_processor.py:750

broadcast_frame (Function) — pipecat/src/pipecat/processors/frame_processor.py:773

broadcast_frame_instance (Function) — pipecat/src/pipecat/processors/frame_processor.py:786

Key Symbols

Symbol

Type

File

Line

ServerEvent

Class

pipecat/src/pipecat/services/openai/realtime/events.py

485

SessionCreatedEvent

Class

pipecat/src/pipecat/services/openai/realtime/events.py

499

SessionUpdatedEvent

Class

pipecat/src/pipecat/services/openai/realtime/events.py

511

ConversationCreated

Class

pipecat/src/pipecat/services/openai/realtime/events.py

523

ConversationItemAdded

Class

pipecat/src/pipecat/services/openai/realtime/events.py

535

ConversationItemDone

Class

pipecat/src/pipecat/services/openai/realtime/events.py

549

ConversationItemInputAudioTranscriptionDelta

Class

pipecat/src/pipecat/services/openai/realtime/events.py

563

ConversationItemInputAudioTranscriptionCompleted

Class

pipecat/src/pipecat/services/openai/realtime/events.py

579

ConversationItemInputAudioTranscriptionFailed

Class

pipecat/src/pipecat/services/openai/realtime/events.py

595

ConversationItemTruncated

Class

pipecat/src/pipecat/services/openai/realtime/events.py

611

ConversationItemDeleted

Class

pipecat/src/pipecat/services/openai/realtime/events.py

627

ConversationItemRetrieved

Class

pipecat/src/pipecat/services/openai/realtime/events.py

639

ResponseCreated

Class

pipecat/src/pipecat/services/openai/realtime/events.py

651

ResponseDone

Class

pipecat/src/pipecat/services/openai/realtime/events.py

663

ResponseOutputItemAdded

Class

pipecat/src/pipecat/services/openai/realtime/events.py

675

ResponseOutputItemDone

Class

pipecat/src/pipecat/services/openai/realtime/events.py

691

ResponseContentPartAdded

Class

pipecat/src/pipecat/services/openai/realtime/events.py

707

ResponseContentPartDone

Class

pipecat/src/pipecat/services/openai/realtime/events.py

727

ResponseTextDelta

Class

pipecat/src/pipecat/services/openai/realtime/events.py

747

ResponseTextDone

Class

pipecat/src/pipecat/services/openai/realtime/events.py

767

Execution Flows

Flow

Type

Steps

Start → _run_handler

cross_community

Start → Create_task

cross_community

Start → Get_time

cross_community

Start → _run_handler

cross_community

Start → Create_task

cross_community

Start → Get_time

cross_community

Start → FramePushed

cross_community

Process_frame → _run_handler

cross_community

Process_frame → Create_task

cross_community

Process_frame → Get_time

cross_community

Connected Areas

Area

Connections

Cartesia

41 calls

Tests

14 calls

Daily

13 calls

Services

11 calls

Foundational

6 calls

Processors

5 calls

Smallwebrtc

4 calls

Whisper

4 calls

How to Explore

gitnexus_context({name: "process_frame"}) — see callers and callees

gitnexus_query({query: "realtime"}) — find related execution flows

Read key files listed above for implementation details