openai-realtime-beta

Stars10

Forks3

UpdatedApril 9, 2026 at 09:49

Skill for the Openai_realtime_beta area of tone. 102 symbols across 15 files.

Installation

Install with Codex or Claude Copy this prompt, paste it into Codex, Claude, or another assistant, and let it review the skill page and install it for you.

Source

tonehq

tonehq/tone

View GitHub Repository View Creator Repositories

Download

Related occupationsSOC

Based on SOC occupation classification

Software DevelopersComputer and Mathematical Occupations·SOC 15-1252

SKILL.md

readonly

name	openai-realtime-beta
description	Skill for the Openai_realtime_beta area of tone. 102 symbols across 15 files.

Openai_realtime_beta

102 symbols | 15 files | Cohesion: 75%

When to Use

Working with code in pipecat/
Understanding how upgrade_to_realtime, upgrade_to_realtime, upgrade_to_nova_sonic work
Modifying openai_realtime_beta-related functionality

Key Files

File	Symbols
`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	ServerEvent, SessionCreatedEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemCreated (+37)
`pipecat/src/pipecat/services/openai_realtime_beta/openai.py`	_receive_task_handler, _handle_evt_audio_done, _handle_evt_conversation_item_created, _handle_conversation_item_retrieved, _handle_evt_text_delta (+17)
`pipecat/src/pipecat/services/openai_realtime_beta/context.py`	init, __setup_local, upgrade_to_realtime, handle_function_call_result, OpenAIRealtimeLLMContext (+3)
`pipecat/src/pipecat/services/openai/realtime/context.py`	init, __setup_local, upgrade_to_realtime, handle_function_call_result, OpenAIRealtimeLLMContext (+2)
`pipecat/src/pipecat/services/aws/nova_sonic/context.py`	init, __setup_local, upgrade_to_nova_sonic, handle_function_call_result, AWSNovaSonicLLMContext (+2)
`pipecat/src/pipecat/services/openai/llm.py`	handle_function_call_result, OpenAIUserContextAggregator, OpenAIAssistantContextAggregator
`pipecat/src/pipecat/services/google/gemini_live/llm.py`	GeminiLiveContext, GeminiLiveUserContextAggregator, GeminiLiveAssistantContextAggregator
`pipecat/src/pipecat/processors/aggregators/openai_llm_context.py`	init, OpenAILLMContext
`pipecat/src/pipecat/services/google/llm.py`	GoogleUserContextAggregator, GoogleAssistantContextAggregator
`pipecat/src/pipecat/services/openai_realtime_beta/frames.py`	RealtimeFunctionCallResultFrame

Entry Points

Start here when exploring this area:

upgrade_to_realtime (Function) — pipecat/src/pipecat/services/openai_realtime_beta/context.py:60
upgrade_to_realtime (Function) — pipecat/src/pipecat/services/openai/realtime/context.py:142
upgrade_to_nova_sonic (Function) — pipecat/src/pipecat/services/aws/nova_sonic/context.py:181
handle_function_call_result (Function) — pipecat/src/pipecat/services/openai_realtime_beta/context.py:258
handle_function_call_result (Function) — pipecat/src/pipecat/services/openai/llm.py:187

Key Symbols

Symbol	Type	File	Line
`ServerEvent`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	388
`SessionCreatedEvent`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	402
`SessionUpdatedEvent`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	414
`ConversationCreated`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	426
`ConversationItemCreated`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	438
`ConversationItemInputAudioTranscriptionDelta`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	452
`ConversationItemInputAudioTranscriptionCompleted`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	468
`ConversationItemInputAudioTranscriptionFailed`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	484
`ConversationItemTruncated`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	500
`ConversationItemDeleted`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	516
`ConversationItemRetrieved`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	528
`ResponseCreated`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	540
`ResponseDone`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	552
`ResponseOutputItemAdded`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	564
`ResponseOutputItemDone`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	580
`ResponseContentPartAdded`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	596
`ResponseContentPartDone`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	616
`ResponseTextDelta`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	636
`ResponseTextDone`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	656
`ResponseAudioTranscriptDelta`	Class	`pipecat/src/pipecat/services/openai_realtime_beta/events.py`	676

Execution Flows

Flow	Type	Steps
`Process_frame → Get_time`	cross_community	5
`Process_frame → FrameProcessed`	cross_community	5
`Process_frame → On_process_frame`	cross_community	5
`Process_frame → Start`	cross_community	5
`Process_frame → Stop`	cross_community	5
`Process_frame → Cancel`	cross_community	5
`Process_frame → Cancel_task`	cross_community	4
`Process_frame → Create_task`	cross_community	4
`Process_frame → SessionUpdateEvent`	cross_community	4
`Process_frame → __setup_local`	cross_community	3

Connected Areas

Area	Connections
Cartesia	17 calls
Tests	8 calls
Realtime	7 calls
Whisper	3 calls
Daily	3 calls
Foundational	3 calls
Services	2 calls
Perplexity	2 calls

How to Explore

gitnexus_context({name: "upgrade_to_realtime"}) — see callers and callees
gitnexus_query({query: "openai_realtime_beta"}) — find related execution flows
Read key files listed above for implementation details

More from this repository

same repository

code-review

tonehq/tone

Use this skill when the user asks to "review my changes", "code review", "review before commit", "/code-review", or wants SOLID, security, performance, accessibility, or error handling analysis on current git changes. Accepts an optional base branch argument (defaults to main).

2026-07-1610

generate-feature-docs

tonehq/tone

Generates feature documentation for a Next.js page by analyzing component source, service imports, Jotai atoms, and navigation paths. Output placed in e2e/ux_flow_docs/<page-name>.md and consumed by /generate-tests for comprehensive test coverage.

2026-06-1810

generate-tests

tonehq/tone

Generates a new Playwright e2e spec file by reading a page component's source code, then runs it. Use when a page has NO existing spec file and you need to create one from scratch.

2026-06-1810

test-cases

tonehq/tone

Skill for the Test-cases area of tone. 250 symbols across 60 files.

2026-06-0310

test-cases

tonehq/tone

Generate and maintain pytest test cases for FastAPI endpoints by reading the APIs.md documentation and tracing actual controller/service code. Creates one test file per controller with comprehensive coverage (success, failure, validation, auth, edge cases). Use this skill when the user asks to generate tests, create test cases, write API tests, add pytest coverage, or mentions "test my APIs". Also triggers on "generate tests", "write test cases", "add test coverage", or "pytest for my endpoints".

2026-06-0310

create-component

tonehq/tone

Creates a new shared UI component using shadcn/ui with the project's theme. Handles shadcn setup verification, theme token mapping, and generates production-ready components following project conventions.

2026-05-2310

Openai_realtime_beta

102 symbols | 15 files | Cohesion: 75%

When to Use

Working with code in pipecat/

Understanding how upgrade_to_realtime, upgrade_to_realtime, upgrade_to_nova_sonic work

Modifying openai_realtime_beta-related functionality

Key Files

File

Symbols

pipecat/src/pipecat/services/openai_realtime_beta/events.py

ServerEvent, SessionCreatedEvent, SessionUpdatedEvent, ConversationCreated, ConversationItemCreated (+37)

pipecat/src/pipecat/services/openai_realtime_beta/openai.py

_receive_task_handler, _handle_evt_audio_done, _handle_evt_conversation_item_created, _handle_conversation_item_retrieved, _handle_evt_text_delta (+17)

pipecat/src/pipecat/services/openai_realtime_beta/context.py

init, __setup_local, upgrade_to_realtime, handle_function_call_result, OpenAIRealtimeLLMContext (+3)

pipecat/src/pipecat/services/openai/realtime/context.py

init, __setup_local, upgrade_to_realtime, handle_function_call_result, OpenAIRealtimeLLMContext (+2)

pipecat/src/pipecat/services/aws/nova_sonic/context.py

init, __setup_local, upgrade_to_nova_sonic, handle_function_call_result, AWSNovaSonicLLMContext (+2)

pipecat/src/pipecat/services/openai/llm.py

handle_function_call_result, OpenAIUserContextAggregator, OpenAIAssistantContextAggregator

pipecat/src/pipecat/services/google/gemini_live/llm.py

GeminiLiveContext, GeminiLiveUserContextAggregator, GeminiLiveAssistantContextAggregator

pipecat/src/pipecat/processors/aggregators/openai_llm_context.py

init, OpenAILLMContext

pipecat/src/pipecat/services/google/llm.py

GoogleUserContextAggregator, GoogleAssistantContextAggregator

pipecat/src/pipecat/services/openai_realtime_beta/frames.py

RealtimeFunctionCallResultFrame

Entry Points

Start here when exploring this area:

upgrade_to_realtime (Function) — pipecat/src/pipecat/services/openai_realtime_beta/context.py:60

upgrade_to_realtime (Function) — pipecat/src/pipecat/services/openai/realtime/context.py:142

upgrade_to_nova_sonic (Function) — pipecat/src/pipecat/services/aws/nova_sonic/context.py:181

handle_function_call_result (Function) — pipecat/src/pipecat/services/openai_realtime_beta/context.py:258

handle_function_call_result (Function) — pipecat/src/pipecat/services/openai/llm.py:187

Key Symbols

Symbol

Type

File

Line

ServerEvent

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

388

SessionCreatedEvent

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

402

SessionUpdatedEvent

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

414

ConversationCreated

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

426

ConversationItemCreated

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

438

ConversationItemInputAudioTranscriptionDelta

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

452

ConversationItemInputAudioTranscriptionCompleted

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

468

ConversationItemInputAudioTranscriptionFailed

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

484

ConversationItemTruncated

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

500

ConversationItemDeleted

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

516

ConversationItemRetrieved

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

528

ResponseCreated

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

540

ResponseDone

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

552

ResponseOutputItemAdded

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

564

ResponseOutputItemDone

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

580

ResponseContentPartAdded

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

596

ResponseContentPartDone

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

616

ResponseTextDelta

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

636

ResponseTextDone

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

656

ResponseAudioTranscriptDelta

Class

pipecat/src/pipecat/services/openai_realtime_beta/events.py

676

Execution Flows

Flow

Type

Steps

Process_frame → Get_time

cross_community

Process_frame → FrameProcessed

cross_community

Process_frame → On_process_frame

cross_community

Process_frame → Start

cross_community

Process_frame → Stop

cross_community

Process_frame → Cancel

cross_community

Process_frame → Cancel_task

cross_community

Process_frame → Create_task

cross_community

Process_frame → SessionUpdateEvent

cross_community

Process_frame → __setup_local

cross_community

Connected Areas

Area

Connections

Cartesia

17 calls

Tests

8 calls

Realtime

7 calls

Whisper

3 calls

Daily

3 calls

Foundational

3 calls

Services

2 calls

Perplexity

2 calls

How to Explore

gitnexus_context({name: "upgrade_to_realtime"}) — see callers and callees

gitnexus_query({query: "openai_realtime_beta"}) — find related execution flows

Read key files listed above for implementation details