audio-programming

name	audio-programming
description	Expert knowledge for programmatic audio across macOS, Linux, Windows, iOS, and Android, with Rust and TypeScript examples. Use when choosing platform audio backends, implementing playback or capture, or troubleshooting cross-platform audio behavior.

Audio Programming by Operating System

This skill will provide detailed knowledge useful for programmatic use of the audio subsystems which modern OS's provide. Use the links provided throughout this skill document to get more details on the areas which are most relevant.

Desktop Operating Systems

To get details on how to handle on audio on a particular desktop operating system, choose from

macOS

The following links provide details on how to work with audio on the macOS operating system:

• The macOS Audio Ecosystem & Rust Access
• Addressing Your Audio Goals
• The macOS Landscape: Tahoe vs. The Past
• Sound Effects versus Normal Audio
• Example: Enumerating the output devices
• Example #2: Hardware Listeners
• Example #3: Leveraging Sound Effects versus Normal Audio

Windows

The following links provide details on how to work with audio on the Windows operating system:

• Introduction
• Windows Audio Architecture Overview
• Common Audio APIs and Access Methods
• Sound Effects on Windows
• Audio Detection and Monitoring
• Volume Control and Muting
• Audio Device Enumeration
• Audio Routing to Specific Outputs
• Audio Ducking (Stream Attenuation)
• Native Audio Codec Support
• Windows 10 vs Windows 11 Audio Differences
• Rust Crate Recommendations
• Conclusion
• Additional Resources

Linux

The following links provide details on how to work with audio on the Linux operating system:

• A Comprehensive Guide for Rust Programmers
• Linux Audio Architecture Overview
• Common Features and APIs for Developers
• Sound Effects on Linux
• Audio Detection and Monitoring
• Volume Control and Muting
• Audio Input/Output Management
• Audio Routing and Stream Direction
• Audio Ducking
• Audio Codec Support
• Historical Evolution and Distribution Variations
• Rust Audio Libraries and Examples
• Summary

Mobile Operating Systems

IOS

Apple's mobile platform IOS:

• Introduction
• IOS Audio Frameworks Overview
• Sound Effects on iOS
• Audio Detection and Monitoring
• Volume Control and Muting
• Audio Input Sources
• Audio Output Routing
• Audio Ducking
• Native Audio Codecs
• Evolution of iOS Audio Support
• Rust Libraries for iOS Audio Development
• Practical Rust Code Examples
• Common Gotchas and Solutions
• References and Resources
• Conclusion

Android

Google's mobile platform Android:

• Overview of Android Audio APIs
• Sound Effects: SoundPool vs MediaPlayer
• Detecting and Controlling Audio State
• Audio Inputs and Sources
• Audio Outputs and Device Routing
• Audio Ducking and Focus Management
• Supported Audio Codecs
• Evolution of Android Audio Support
• Rust-Based Audio Development on Android
• Summary

Software Libraries

Rust Crates

This section will dig into the crates that most Rust developers will consider when developing an application that needs audio support.

• Introduction
• Cpal (Cross-Platform Audio Library)
• Rodio
• Kira
• Symphonia
• Fundsp
• Dasp (Digital Audio Signal Processing)
• Rubato
• Hound
• Nih-plug
• Tinyaudio
• Coreaudio-rs
• Oboe
• Vst-rs
• Summary Comparison Table
• Choosing the Right Crate
• Conclusion

Typescript Libraries

This section will dig into the npm libraries that most Typescript developers will consider when developing an application that needs audio support.

• Introduction
• The Web Audio API Foundation
• Web Browser Audio Libraries
• React Native / Mobile Audio Libraries
• Node.js Desktop Audio Libraries
• Platform Support Summary Table
• Choosing the Right Library
• Common Gotchas Across All Libraries
• Conclusion