Skip to content

About

Realtime voice AI example app for iOS in Swift and SwiftUI: live conversation, speech-to-text and text-to-speech with the Wiro AI API.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

Wiro AI

Wiro Realtime for Swift: Voice AI Example for iOS

Realtime voice AI for iOS in Swift and SwiftUI: live conversation, speech-to-text and text-to-speech with the Wiro AI API.

Swift 6.0 iOS 26.0+ CI License: MIT

Website · Models · Docs · Dashboard

Wiro Realtime for Swift is the official open-source example for building realtime voice AI into an iOS app with Swift, SwiftUI and the Wiro AI API. Its three tabs stream audio over WebSocket for a live speech-to-speech conversation with barge-in, live speech-to-text from the microphone, and text-to-speech playback. The auth, networking, realtime and audio layers have no UI dependency, so you can lift them into your own app.

Conversation tab of the SwiftUI app with the Marin voice, settings and a Start button Transcription tab of the SwiftUI app with the Balanced accuracy setting and a Start button Speech tab of the SwiftUI app with a text-to-speech prompt, the MOSS TTS Realtime model and a Play button

What's inside

Three realtime audio flows, each a tab in the app, each backed by a live Wiro AI model over one WebSocket protocol:

Flow Model What it does
Conversation openai/gpt-realtime-mini Full-duplex voice chat with barge-in
Transcription mistralai/voxtral-mini-4b-realtime-2602 Live speech-to-text as you talk
Speech openmoss/moss-tts-realtime or openbmb/voxcpm2 Streaming text-to-speech playback

The chrome is system SwiftUI: TabView, NavigationStack, toolbar items, Menu, Form, List. Liquid Glass comes from iOS 26, light and dark follow the system, and there is no custom orb, wave, or tab bar. The screens carry no instructions: Start is the one prominent button, and the stage shows what is happening.

Features

  • Live speech-to-speech conversation with voice activity detection, barge-in, and a noise gate
  • Realtime microphone transcription with streaming partial results
  • Streaming text-to-speech with bounded PCM playback
  • One AVAudioEngine graph for capture and playback, so the OS echo canceller (AEC) actually works
  • Signed REST Run requests and the full Wiro AI realtime WebSocket protocol
  • Bounded capture/playback queues, safe PCM overflow shedding, audio route and interruption handling
  • Cross-feature guard so two tabs never hold the microphone at once
  • Automatic reconnect to the same task on socket drops, with a bounded restart budget
  • Session lifecycle covered by XCTest fakes, so no device is needed to verify the plumbing

Requirements

  • Xcode 26 or later
  • A physical iPhone on iOS 26 or later (the simulator microphone is not a usable voice path)
  • An Apple Developer team for signing on that iPhone: set DEVELOPMENT_TEAM in Configs/Secrets.xcconfig (see below), since the project file ships without one
  • A Wiro AI project and API key

No CocoaPods and no Swift package dependencies. The project is one folder-synced app target plus its unit-test target.

Run

Copy the credential template and set the key:

cp Configs/Secrets.xcconfig.example Configs/Secrets.xcconfig

Edit Configs/Secrets.xcconfig:

WIRO_API_KEY = YOUR_API_KEY
WIRO_API_SECRET =
DEVELOPMENT_TEAM = YOUR_TEAM_ID

WIRO_API_SECRET is only for signature-based Wiro AI projects. Leave it empty for API-key-only projects. DEVELOPMENT_TEAM is the ten-character id from your Apple Developer account; the simulator builds without it. The secrets file is gitignored.

Then:

open SwiftRealtime.xcodeproj

Select the SwiftRealtime scheme, pick a physical iPhone, and run.

Alternatively, leave the xcconfig empty and set WIRO_API_KEY (and optionally WIRO_API_SECRET) on the scheme's environment. Scheme env wins over the compiled Info.plist values.

Launch fails fast when WIRO_API_KEY is missing.

Credentials warning: values from .xcconfig are compiled into the binary and can be read out of any build you distribute. This is fine for a developer running the example on their own phone. It is not fine for an app in the App Store: see Shipping to users before you do that.

Shipping to users

The API key is only needed for one call: POST /Run, which creates the task and returns a socketaccesstoken. Everything after that (the WebSocket subscribe, the audio frames, the session end) is authenticated by that per-task token alone. So the key never has to leave your server.

The seam is the WiroApiClient protocol (SwiftRealtime/Networking/WiroApiClient.swift). Implement it against your own backend, which holds the key, calls /Run (and /Task/Kill for terminateTaskBestEffort), and hands back the task id and token:

final class BrokeredWiroApiClient: WiroApiClient, @unchecked Sendable {
    func createCancellation() -> WiroRequestCancellation { .init() }

    func runModel(
        model: ModelDefinition,
        parameters: [String: Any],
        cancellation: WiroRequestCancellation?,
    ) async throws -> WiroRunResult {
        // POST to your server; it calls Wiro with the key and returns
        // { "taskId": ..., "taskToken": ... }.
    }

    func terminateTaskBestEffort(taskId: String, taskToken: String) async {
        // POST to your server; it calls /Task/Kill.
    }
}

Then build RealtimeSessionDependencies with it instead of the credential-based convenience initializer:

RealtimeSessionDependencies(
    httpClient: URLSessionWiroHttpClient(),
    apiClient: BrokeredWiroApiClient(),
    readyTimeout: .seconds(15),
)

Nothing under Realtime/ or Audio/ changes: the socket client only ever sees the task token. Your server decides who may start a billed task, how many, and for how long, which is the control you want over a metered resource anyway.

Make it yours

SwiftRealtime/App/Config/ConversationConfig.swift holds the persona, the voice, and the model. Editing that one file is the whole of turning this example into a product.

static let persona = "...who the assistant is..."
static let voice = "marin"

Common changes:

  • Give the assistant a job: rewrite persona.
  • Change the voice: set voice to any option the model catalog lists.
  • Tune the engineering parameters: parameters overrides the catalog defaults for turn detection, audio formats, and rates.
  • Ship only the conversation: delete SwiftRealtime/Views/Transcription/, SwiftRealtime/Views/Speech/, SwiftRealtime/Services/Transcription/, and SwiftRealtime/Services/Speech/ (plus their Tests/ mirrors), then remove the two Tabs from SwiftRealtime/Views/Home/RealtimeHomeView.swift. Shared layers under Models/, Networking/, Auth/, Realtime/, and Audio/ are untouched.

How a conversation runs

REST:      https://api.wiro.ai/v1
WebSocket: wss://socket.wiro.ai/v1
Run:       POST /Run/{owner}/{model}
  1. POST /Run/{owner}/{model} returns a task id and a task token (socketaccesstoken).
  2. A WebSocket opens and subscribes with { "type": "task_info", "tasktoken": "..." }.
  3. After task_stream_ready, 20 ms PCM chunks stream up as UTF8(tasktoken + "|") + pcm_bytes; audio frames come back in the same shape. Transcripts arrive as task_output messages prefixed TRANSCRIPT_USER: / TRANSCRIPT_AI:; task_stream_end marks the end of each assistant turn; task_cost reports turnCost and cumulativeCost as the conversation goes.
  4. The app sends task_session_end on leave and gives the server a bounded window to answer with task_postprocess_end before it closes the socket. task_end alone only means the model process exited. A client that disconnects without task_session_end is cleaned up by the server, and so is a task whose wallet runs dry.

Audio is signed 16-bit PCM, 24 kHz, mono, little-endian on both sides. The Wiro AI browser example sends 200 ms frames; this app sends 20 ms frames because barge-in latency is bounded by the frame size, and the server accepts either.

Authentication is x-api-key alone, or x-api-key + x-nonce + x-signature where the signature is HMAC-SHA256(key = API_KEY, message = API_SECRET + NONCE).

Project layout

SwiftRealtime/
  App/            entry, AppColors, ConversationConfig
  Models/         catalog, parameters, run result
  Networking/     HTTP, endpoints, Run launcher
  Auth/           credentials, nonce, headers
  Realtime/       socket, session, framing
  Audio/          PCM, engine, session
  Services/       Conversation / Transcription / Speech
  Views/          Home / Conversation / Transcription / Speech / Shared
Tests/            mirrors the app; Support/ holds fakes
Configs/
  Secrets.xcconfig.example   credential template (copy locally)

Models/, Networking/, Auth/, Realtime/, and Audio/ have no dependency on any view or screen service and cover the whole Wiro AI integration, so they are the part worth lifting into your own app.

Tests

WIRO_API_KEY=test xcodebuild test \
  -scheme SwiftRealtime \
  -destination 'platform=iOS Simulator,name=iPhone 17 Pro'

Tests mirror SwiftRealtime/ and ship fakes for audio, network, and the socket, so the entire session lifecycle runs without a device. Time-dependent code takes a RealtimeClock; tests drive a TestClock by hand, so no test waits on the wall.

CI (.github/workflows/tests.yml) runs the suite on an iOS 26 simulator plus swiftformat --lint, swiftlint --strict, and an 80-column check, on pushes to main and on pull requests.

Contributing

Read CONTRIBUTING.md before opening a pull request. To report a security problem, follow SECURITY.md instead of opening a public issue.

Documentation

More from Wiro AI

Repository What it is
Wiro-MCP Official MCP server for Wiro AI, @wiro-ai/wiro-mcp on npm
Wiro-LLM Vercel AI SDK provider for chat, images, speech, transcription and video, @wiro-ai/wiro-llm on npm
Wiro-Chromium-Extension Wiro AI extension for Chrome, Edge, Opera and Brave
Wiro-Firefox-Extension Wiro AI add-on for Firefox
Wiro-Safari-Extension Wiro AI extension for Safari on the Mac
Wiro-Plugin Wiro AI plugin for Cursor, Claude Code, Gemini CLI, Devin, Antigravity and Kiro
Wiro-Skills Agent skills for images, image edits, video, music, speech, transcripts, 3D and model search
Swift-QuickStart WiroKit, the Wiro AI SDK for iOS
Kotlin-QuickStart WiroKit, the Wiro AI SDK for Android
Dart-QuickStart Wiro AI SDK for Dart and Flutter, wiro on pub.dev
ReactNative-QuickStart Wiro AI SDK for React Native and Expo, @wiro-ai/wiro-react-native on npm
Kotlin-Realtime Realtime voice AI example for Android
Dart-Realtime Realtime voice AI example for Flutter
ReactNative-Realtime Realtime voice AI example for React Native
n8n-nodes-wiro One Wiro AI node for n8n with a searchable model picker, @wiro-ai/n8n-nodes-wiro on npm
Wiro-Dify-Plugin Wiro AI plugins for Dify: the LLM gateway as a model provider, plus image, video, speech and music tools
Wiro-ComfyUI Wiro AI nodes for ComfyUI
Wiro-Hermes Wiro AI plugins for Hermes Agent: image, video, audio and 3D tools, plus the LLM gateway as a model provider
Wiro-Zed Wiro AI MCP server extension for Zed
Wiro-Action GitHub Action for Wiro AI models and the LLM gateway, on the GitHub Marketplace
Wiro-Raycast Wiro AI extension for Raycast: image and video generation, LLM chat and model search
Wiro-WordPress Wiro AI plugin for WordPress: featured images, image edits, alt text, narration and SEO suggestions
Wiro-Obsidian Wiro AI plugin for Obsidian: images, video, speech, music, transcription and text tools
Wiro-Blender Wiro AI add-on for Blender: text to 3D, image to 3D and textures
Wiro-Figma Wiro AI plugin for Figma: images, vectors, image edits and text
Wiro-Next-Starter Next.js starter for Wiro AI: Playground, image, video and audio tools, and LLM chat, ready for Vercel and Railway
Wiro-Docs Source of the Wiro AI API docs
wiroai.github.io Every open-source project from Wiro AI on one page, with a page for each repository

Website · Models · Docs · X

License

MIT


Wiro AI koala mascot

Built by the Wiro AI team

wiro.ai · GitHub @wiroai

About

Realtime voice AI example app for iOS in Swift and SwiftUI: live conversation, speech-to-text and text-to-speech with the Wiro AI API.

Topics

Resources

Code of conduct

Contributing

Security policy

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages