AI Agents, Standard

Apple Watch AI recaps enter beta: Live Rewind and Siri Recaps explained

A glowing platform condensing streams of conversation light into summary orbs, illustrating Apple Watch AI recaps

Apple Watch AI recaps are now in developer beta testing, bringing a new kind of ambient intelligence to the wrist. Announced as part of Apple’s Audio Intelligence suite at the company’s September hardware event, the features let an Apple Watch listen to the conversation its wearer is part of, then rewind it or turn it into notes. They involve listening to human speech, so Apple has built them around a deliberately narrow set of privacy promises: opt-in use, and, for Siri Recaps, no speaker identification, no stored raw audio, and no verbatim transcripts, while Live Rewind shows only a short text snippet that is deleted after 30 seconds unless saved.

Apple Watch AI recaps enter beta

Audio Intelligence is a set of four opt-in AI features for the Apple Watch. It entered developer beta testing in the iOS 27.3 and watchOS 27.3 updates, with a public beta to follow before general availability. The four features are Sound Recognition, Music Recognition, Live Rewind, and Siri Recaps.

Sound Recognition is aimed in particular at deaf and hard-of-hearing users, helping them identify important sounds such as sirens, alarms, and doorbells from their watch. Music Recognition taps into Apple’s Shazam app to detect music playing in the background and identify the song name and artist. The two conversation features, Live Rewind and Siri Recaps, are the ones that have drawn the most attention, because they involve listening to human speech.

The features require an Apple Watch Series 12 or Apple Watch Ultra 4, both powered by Apple’s S11 chip, paired with an iPhone with Apple Intelligence enabled. Reporting on the launch terms puts the compatible iPhones at iPhone 16 or later, excluding the iPhone 16e. At launch, the conversation features are available in English only and are not initially available in the EU, and features that rely on server-side models are subject to daily usage limits.

Live Rewind: rewinding the last 15 seconds

A loop of glowing light rewinding over sound waves, illustrating Live Rewind

Live Rewind answers a small, familiar problem: someone just said something and you missed it. If a person was giving verbal directions or reading a long list of specials at a restaurant, the wearer can double-press the Watch’s digital crown to see what was said in the last 15 seconds as a text snippet displayed on the watch face.

The interaction is designed to be visible to other people. When the wearer double-presses the crown, an audible chime sounds and an animation displays on the watch, signalling through the combination of gesture, sound, and visual display that something that was said has been captured. Below the text snippet, an “Ask Siri” option lets the wearer ask questions about what was said, such as the meaning of a technical term or an unfamiliar menu item.

The snippet is deliberately short-lived. If the wearer views it and does nothing, it disappears permanently. If they want to keep it, they can save it to the Siri app, which can be useful for remembering a name from a fast-paced presentation or a note from a conversation. Unsaved snippets are deleted automatically after 30 seconds.

Siri Recaps: notes from conversations you were part of

Siri Recaps takes the same ambient listening technology further, turning conversations into high-level notes. Instead of a transcript, the feature produces a short summary sentence and bullet points identifying key points, which might include important dates or deadlines, pricing, or payment plan information. As hypothetical illustrations, consider work meetings, parent-teacher conferences, and personal training sessions, where the wearer needs to remember tasks or things that were said but cannot write notes, either because their hands are full or because they are concentrating on what is being said.

Three limits define the feature. Apple says it is not identifying speakers, not saving the raw audio, and not providing word-for-word transcriptions. The output is a short summary with bullet points, not a transcript.

Control is in the wearer’s hands. Siri Recaps can be enabled manually or configured on a schedule, for example only while at work, or never at night. Even on a schedule, recapping can be turned off at any time from Control Center. The feature does not record conversations when the wearer is listening to music with headphones or using noise cancellation features. At the end of the day, and again when the wearer first unlocks the Watch in the morning, they are prompted to review saved Siri Recaps and choose which, if any, to keep. Notes can be saved to the Notes app or exported to the Journal app for more personal entries. If the wearer does nothing, recaps delete themselves within seven days.

Apple also says Siri Recaps is designed to omit sensitive information, including government-assigned identifiers, financial and authentication data, certain personal identifiers, and language that would promote self-harm.

How the audio is processed

Layered shields around a locked enclave with summary orbs leaving it, illustrating secure audio processing

The processing pipeline is the technical basis for Apple’s privacy claims, and it runs across three layers: the Watch, the iPhone, and Apple’s Private Cloud Compute.

It starts on the Watch. The Watch processes raw audio in a dedicated audio buffer in a secure enclave, a hardware-protected memory space that cannot be accessed by the rest of the operating system. Lightweight AI models on the S11 chip detect whether a conversation is happening that the wearer is part of. That audio is then transferred to the paired iPhone for processing.

On the iPhone, on-device processing turns the audio into condensed text, with filler words removed. That condensed text is encrypted and sent to Apple’s Private Cloud Compute to create the recap, which is sent back to the phone. Apple says the recap and the condensed text submitted to Private Cloud Compute are deleted from Private Cloud Compute immediately afterwards. The recaps are encrypted when synced between the wearer’s devices.

Live Rewind follows a similar path: the Watch transfers audio to the iPhone for processing to create the 15-second snippets. Apple says none of these features should impact the battery life of the watch or phone.

Privacy design and its limits

AI recording devices from other companies, including Meta’s AI glasses and other AI wearables, drew criticism for recording people who had not agreed to be recorded. That criticism provides context for Apple’s design, which combines consent, signalling, and technical constraint: the features are opt-in, the double-press gesture plus chime and animation announce a capture, and the system is designed not to know who is speaking or to keep the underlying audio.

That design still leaves genuine questions open. The system is described as detecting conversations the wearer is part of, but Apple has not publicly detailed how that boundary is drawn in a crowded room, or what happens when other participants have not consented to even a summarized record of what they said. A recap that omits speaker names still captures the substance of other people’s words, and a summary saved to Notes persists long after the 30-second or seven-day deletion windows for unsaved material have passed.

The launch limits also narrow who can judge the features for themselves. English-only availability, the initial absence from the EU, daily usage limits, and the age restrictions reported at launch (unavailable to users under 13; under-18 Child Account users need a parent or guardian to enable them) mean the first real-world evidence will come from a limited group of developer-beta users in limited regions. Those limits may change before general availability, and they are worth re-checking rather than assuming.

Availability and what to watch next

For now, the features are in developer beta for Apple Watch Series 12 and Apple Watch Ultra 4. A public beta is planned before general availability, but exact public-beta and general-release dates are not established by the available research.

What to watch as the beta widens is practical, not just technical. First, whether the privacy behaviour holds up in everyday use: how reliably the system distinguishes a conversation the wearer is part of from background speech, and how bystanders react to the chime and animation in practice. Second, whether battery life really is unaffected once the features run all day on a schedule. Third, whether the launch limits, including language, region, and daily usage caps, loosen or tighten on the way to general release.

If those answers come back clean, Apple Watch AI recaps could become a genuinely useful everyday tool: a way to catch the direction you missed and keep the action items from a meeting without ever pulling out a phone. If they do not, the beta period will have done its job, surfacing the problems while the audience is still small and the features are still optional.