feat: whisper context lifecycle, constrained generation, and a home slot

[dishit-wednesday]

Core capabilities plus a submodule pointer bump. No product code here - the changes are to whisper's context lifecycle, model loading, constrained generation, and the home slot registry.

Whisper context lifecycle

The transcription context is now safe under a second, long-running consumer. Three ways it could be lost or corrupted underneath a caller:

• One shared in-flight load. Two callers racing to load the model each got their own context; one was leaked. They now share the single in-flight promise.
• Eviction is vetoed during a file transcribe. Memory pressure could evict the context out from under a decode that was still running.
• The context resets after a wedged transcribe, so one hung call cannot hold it indefinitely. Previously the only recovery was restarting the app.

maxThreads is also passed through transcribeFile, where it was being silently dropped.

Model loading

• skipVision - a text-only load that leaves the projector on disk, for callers that will never send an image.
• Paired with a fix so a text-only load no longer satisfies a caller that asked for vision. That was the bug that made the flag safe to add rather than dangerous: without it, skipVision could poison a later vision request.

Constrained generation

llmConstraints collects grammar, repeat-penalty and thinking overrides into one module, accepted by generateWithMaxTokens as ConstrainedCompletionOpts. Each override was previously threaded through separately.

Slots

A home.recorder slot, rendered above recent conversations. Core declares the slot; anything may fill it or not. A build without the submodule renders nothing and behaves exactly as before.

Build and test config

ios/Podfile.lock, jest.config.js and react-native.config.js move so the submodule autolinks by root only, declares its own platforms, and runs its suite from the root config.

Reviewing this

19 commits, 14 files, +233/-45. Three are submodule pointer bumps; the rest are the changes above, from a lineage that had no open PR - so this is the first time they are proposed for dev.

Not device-verified. The whisper changes in particular are reasoned and unit-tested, not observed on hardware under real memory pressure.

Greptile Summary

The PR adds Whisper context-lifecycle coordination, text-only model loading, consolidated constrained-generation options, and a home-screen extension slot. It also updates the Pro submodule integration and associated iOS, React Native, and Jest configuration.

• Shares concurrent Whisper loads and tracks file transcription for residency decisions.
• Adds skipVision loading and vision-aware active-model compatibility checks.
• Consolidates grammar, repetition, and thinking overrides into constrained completion options.
• Registers and renders the optional home.recorder slot.
• Updates native dependencies, autolinking, and root-level test configuration.

Confidence Score: 3/5

The PR is not yet safe to merge because vision upgrades can falsely succeed and Whisper eviction can still release a context during file-transcription startup.

A same-path model load returns before attaching the requested projector, while Whisper marks file transcription active only after starting native decoding, leaving both previously reported runtime failures outstanding.

Files Needing Attention: src/services/llm.ts, src/services/activeModelService/index.ts, src/services/whisperService.ts, src/stores/whisperStore.ts

Important Files Changed

Filename	Overview
src/services/whisperService.ts	Adds shared context-load handling, file-transcription lifecycle tracking, timeout recovery, and maxThreads forwarding.
src/stores/whisperStore.ts	Integrates Whisper residency with an eviction veto while file transcription is active.
src/services/activeModelService/index.ts	Adds vision-aware model compatibility checks and propagates text-only loading options.
src/services/llm.ts	Accepts consolidated constrained-completion options and manages multimodal context metadata.
src/services/llmConstraints.ts	Centralizes grammar, repeat-penalty, and thinking-option application.
src/bootstrap/slotRegistry.ts	Declares the optional home recorder extension slot.
src/screens/HomeScreen/index.tsx	Renders the optional recorder slot above recent conversations.
ios/Podfile	Adds modular ONNX Runtime headers required by the Pro Swift pod.
jest.config.js	Extends root test discovery and configuration for the checked-out Pro submodule.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
  A[Model request] --> B{Whisper or text model?}
  B -->|Whisper| C[Residency coordination]
  C --> D[Shared context load]
  D --> E[File transcription]
  B -->|Text model| F{skipVision?}
  F -->|Yes| G[Load text context only]
  F -->|No| H[Load text context and projector]
  G --> I[Constrained generation]
  H --> I
  J[Home screen] --> K[home.recorder slot]
  K --> L[Optional Pro implementation]

Loading

_{Reviews (2): Last reviewed commit: "chore(ios): background audio and the pod..." | Re-trigger Greptile}

[qodo-code-review]

ⓘ Qodo reviews are paused because your trial has ended. Ask your workspace admin to add credits to resume reviews. Manage billing

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro Plus

Run ID: abb2f7d6-7f28-4fbd-b05f-21eb114872c0

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[sonarqubecloud]

Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud