[唤醒应答与快速端点]：完成唤醒后我在播报和本地VAD端点优化，包含缓冲清理、配置项和测试覆盖

2026-06-17 20:51:14 +08:00
parent 860c2909fc
commit 44f708a3dc
12 changed files with 224 additions and 7 deletions
@@ -11,6 +11,28 @@ The live runtime SHALL display the recognized user utterance text in the termina
 - **WHEN** STT returns empty text, punctuation-only text, or an invalid transcript
 - **THEN** the runtime SHALL NOT emit a misleading transcript as valid user input and SHALL recover to standby without invoking the LLM

+### Requirement: Wake acknowledgement before recording
+The live runtime SHALL provide an audible local acknowledgement after local wake detection and before it starts recording the user's formal question.
+
+#### Scenario: Wake is detected
+- **WHEN** the local wakeword provider detects “小杰小杰”
+- **THEN** the runtime SHALL play a short acknowledgement such as “我在” before entering the user utterance recording state
+
+#### Scenario: Acknowledgement playback finishes
+- **WHEN** the acknowledgement playback completes
+- **THEN** the runtime SHALL clear buffered microphone input captured during acknowledgement playback before starting VAD recording for the user's question
+
+### Requirement: Fast user utterance endpointing
+The live runtime SHALL use the project-local VAD model by default for user utterance endpoint detection and SHALL expose configurable silence timing so the recording stops promptly after the user stops speaking.
+
+#### Scenario: User stops speaking after wake
+- **WHEN** VAD observes the configured continuous silence duration after a started utterance
+- **THEN** the runtime SHALL close the utterance segment and proceed to STT without waiting for the maximum recording duration
+
+#### Scenario: Local VAD model is available
+- **WHEN** `OWNER_VAD_PROVIDER=local`
+- **THEN** the runtime SHALL use the project-local `sherpa-onnx` VAD model rather than a raw energy threshold for live user utterance endpointing
+
 ## MODIFIED Requirements

 ### Requirement: Wake word detection
@@ -56,7 +78,7 @@ The system SHALL provide a `run-live` command that performs real repeated voice

 #### Scenario: Live runtime completes two turns
 - **WHEN** the user wakes the system with “小杰小杰”, asks a question, hears the reply, then wakes it again and asks another question
- **THEN** the system SHALL complete local wake, recording, STT, transcript display, LLM, TTS, playback for both turns and SHALL return to standby after each turn
+- **THEN** the system SHALL complete local wake, audible acknowledgement, recording, STT, transcript display, LLM, TTS, playback for both turns and SHALL return to standby after each turn

 #### Scenario: Once mode completes one turn
 - **WHEN** the user runs `PYTHONPATH=src python3.11 -m owner_voice_pet run-live --once`
@@ -31,3 +31,10 @@
 - [ ] 4.3 执行真实 run-live 验收；前置条件：模型、设备、.env 齐全；验收标准：唤醒命中使用本地模型，终端显示转写结果；测试要点：单轮或两轮状态输出；优先级：P0；预计：60 分钟。
 - [x] 4.4 最终门禁；前置条件：全部实现完成；验收标准：compileall、unittest、security-check、model-check、device-check、OpenSpec strict 全通过；优先级：P0；预计：30 分钟。
 - [ ] 4.5 归档变更并提交；前置条件：4.4 通过；验收标准：主 spec 更新，archive 完成，最终 commit，`git status --short` 为空；测试要点：中文提交信息；优先级：P0；预计：20 分钟。
+
+## 5. 唤醒应答与快速端点修正
+
+- [x] 5.1 增加唤醒后本地语音应答；前置条件：本地 KWS 已可唤醒；验收标准：wake 命中后播放“我在”再进入录音；测试要点：fake runtime 播放顺序；优先级：P0；预计：45 分钟。
+- [x] 5.2 清理应答播放期间的麦克风缓冲；前置条件：5.1 完成；验收标准：应答音频不进入正式问题 VAD/STT；测试要点：transport flush 测试；优先级：P0；预计：45 分钟。
+- [x] 5.3 live 默认改用本地 `sherpa-onnx` VAD 并缩短静音端点；前置条件：模型已下载；验收标准：`.env` 可配置 VAD provider、静音结束时间和最大录音时长；测试要点：配置和 runtime 构造测试；优先级：P0；预计：45 分钟。
+- [x] 5.4 验证并提交“唤醒应答与快速端点”模块；前置条件：5.1 至 5.3 完成；验收标准：compileall、unittest、security-check、model-check、OpenSpec strict 通过后 commit；优先级：P0；预计：20 分钟。