Skip to content

server : add tests for the realtime API - #7

Draft
T0mSIlver wants to merge 2 commits into
realtime-basefrom
realtime-tests
Draft

T0mSIlver wants to merge 2 commits into
realtime-basefrom
realtime-tests

Conversation

@T0mSIlver

Copy link
Copy Markdown
Owner

Proposed body for review on the fork. Rewrite it in your own words before opening upstream (llama.cpp does not accept AI-written PR text).

Overview

Adds tools/server/tests/unit/test_realtime.py, the first tests for the /v1/realtime WebSocket endpoint.

The slow tests use ggml-org/Voxtral-Mini-4B-Realtime-2602-GGUF:Q4_K_M and whisper.cpp's jfk.wav, and run with --temp 0. The model is not a ServerPreset on purpose, because load_all() would download it for every test session.

Additional information

Run on an RTX 3090, CUDA Release build of master 9145ddb:

./tests.sh unit/test_realtime.py                  1 passed, 2 skipped
SLOW_TESTS=1 ./tests.sh unit/test_realtime.py     3 passed

At 1242be6 (before ggml-org#30994), test_realtime_commit fails as expected:

item 1: "And so, my fellow Americans, ask not what your country can do for you."
item 2: "Ask what you can do for your country. ..."
AssertionError (AUDIO_RE)

Requirements



Generated by Claude Code

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant