AudioJev: audio decisions, order calibration and release limits

Read AudioJev’s paper, checkpoint and inference library together: candidate-order stability, seed-specific results, data overlap and separate licenses.

Short answer: AudioJev is an independent audio decision model that scores supplied alternatives from a waveform and question. Its order-calibration objective addresses sensitivity to candidate order; it does not establish that a returned probability equals the empirical chance of being correct.

Based on the fixed-v1 abstract, public model card and inference-library overview. No weights, audio or inference code were executed or downloaded.

What does the model return?

The paper describes training paired candidate orders and aligning their distributions by candidate identity. Inference scores the supplied candidates without an order ensemble. The separate inference library exposes Choice and Noul requests, plus an experimental Score interface, and can share an audio encoding across questions. This is a closed set: your application still has to supply appropriate alternatives and a fallback when needed. AudioJev paper, v1 · Inference-library documentation

How does DuplexJev differ?

DuplexJev connects ASR-encoder states to a frozen language model, whereas AudioJev describes a shared full-parameter model with an option-order objective. The speech paper reports different connector configurations and timing on an eight-GPU node. These are different training and serving arrangements, not a matched speed comparison. For a useful comparison, hold audio tasks, candidate sets, batching and hardware fixed, and separate audio encoding, question scoring and end-to-end latency. DuplexJev, v1 · AudioJev, v1

Which results belong to the released checkpoint?

Keep the paper’s three-seed averages separate from the model card’s single-seed, original-order results. The card also discloses audio-source overlap in part of the hidden MMAU evaluation. Neither a hidden evaluation split nor a fixed final checkpoint automatically establishes independence from all fitting or development sources. Checkpoint and evaluation scope

How should I evaluate it?

For your own test, define a task-specific answer set and verify labels independently. Compare unchanged audio under meaning-preserving candidate permutations, align the returned probabilities by candidate identity, and measure both accuracy and order sensitivity. Assess correctness calibration separately, on held-out labeled examples. If a downstream action depends on a threshold, report the accepted fraction and error rate together. These are proposed checks, not results produced by this collection.

What is available, and under which terms?

The library is presented as Apache-2.0 code; the checkpoint declares the separate Qwen Research license. Review the model’s own terms before use. The release does not establish open-ended generation, visual performance or live turn-taking readiness. Follow the linked runtime documentation for hardware and deployment requirements; a documented command is not a verified deployment by this project. Model card and license declaration · Runtime and deployment entry point