vLLM Semantic Router introduced Fusion, a routing primitive that runs multiple models concurrently, uses a judge model to analyze agreement and gaps between their outputs, and synthesizes a single response while keeping observable traces. It supports automatic routing, explicit Fusion routing, and per-request overrides, letting operators decide when a multi-model panel justifies the added latency. Stage contracts and explicit error policies keep the multi-model workflow inspectable for production serving.
