4f6cc4812ede99771af53b624739b20c2f2b0e06
Live verification via POST /status/models/ping (after confirming the gateway itself is reachable -- embedding role succeeded, 1.5s latency) shows http://6.86.80.4:30080/v1/rerank returns a fast, reproducible '503 Service Unavailable' -- not a timeout/fluke. The gateway's model catalog (19 models: deepseek-*, glm-*, kimi-*, qwen3*, text-embedding-v3/4) contains no cross-encoder/rerank-capable model, confirming no reranker service is deployed behind this gateway today. Leaving RERANKER_ENABLED=true would be a permanent no-op (graceful fallback to unranked order every call) plus a misleading permanent error badge on the Status page. Revert until a reranker model is actually deployed on the gateway. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Description
AIRegulation-DocAnalysis-Demo
12 MiB
Languages
Python
55.2%
HTML
22.7%
TypeScript
16.2%
CSS
2.8%
Shell
1.4%
Other
1.6%