10 Commits

Author	SHA1	Message	Date
wangwei	b870ed8730	feat: make contexts optional in /api/score ... When contexts is absent, metrics that require retrieved_contexts (faithfulness, context_recall, context_precision, noise_sensitivity) are automatically skipped and appear in skipped_metrics. Only answer_relevancy, factual_correctness, semantic_similarity remain computable without contexts. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-06-24 14:42:03 +08:00
wangwei	a03a24be4e	feat: add POST /api/score endpoint for Dify real-time scoring ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-06-22 15:14:19 +08:00
wangwei	e4d4e4968b	feat: add InlineScorer service with LLM client caching ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-06-22 15:03:43 +08:00
wangwei	761faf9c42	feat: add ScoreRequest/ScoreResponse models and SCORE_API_TOKEN setting ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-06-22 15:00:05 +08:00
wangwei	ce0d2291b0	feat: yaml_patcher and ProfileApplyRequest support metric_weights and doc_weights ... Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>	2026-06-18 17:02:21 +08:00
wangwei	719c3b4ca4	test: ensure test package structure and all webapp tests pass	2026-06-16 16:27:54 +08:00
wangwei	e329f59139	feat: add yaml_patcher service to apply LLM profiles to scenario YAML	2026-06-16 16:21:19 +08:00
wangwei	b19054bd66	feat: add /api/llm-profiles CRUD router	2026-06-16 16:18:40 +08:00
wangwei	5d09deb420	feat: add ProfileManager service with JSON persistence	2026-06-16 16:14:31 +08:00
wangwei	b98af29449	feat: add LLMProfile pydantic models	2026-06-16 16:10:37 +08:00