AIRegulation/siemens_ragas
7
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(session-async): add /api/score/session_async with incremental session report aggregation

Browse Source 
- New POST /api/score/session_async endpoint: same session_id calls append to one shared report
- New GET /api/score/sessions/{session_id}: returns call_count, metric_means, all job records
- New GET /api/score/session/jobs/{job_id}: individual call status
- SessionScoreJobManager: deterministic run_id from session_id, per-session mutex for CSV append, advisor regenerated on every call
- SessionScoreRequest (extends ScoreRequest + session_id), SessionScoreJobResponse, SessionStatus models added
- 24 new tests, all passing

chore(weighted-score): comment out 综合加权得分 display and computation

- report.js: hide 综合加权得分 card in report detail page
- score_jobs.js: hide 综合 chip in async job list
- report_builder.py: overall_ws=None (computation disabled)
- summary.py: weighted_score summary line disabled
- evaluator.py: weighted_score/sample_weight columns no longer written to scores.csv
- score.py /api/score: weighted_score always returns null
- score_job_manager.py + session_score_manager.py: weighted=None
- Updated 3 tests to match new behaviour (6 pre-existing failures unchanged)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This commit is contained in:
wangwei
2026-06-26 16:09:33 +08:00
parent e1751447df
commit 754a30ad59
36 changed files with 2004 additions and 51 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
logs/online_eval.log Normal file
View File

@@ -0,0 +1 @@
Completed run: C:\Projects\AIProjects\Siemens-AIPOC\siemens_ragas\outputs\online\siemens-pdf-question-bank

24
logs/server_2026-06-23.log Normal file
View File

@@ -0,0 +1,24 @@
2026-06-23 13:55:00 INFO webapp.server Starting RAGAS Console host=127.0.0.1 port=8800 log_level=info log_file=C:\Projects\AIProjects\Siemens-AIPOC\siemens_ragas\logs\server_2026-06-23.log
2026-06-23 13:55:14 INFO uvicorn.error Started server process [83868]
2026-06-23 13:55:14 INFO uvicorn.error Waiting for application startup.
2026-06-23 13:55:14 INFO uvicorn.error Application startup complete.
2026-06-23 13:55:14 INFO uvicorn.error Uvicorn running on http://127.0.0.1:8800 (Press CTRL+C to quit)
2026-06-23 13:59:47 INFO uvicorn.access 127.0.0.1:53487 - "GET / HTTP/1.1" 200
2026-06-23 13:59:47 INFO uvicorn.access 127.0.0.1:53487 - "GET /static/css/app.css HTTP/1.1" 200
2026-06-23 13:59:47 INFO uvicorn.access 127.0.0.1:50321 - "GET /static/js/api.js HTTP/1.1" 200
2026-06-23 13:59:47 INFO uvicorn.access 127.0.0.1:51325 - "GET /static/js/profiles.js HTTP/1.1" 200
2026-06-23 13:59:47 INFO uvicorn.access 127.0.0.1:59869 - "GET /static/js/report.js HTTP/1.1" 200
2026-06-23 13:59:48 INFO uvicorn.access 127.0.0.1:50980 - "GET /static/js/runner.js HTTP/1.1" 200
2026-06-23 13:59:48 INFO uvicorn.access 127.0.0.1:63223 - "GET /static/js/app.js HTTP/1.1" 200
2026-06-23 13:59:48 INFO webapp.access GET /docs → 200 (0ms)
2026-06-23 13:59:48 INFO uvicorn.access 127.0.0.1:63223 - "GET /docs HTTP/1.1" 200
2026-06-23 13:59:48 INFO webapp.access GET /api/health → 200 (0ms)
2026-06-23 13:59:48 INFO uvicorn.access 127.0.0.1:50321 - "GET /api/health HTTP/1.1" 200
2026-06-23 13:59:49 INFO webapp.api.runs [get_runs] found 19 runs
2026-06-23 13:59:49 INFO webapp.access GET /api/runs → 200 (1094ms)
2026-06-23 13:59:49 INFO uvicorn.access 127.0.0.1:63223 - "GET /api/runs HTTP/1.1" 200
2026-06-23 13:59:49 INFO webapp.access GET /openapi.json → 200 (94ms)
2026-06-23 13:59:49 INFO uvicorn.access 127.0.0.1:63223 - "GET /openapi.json HTTP/1.1" 200
2026-06-23 13:59:50 INFO webapp.api.llm_profiles [list_profiles] count=6
2026-06-23 13:59:50 INFO webapp.access GET /api/llm-profiles → 200 (0ms)
2026-06-23 13:59:50 INFO uvicorn.access 127.0.0.1:63223 - "GET /api/llm-profiles HTTP/1.1" 200

35
logs/siemens_build.log Normal file
View File

@@ -0,0 +1,35 @@
[info] generating questions for: 315_1_Flash????????.pdf
[info] 315_1_Flash????????.pdf: 6 questions generated (total so far: 6)
[info] generating questions for: 316_2_Flash??????_??.pdf
[info] 316_2_Flash??????_??.pdf: 10 questions generated (total so far: 16)
[info] generating questions for: 317_3_Flash??????_??.pdf
[info] 317_3_Flash??????_??.pdf: 9 questions generated (total so far: 25)
[info] generating questions for: 318_4_Flash??????_???.pdf
[info] 318_4_Flash??????_???.pdf: 9 questions generated (total so far: 34)
[info] generating questions for: 319_5_Flash??????_?????.pdf
[info] 319_5_Flash??????_?????.pdf: 10 questions generated (total so far: 44)
[info] generating questions for: 320_6_Flash??????_??.pdf
[info] 320_6_Flash??????_??.pdf: 8 questions generated (total so far: 52)
[info] generating questions for: 321_??CT???????????--??.pdf
[info] 321_??CT???????????--??.pdf: 5 questions generated (total so far: 57)
[info] generating questions for: 322_??CT???????????--??????????.pdf
[info] 322_??CT???????????--??????????.pdf: 8 questions generated (total so far: 65)
[info] generating questions for: 323_??CT???????????--?????????.pdf
[info] 323_??CT???????????--?????????.pdf: 5 questions generated (total so far: 70)
[info] generating questions for: 324_??CT???????????--????????.pdf
[info] 324_??CT???????????--????????.pdf: 8 questions generated (total so far: 78)
[info] generating questions for: 325_??CT???????????--???????.pdf
[info] 325_??CT???????????--???????.pdf: 8 questions generated (total so far: 86)
[info] generating questions for: 326_??CT???????????--4D????.pdf
[info] 326_??CT???????????--4D????.pdf: 7 questions generated (total so far: 93)
[info] generating questions for: 327_??CT???????????--??????.pdf
[info] 327_??CT???????????--??????.pdf: 8 questions generated (total so far: 101)
[info] generating questions for: 749_????01_???????????.pdf
[info] 749_????01_???????????.pdf: 8 questions generated (total so far: 109)
[info] generating questions for: 804_????02-????????CT?????X-Map??.pdf
[info] 804_????02-????????CT?????X-Map??.pdf: 8 questions generated (total so far: 117)
[info] generating questions for: 805_????03_????????????????.pdf
[info] 805_????03_????????????????.pdf: 6 questions generated (total so far: 123)
[info] generating questions for: 807_???CT???????_SJ-L10.2??1-5.pdf
[info] 807_???CT???????_SJ-L10.2??1-5.pdf: 9 questions generated (total so far: 132)
Completed dataset build: C:\Projects\AIProjects\Siemens-AIPOC\siemens_ragas\outputs\dataset-builds\siemens-pdf-question-bank\2026-06-15T09-28-35.302231+00-00