hyungi c57e4c52dc docs(eval): Phase 2Q Diagnose Phase 4 — decision tree md + Apply PR 백로그 ...

phase-2q-query-rewrite-diagnose.md v6 plan §7 Phase 4 closure.
Phase 3 commit a41adb6 의 3 측정 결과 + 4 factor weighted decision.

decision = H1 (both backends NDCG net 개선 ≥ +0.26):
- 추천 Apply LLM = cand_multi_query_macmini (gemma-4)
- 사유: F3 ⭐ 24/7 가동 + F1 NDCG 0.927 dominant + F4 cold latency 우세
- 대안: qwen (mixed/english 강점 + MacBook always-on 의향 시)

산출물:
- tests/search_eval/baselines/v0_2_phase2q_decision_2026-05-24.md (180 lines)
  · §1 결정 요약 / §2 측정 표 / §3 카테고리 회복 / §4 4-factor weighted
  · §5 분석 노트 5건 (multi-query 효과 / variants 구성 / cache hit / Recall 회귀 / Phase 3 incident)
  · §6 closure gate (branch close 사용자 결정 보류)
  · §7 follow-up PR 백로그: Apply 1 + 별 chore 2 + Extended 4 + Cloud 1 + Cleanup 1
  · §9 사용자 검토 항목 5건

Phase 2Q Diagnose closure 완료. Apply PR 진입 = 사용자 LLM 선택 + sequencing 결정 후.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-24 00:57:48 +00:00

..

api

feat(search): /ask/react endpoint with Qwen native tool calling ReAct loop

2026-05-22 13:43:47 +00:00

calibrate_fixtures

feat(scripts): Phase 3.5 — calibrate_ask.py CLI (Q0~Q8 + render + FP CSV)

2026-04-17 08:11:06 +09:00

fixtures

feat(eval): Phase 2Q Diagnose Phase 1A — fixture (4 카테고리 × 2 LLM) + prompt v1

2026-05-23 22:09:29 +00:00

load/fixtures

ops(gpu-health): GPU 서비스 health/smoke 표준화 + synthetic VRAM 피크 가드

2026-05-14 09:42:07 +09:00

phase3_5_eval

feat(ask): Phase 3.5a guardrails (classifier + refusal gate + grounding + partial)

2026-04-10 08:49:11 +09:00

policy

fix(policy): use container-compatible imports (drop app. prefix)

2026-04-24 09:42:24 +09:00

scripts

feat(chunk): Phase 1.2-E reindex 스크립트 추가

2026-04-08 12:31:29 +09:00

search_eval

docs(eval): Phase 2Q Diagnose Phase 4 — decision tree md + Apply PR 백로그

2026-05-24 00:57:48 +00:00

services

feat(search): /ask/react endpoint with Qwen native tool calling ReAct loop

2026-05-22 13:43:47 +00:00

__init__.py

feat: scaffold v2 project structure with Docker, FastAPI, and config

2026-04-02 10:20:15 +09:00

_worker_pool_helpers.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

conftest.py

feat: scaffold v2 project structure with Docker, FastAPI, and config

2026-04-02 10:20:15 +09:00

test_ask_eval_auth.py

feat(ask): Phase 3.5 A0 — ask_events source/eval_case_id + eval auth boundary

2026-04-17 08:11:06 +09:00

test_briefing_historical.py

fix(briefing): backfill country_perspectives[].article_ids from cluster members

2026-05-12 13:15:26 +09:00

test_explanation_cap.py

fix(tests): explanation cap test setup — 한글 chunk 길이 부족 보정

2026-05-02 08:35:34 +09:00

test_freshness_decay.py

feat(search): PR-RAG-Time-1 freshness decay (news/law_monitor)

2026-05-03 08:38:09 +09:00

test_grounding_fabricated_number.py

feat(grounding): Phase 3.5 B1 — unit-aware fabricated_number + bound semantics

2026-04-17 08:11:06 +09:00

test_internal_worker_authz.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_internal_worker_endpoints.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_laptop_worker_bot_auth.py

feat(worker-pool): Registry-1B Pull 활성화 (auth + worker_jobs + 5 endpoint)

2026-05-19 08:54:07 +09:00

test_marker_image_persist.py

feat(markdown): persist extracted images with auth routes

2026-05-10 14:05:41 +09:00

test_priority_gate.py

feat(search): MLX priority gate (B-1, Priority.FOREGROUND vs BACKGROUND)

2026-05-17 08:42:58 +09:00

test_query_rewriter.py

fix(search): Phase 2Q variants bug fix + Phase 3 3 measurement 박제

2026-05-24 00:51:56 +00:00

test_session_summary_guard_pattern.py

feat(study): Phase 4-D 운영 관찰 + confidence calibration

2026-05-02 07:33:57 +09:00

test_synthesis_failure_regate.py

fix(search): re-gate Tier 0 — synthesis self-refuse / timeout / empty answer 일관 처리

2026-04-17 08:29:49 +09:00

test_verifier_numeric_promote.py

feat(verifier): Phase 3.5 B2 — numeric_conflict promote (env flag) + Tier 4

2026-04-17 08:11:06 +09:00

test_worker_jobs_ownership.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_worker_jobs_retry.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_worker_jobs_skip_locked.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_worker_jobs_smoke.py

refactor(worker-pool): Registry-1B test fixture — NullPool helper standalone

2026-05-19 12:43:53 +09:00

test_worker_recap_compaction.py

feat(worker-pool): Registry-1C cap 1MB + deterministic compaction

2026-05-19 12:55:51 +09:00

test_worker_recap_endpoint.py

feat(worker-pool): Registry-1C cap 1MB + deterministic compaction

2026-05-19 12:55:51 +09:00