hyungi 7aaabe2c75 feat(search): split markdown processing for large PDFs (>threshold) ...

PR-DocSrv-LargeDoc-Split-Markdown-1 commit 3 (plan brisk-paging-quokka.md).

- page_count gauge 분기: 소형(<=120p)=_process_single 통째 1-shot / 대형(>120p)=_process_split
- MAX_PAGES=200 hard skip 제거 → 대형은 BATCH_PAGES=40 page-range 윈도우 순차 변환
- 각 batch /convert start_page/end_page(1-based) 호출 + slug 충돌 회피 batch별 ref rewrite + stitch
- _persist_images_to_nas seq_offset → batch 간 image_key(img_NNN) 연속
- md_status success/partial/failed (전부/일부/전무) + failed batch manifest JSON
- 대형 md_content = head+manifest (LARGE_DOC_MD_CONTENT_HEAD_CHARS=50000), canonical=document_chunks(commit 4)
- MARKER_MAX_SPLIT_PAGES=5000 초과 = skipped_too_large 안전상태

검증: G1 소형회귀 doc6675 동일(success,6292,14)/single경로 / G2 doc5180 453p→12batch success
manifest+207img(img_001~207 연속) / G4 stuck0 restart0 각batch<300s. 섹션 chunk적재(G3)=commit 4.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

2026-05-24 07:39:49 +00:00

..

__init__.py

feat: scaffold v2 project structure with Docker, FastAPI, and config

2026-04-02 10:20:15 +09:00

briefing_worker.py

feat(briefing): add morning briefing schema + services + api (historical off)

2026-05-12 12:58:50 +09:00

chunk_worker.py

fix(digest): multi-word ai_sub_group matching + NYT_API_KEY example

2026-04-13 14:33:04 +09:00

classify_worker.py

ops(triage): event_kind_hint diagnostic logging cleanup (PR-4B Apply 영구 보류)

2026-05-18 11:27:29 +00:00

daily_digest.py

fix(daily_digest): cast today to date object for KST comparison

2026-05-12 21:30:41 +00:00

deep_summary_worker.py

refactor(search): swap 10 call sites to acquire_mlx_gate(Priority.*) (B-1)

2026-05-17 08:51:57 +09:00

digest_worker.py

feat(digest): Phase 4 Global News Digest (cluster-level batch summarization)

2026-04-09 07:45:11 +09:00

embed_worker.py

feat(search): retrieval+evidence 품질 개선

2026-04-15 14:56:33 +09:00

extract_worker.py

fix(ingest): devonagent extract md_status 'ready' → 'success'

2026-05-16 08:42:15 +09:00

file_watcher.py

feat(ingest): devonagent 트랙 Phase 1 ingest 활성화

2026-05-15 21:23:16 +09:00

law_monitor.py

feat(category): law 카테고리 분리 — enum + backfill + classify skip

2026-04-24 09:14:56 +09:00

mailplus_archive.py

fix(queue): enqueue 경로 중복 방어 — partial unique index + 중앙 enqueue_stage 함수

2026-04-15 08:37:32 +09:00

marker_worker.py

feat(search): split markdown processing for large PDFs (>threshold)

2026-05-24 07:39:49 +00:00

news_collector.py

fix(news): news 문서 chunk stage enqueue 추가 + 7일 백필 스크립트

2026-05-15 16:35:53 +09:00

preview_worker.py

fix: LibreOffice 한글 파일명 호환 — 영문 임시파일로 복사 후 변환

2026-04-03 11:18:06 +09:00

queue_consumer.py

feat(ingest): devonagent 트랙 Phase 1 ingest 활성화

2026-05-15 21:23:16 +09:00

stt_worker.py

feat(media): §3 audio STT + video 재생 인프라

2026-04-24 06:47:36 +09:00

study_explanation_worker.py

refactor(search): swap 10 call sites to acquire_mlx_gate(Priority.*) (B-1)

2026-05-17 08:51:57 +09:00

study_question_embed_worker.py

feat(study): Phase 1 학습 루프 데이터 계층 — progress 캐시 + finalize + review API

2026-05-01 09:28:46 +09:00

study_queue_consumer.py

feat(study): Mac mini derived-worker (PR-MacMini-Derived-Worker-1)

2026-05-15 03:13:43 +00:00

study_session_analysis_worker.py

refactor(search): swap 10 call sites to acquire_mlx_gate(Priority.*) (B-1)

2026-05-17 08:51:57 +09:00

study_session_queue_consumer.py

feat(study): Phase 4-B v1 세션 단위 종합 분석 (자유 마크다운)

2026-05-02 07:20:29 +09:00

summarize_worker.py

fix(worker): summarize ai_model_version label 정정 — qwen3.5 hardcode → primary config 동적

2026-05-23 21:28:05 +00:00

thumbnail_worker.py

feat(media): §3 audio STT + video 재생 인프라

2026-04-24 06:47:36 +09:00

tier_backfill.py

fix(ops): backfill 쿼리에 빈 extracted_text 제외 — 무한 retry 방지

2026-04-27 08:25:12 +09:00

upload_cleanup.py

feat(upload): §4-독립 — error_code 체계 + .uploading orphan cleanup + 진행률/abort UX

2026-04-24 06:57:02 +09:00