hyungi/hyungi_document_server
1
1
Fork 0
Code Issues Pull Requests 2 Actions Packages Projects Releases Wiki Activity
Files
e50869cbdaea27925dac336523e983cd0e8ba6cb
hyungi_document_server/migrations
T
History
Hyungi Ahn e50869cbda feat(canonical): Phase 1B marker-service + marker_worker for PDF→markdown (222) 
신규 컨테이너 marker-service (port 3300, Marker 1.10.2 + surya 0.17.1 + HF
cache volume). marker_worker 가 markdown stage 큐 소비:
  classify_worker → enqueue 'markdown' (leaf, embed/chunk 와 독립)
  → SKIP_DOC_TYPES (발주서/세금계산서/명세표) 스킵
  → 확장자 != .pdf 스킵 (Phase 1B = PDF only)
  → page_count > 200 스킵
  → marker-service POST /convert
  → 422/404 = doc-level failed, 5xx = queue retry

안정성 장치:
- migration 222: ALTER TYPE process_stage ADD VALUE markdown (단일 statement)
- md_extraction_quality JSONB dict 직접 저장
- skip 시 md_content/hash NULL 클리어
- /ready Response.status_code + warmup_error 가시화
- HF cache volume (build-time download 0)
- file_path 는 NAS 상대경로 → /documents prefix prepend

성공 기준: 파이프라인 안정성. markdown 품질은 Phase 1D pilot.

Pre-flight (2026-05-01):
- marker-pdf 1.10.2 stable
- file_path 9503건 NAS 상대경로
- DOCUMENT_TYPES 한국어 7종 → SKIP alias 보강
- queue retry max_attempts=3 + reset_stale_items 확인
- main 220/221 study_q_related 선점 → 222 rebump

Plan: ~/.claude/plans/plan-idempotent-sundae.md (Round 5 approved)

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 00:06:23 +00:00
..
_deferred
ops(migrations): defer 142 NOT NULL until 1주 운영 관찰 후 활성화
2026-04-17 08:11:06 +09:00
001_initial_schema.sql
feat: implement Phase 0 auth system, setup wizard, and Docker config
2026-04-02 13:21:45 +09:00
002_vector_index.sql
feat: implement Phase 2 core features
2026-04-02 14:49:12 +09:00
003_automation_state.sql
feat: implement Phase 3 automation workers
2026-04-02 15:24:50 +09:00
004_user_note.sql
feat: Phase 1D+2 — 모바일 대응, 스마트 그룹, 메모, 태그 편집
2026-04-03 09:27:18 +09:00
005_preview_fields.sql
feat: Markdown 편집기 + PDF 변환 파이프라인 + 뷰어 포맷 분기
2026-04-03 10:10:03 +09:00
006_edit_url.sql
feat: 수동 편집 URL — 정보 패널에서 Synology Drive 링크 입력/관리
2026-04-03 10:37:44 +09:00
007_original_fields.sql
feat: 오피스 → ODF 변환 + 원본/편집본 분리 아키텍처
2026-04-03 13:11:43 +09:00
008_classify_fields.sql
feat: 분류 체계 전면 개편 — taxonomy + document_type + confidence
2026-04-03 13:32:20 +09:00
009_review_status.sql
fix: Codex 리뷰 5건 수정 (critical 1 + high 4)
2026-04-06 07:15:13 +09:00
010_soft_delete.sql
fix: Codex 리뷰 5건 수정 (critical 1 + high 4)
2026-04-06 07:15:13 +09:00
011_embedding_1024.sql
feat: 임베딩 모델 변경 — nomic-embed-text → bge-m3 (1024차원, 다국어)
2026-04-06 12:49:45 +09:00
012_news_sources.sql
feat: 뉴스 자동 수집 시스템 — 6개국 신문 RSS/API
2026-04-06 13:38:07 +09:00
013_news_features.sql
feat: 뉴스 전용 페이지 + 분류 격리 + 읽음 상태
2026-04-06 14:16:00 +09:00
014_document_chunks.sql
feat(chunk): Phase 0.1 chunk 인덱싱 — ORM/worker/migration 정리
2026-04-07 13:26:37 +09:00
015_search_failure_logs.sql
feat(search): Phase 0.3 검색 실패 자동 로깅
2026-04-07 08:29:12 +09:00
016_fts_expand_and_trgm.sql
feat(search): Phase 1.2-AB — migration 016 + trigram retrieval
2026-04-07 14:36:22 +09:00
101_global_digests.sql
fix(migration): SQLAlchemy text() bind 충돌 회피 — [:200] 표기 제거
2026-04-09 07:56:50 +09:00
102_ask_events.sql
feat(ask): Phase 3.5b guardrails — verifier + telemetry + grounding 강화
2026-04-10 09:49:56 +09:00
103_ask_events_indexes.sql
fix(migration): split 102 ask_events into single-statement files
2026-04-10 08:52:26 +09:00
104_user_admin.sql
fix(news): SSRF validation + admin auth + API key masking + collect lock + XML safety
2026-04-13 14:32:55 +09:00
105_memo_support.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
106_memo_file_path_nullable.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
107_memo_file_path_partial_unique.sql
fix(memos): DROP CONSTRAINT 사용 (UNIQUE constraint는 DROP INDEX 불가)
2026-04-13 16:03:35 +09:00
108_memo_file_path_partial_unique_idx.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
109_memo_columns.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
110_memo_pinned.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
111_memo_ask_includable.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
112_memo_notes_index.sql
fix(memos): migration을 개별 파일로 분리 (asyncpg multi-statement 미지원)
2026-04-13 16:02:45 +09:00
113_memo_archived.sql
feat(memos): UX 개선 — 편집 수정, 제목 제거, 체크박스, 아카이브
2026-04-14 08:36:16 +09:00
114_library_user_tags_gin.sql
feat(library): 자료실 — 태그 기반 트리 문서 관리 기능
2026-04-14 14:55:45 +09:00
115_doc_purpose.sql
fix(library): 마이그레이션 2개로 분리 (BEGIN 검증 회피)
2026-04-14 15:31:16 +09:00
116_doc_purpose_column.sql
fix(library): 마이그레이션 2개로 분리 (BEGIN 검증 회피)
2026-04-14 15:31:16 +09:00
117_queue_active_unique.sql
fix(queue): migration을 단일 statement 파일 3개로 분리
2026-04-15 08:40:19 +09:00
118_queue_drop_old_constraint.sql
fix(queue): migration을 단일 statement 파일 3개로 분리
2026-04-15 08:40:19 +09:00
119_queue_active_unique_index.sql
fix(queue): migration을 단일 statement 파일 3개로 분리
2026-04-15 08:40:19 +09:00
120_library_categories.sql
fix(library): 마이그레이션 asyncpg 다중 statement 분리
2026-04-15 10:03:00 +09:00
121_library_categories_indexes.sql
fix(library): 마이그레이션 asyncpg 다중 statement 분리
2026-04-15 10:03:00 +09:00
122_library_categories_parent_idx.sql
fix(library): 마이그레이션 asyncpg 다중 statement 분리
2026-04-15 10:03:00 +09:00
123_library_categories_seed.sql
fix(library): 마이그레이션 asyncpg 다중 statement 분리
2026-04-15 10:03:00 +09:00
124_facet_columns.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
125_facet_topic.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
126_facet_year.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
127_facet_doctype.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
128_facet_indexes.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
129_facet_topic_idx.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
130_facet_year_idx.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
131_facet_doctype_idx.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
132_facet_values.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
133_facet_values_unique.sql
feat(library): Phase 2A facet 탐색 기반 — 컬럼 + API + 필터
2026-04-15 10:09:25 +09:00
134_extract_meta.sql
fix(migration): asyncpg 다중 statement 분리
2026-04-15 15:10:01 +09:00
135_ask_events_observability.sql
fix(migration): asyncpg 다중 statement 분리 (135/136)
2026-04-16 13:54:15 +09:00
136_ask_events_prompt_version_idx.sql
fix(migration): asyncpg 다중 statement 분리 (135/136)
2026-04-16 13:54:15 +09:00
137_analyze_events.sql
feat(api): Phase E.2 — analyze_events 테이블 + 로깅
2026-04-16 13:58:58 +09:00
138_ask_events_source_and_eval_case_id.sql
feat(ask): Phase 3.5 A0 — ask_events source/eval_case_id + eval auth boundary
2026-04-17 08:11:06 +09:00
139_ask_events_source_created_idx.sql
feat(ask): Phase 3.5 A0 — ask_events source/eval_case_id + eval auth boundary
2026-04-17 08:11:06 +09:00
140_ask_events_eval_case_id_idx.sql
feat(ask): Phase 3.5 A0 — ask_events source/eval_case_id + eval auth boundary
2026-04-17 08:11:06 +09:00
141_ask_events_source_backfill.sql
feat(ask): Phase 3.5 A0 — ask_events source/eval_case_id + eval auth boundary
2026-04-17 08:11:06 +09:00
143_category.sql
fix(migrations): 143 asyncpg multi-statement 분리
2026-04-23 15:46:00 +09:00
144_documents_category_columns.sql
fix(migrations): 143 asyncpg multi-statement 분리
2026-04-23 15:46:00 +09:00
145_documents_category_idx.sql
fix(migrations): 143 asyncpg multi-statement 분리
2026-04-23 15:46:00 +09:00
146_documents_has_suggestion_idx.sql
fix(migrations): 143 asyncpg multi-statement 분리
2026-04-23 15:46:00 +09:00
147_audio_segments_table.sql
feat(media): §3 audio STT + video 재생 인프라
2026-04-24 06:47:36 +09:00
148_audio_segments_idx.sql
feat(media): §3 audio STT + video 재생 인프라
2026-04-24 06:47:36 +09:00
149_document_media_cols.sql
feat(media): §3 audio STT + video 재생 인프라
2026-04-24 06:47:36 +09:00
150_queue_stage_stt.sql
feat(media): §3 audio STT + video 재생 인프라
2026-04-24 06:47:36 +09:00
151_queue_stage_thumbnail.sql
feat(media): §3 audio STT + video 재생 인프라
2026-04-24 06:47:36 +09:00
152_category_law.sql
feat(category): law 카테고리 분리 — enum + backfill + classify skip
2026-04-24 09:14:56 +09:00
153_analyze_events_shadow.sql
fix(db): split migration 153 for asyncpg single-statement limit
2026-04-24 09:38:40 +09:00
154_analyze_events_shadow_idx_ts.sql
fix(db): split migration 153 for asyncpg single-statement limit
2026-04-24 09:38:40 +09:00
155_analyze_events_policy_violation_idx.sql
fix(db): split migration 153 for asyncpg single-statement limit
2026-04-24 09:38:40 +09:00
156_ai_analysis_cols.sql
feat(ai): B-1 summary tier 분할 — triage(4B) + deep_summary(26B)
2026-04-24 10:22:40 +09:00
157_queue_stage_deep_summary.sql
feat(ai): B-1 summary tier 분할 — triage(4B) + deep_summary(26B)
2026-04-24 10:22:40 +09:00
158_processing_queue_payload.sql
feat(ai): B-1 summary tier 분할 — triage(4B) + deep_summary(26B)
2026-04-24 10:22:40 +09:00
159_analyze_events_pr_b_tier.sql
feat(ai): B-1 summary tier 분할 — triage(4B) + deep_summary(26B)
2026-04-24 10:22:40 +09:00
160_analyze_events_pr_b_idx.sql
feat(ai): B-1 summary tier 분할 — triage(4B) + deep_summary(26B)
2026-04-24 10:22:40 +09:00
161_analyze_events_answerability.sql
feat(search): B-2 evidence LLM → 4B triage 전환 + answerability 컬럼
2026-04-24 10:33:32 +09:00
162_analyze_events_answerability_idx.sql
feat(search): B-2 evidence LLM → 4B triage 전환 + answerability 컬럼
2026-04-24 10:33:32 +09:00
163_memo_task_state.sql
fix(memo): bump migration number 161 → 163 (collision with PR-B 161/162)
2026-04-24 12:59:39 +09:00
164_study_sessions.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
165_study_sessions_idx_type_user.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
166_study_sessions_idx_cert.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
167_study_sessions_idx_lang.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
168_study_sessions_idx_review.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
169_study_sessions_idx_quiz.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
170_study_session_assets.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
171_study_session_assets_idx_session.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
172_study_session_assets_idx_document.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
173_study_session_assets_idx_type.sql
fix(study): split migration 164 into 10 single-statement files (asyncpg)
2026-04-27 08:18:40 +09:00
174_document_reads.sql
feat(library): 자료실 회독 카운트 추적 (PR-A backend)
2026-04-27 12:08:36 +09:00
175_document_reads_idx_user_doc.sql
feat(library): 자료실 회독 카운트 추적 (PR-A backend)
2026-04-27 12:08:36 +09:00
176_document_reads_idx_doc_time.sql
feat(library): 자료실 회독 카운트 추적 (PR-A backend)
2026-04-27 12:08:36 +09:00
177_document_notes.sql
feat(library): 자료별 손글씨 노트 (PR-D) — iPad 학습 시 옆에 필기
2026-04-27 12:38:03 +09:00
178_document_notes_idx.sql
feat(library): 자료별 손글씨 노트 (PR-D) — iPad 학습 시 옆에 필기
2026-04-27 12:38:03 +09:00
179_study_topics.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
180_study_topics_uq_active.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
181_study_topics_idx_user.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
182_study_sessions_topic_fk.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
183_study_sessions_topic_idx.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
184_study_topic_documents.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
185_study_topic_documents_idx_doc.sql
feat(study): study_topics 학습 워크스페이스 컨테이너 도입
2026-04-28 07:06:37 +09:00
186_study_questions.sql
feat(study): 문제은행 + 복습모드 (study_questions)
2026-04-28 08:00:37 +09:00
187_study_questions_idx_topic.sql
feat(study): 문제은행 + 복습모드 (study_questions)
2026-04-28 08:00:37 +09:00
188_study_question_attempts.sql
feat(study): 문제은행 + 복습모드 (study_questions)
2026-04-28 08:00:37 +09:00
189_study_question_attempts_idx_question.sql
feat(study): 문제은행 + 복습모드 (study_questions)
2026-04-28 08:00:37 +09:00
190_study_question_attempts_idx_user_topic.sql
feat(study): 문제은행 + 복습모드 (study_questions)
2026-04-28 08:00:37 +09:00
191_study_questions_ai_explanation.sql
feat(study): AI 풀이 생성 — 수동 트리거 + RAG (PR-3)
2026-04-28 08:41:46 +09:00
192_study_questions_ai_status_idx.sql
feat(study): AI 풀이 생성 — 수동 트리거 + RAG (PR-3)
2026-04-28 08:41:46 +09:00
193_study_questions_embedding.sql
feat(study): study_questions 자동 임베딩 (PR-4)
2026-04-28 08:54:02 +09:00
194_study_questions_embedding_idx.sql
feat(study): study_questions 자동 임베딩 (PR-4)
2026-04-28 08:54:02 +09:00
195_study_topic_exam_meta.sql
feat(study): 시험·회차·문항 관리 (PR-6)
2026-04-28 09:31:06 +09:00
196_study_questions_exam_qnum.sql
feat(study): 시험·회차·문항 관리 (PR-6)
2026-04-28 09:31:06 +09:00
197_study_questions_exam_round_idx.sql
feat(study): 시험·회차·문항 관리 (PR-6)
2026-04-28 09:31:06 +09:00
198_study_question_images.sql
fix(study): 마이그레이션 198 single-statement 분리 — 199_idx 추가
2026-04-28 13:44:59 +09:00
199_study_question_images_idx.sql
fix(study): 마이그레이션 198 single-statement 분리 — 199_idx 추가
2026-04-28 13:44:59 +09:00
200_attempts_outcome.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
201_attempts_outcome_backfill.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
202_attempts_selected_choice_nullable.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
203_attempts_outcome_not_null.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
204_study_topic_subject_notes.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
205_study_topic_subject_notes_uq.sql
feat(study): 문제풀이 모드 개편 + 결과 분류 + 분야 설명 (PR-9)
2026-04-28 15:58:35 +09:00
206_study_quiz_sessions.sql
feat(study): 문제풀이 세션 + 결과 카드 + 학습완료 체크 (PR-10)
2026-04-28 16:49:21 +09:00
207_study_quiz_sessions_active_uq.sql
feat(study): 문제풀이 세션 + 결과 카드 + 학습완료 체크 (PR-10)
2026-04-28 16:49:21 +09:00
208_attempts_quiz_session.sql
feat(study): 문제풀이 세션 + 결과 카드 + 학습완료 체크 (PR-10)
2026-04-28 16:49:21 +09:00
209_attempts_reviewed_at.sql
feat(study): 문제풀이 세션 + 결과 카드 + 학습완료 체크 (PR-10)
2026-04-28 16:49:21 +09:00
210_quiz_sessions_mode.sql
feat(study): 같은 유형 과밀 방지 — 출제 단계 spacing (PR-12-B)
2026-04-29 08:45:15 +09:00
211_md_columns.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
212_md_draft_status_check.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
213_md_status_pending_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
214_content_origin_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
215_md_frontmatter_gin_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
216_md_draft_status_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
217_document_lineage.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
218_lineage_source_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
219_lineage_derived_idx.sql
fix(canonical): split Phase 1A migrations into single-statement files (211-219)
2026-04-30 01:57:11 +00:00
220_study_q_related_cache.sql
feat(study): related-types DB 캐시 — HNSW 매번 재계산 제거
2026-05-01 07:22:31 +09:00
221_study_q_related_stale_idx.sql
feat(study): related-types DB 캐시 — HNSW 매번 재계산 제거
2026-05-01 07:22:31 +09:00
222_processing_queue_stage_markdown.sql
feat(canonical): Phase 1B marker-service + marker_worker for PDF→markdown (222)
2026-05-01 00:06:23 +00:00