Kyeongmin/C.E.L_Slide_test2
1
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
4d7c4017799235e169e9b27ec65d52cf69096ba0
C.E.L_Slide_test2/tests/matching/RESULT.md
T
KyeongminandClaude Opus 4.8 b836e79ee1 wip: phase_z2 evidence 파이프라인 + matching 실험(phase2~26) + 프론트 trace 패널 진행분 스냅샷 
- src: phase_z2 composition/mapper/pipeline/placement_planner/retry, ai_fallback(prompts/schema/validate), mdx_text_atoms 신규
- Front: PipelineTracePanel 신규, FramePanel/SlideCanvas/Home/designAgentApi 등 갱신 + 테스트 4종 추가
- templates/phase_z2: catalog(component_expansion_registry, node_slot_mapping 신규), frames, families, slide_base 갱신
- tests/matching: phase2~26 매칭 실험 스크립트·리포트·온톨로지 전체 (미커밋 진행분)
- tests: b4_v4 evidence, task5~28.5 시리즈, regression(imp95 baseline) 등 신규 테스트 대량 추가
- docs/reference: MDX 구조 인벤토리, MDX→Frame 구조 계약 문서
- scripts: mdx 계약/parity/coverage/viewport 체크, gitea comment, run sync 유틸
- .gitignore: tmp*.json, chromedriver, .orchestrator, *.pkl, Front_test* 등 임시/스냅샷 제외

미완성 작업의 보존용 스냅샷 커밋 (2026-07-02)

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-02 17:03:42 +09:00

5.6 KiB
Raw Blame History

MDX ↔ Figma 매칭 방법 비교 결과

테스트 셋: MDX 01~03의 ## 중목차 7개 섹션 Figma 프레임 32개 중 매칭 비교 방법 8개

1. Ground Truth

섹션 ID MDX 섹션 Primary Secondary 확신도
MDX01-intro 용어의 혼용 (intro) null - high
MDX01-1 1. 용어 정의 null 1171281189 medium
MDX01-2 2. 용어간 상호관계 1171281195 - very_high
MDX02-1 1. DX의 궁극적 목표 1171281189 1171281191 high
MDX02-2 2. DX 기반 Process 혁신에 따른 주체별 기대효과 1171281191 1171281189 very_high
MDX03-1 1. DX 시행을 위한 필수 요건 1171281190 1171281192 very_high
MDX03-2 2. Process의 혁신과 Product의 변화 1171281210 - very_high

2. 메인 매트릭스 — 각 방법의 Top-1

방법 M01-intro M01-1 M01-2 M02-1 M02-2 M03-1 M03-2
GT null null 1171281195 1171281189 1171281191 1171281190 1171281210
1. TF-IDF ·208 (0.26) ·208 (0.18) ✅195 (0.87) ✅189 (0.49) ✅191 (0.52) ◯192 (0.56) ✅210 (0.65)
2. BM25 ·198 (17.46) ·210 (18.72) ✅195 (148.67) ✅189 (37.81) ✅191 (95.54) ◯192 (64.40) ✅210 (89.60)
3. Char 2~3gram ·210 (0.04) ·210 (0.06) ✅195 (0.40) ✅189 (0.18) ✅191 (0.17) ◯192 (0.21) ✅210 (0.29)
4. Kiwi+BM25 ·198 (27.06) ·210 (26.64) ✅195 (157.73) ✅189 (52.89) ✅191 (125.30) ◯192 (90.19) ✅210 (103.37)
5. Structural ·173 (0.58) ·173 (0.57) ✗194 (0.83) ✗173 (0.61) ✗194 (0.91) ✗173 (0.17) ✗205 (0.50)
6. AI-Metadata ·198 (0.20) ·208 (0.21) ✅195 (1.00) ✅189 (0.37) ✅191 (0.42) ✅190 (0.73) ✅210 (0.69)
7. Weighted (BM25+CNG) ·198 (0.94) ·210 (1.00) ✅195 (1.00) ✅189 (1.00) ✅191 (1.00) ◯192 (1.00) ✅210 (1.00)
8. HardFilter+BM25 ·198 (17.15) ·210 (18.72) ✅195 (148.67) ✅189 (37.55) ✅191 (95.54) ✗178 (8.60) ✗211 (14.95)

✅ primary 일치 · ◯ secondary 일치 · ✗ 불일치 · · GT null

3. Top-3 분석 (명확 매칭 5개 섹션만)

1. TF-IDF

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (0.87) 210 (0.15) 193 (0.14)
MDX02-1 189 (0.49) 191 (0.38) 210 (0.20)
MDX02-2 191 (0.52) 189 (0.32) 210 (0.23)
MDX03-1 192 (0.56) 190 (0.30) 198 (0.17)
MDX03-2 210 (0.65) 189 (0.19) 180 (0.14)

2. BM25

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (148.67) 210 (27.44) 193 (23.16)
MDX02-1 189 (37.81) 191 (25.15) 210 (18.95)
MDX02-2 191 (95.54) 189 (56.78) 210 (52.91)
MDX03-1 192 (64.40) 190 (36.52) 198 (20.77)
MDX03-2 210 (89.60) 189 (28.37) 211 (16.31)

3. Char 2~3gram

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (0.40) 210 (0.06) 211 (0.05)
MDX02-1 189 (0.18) 210 (0.07) 191 (0.07)
MDX02-2 191 (0.17) 210 (0.07) 189 (0.07)
MDX03-1 192 (0.21) 190 (0.09) 210 (0.05)
MDX03-2 210 (0.29) 189 (0.08) 192 (0.05)

4. Kiwi+BM25

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (157.73) 193 (64.48) 210 (56.75)
MDX02-1 189 (52.89) 191 (35.12) 210 (26.77)
MDX02-2 191 (125.30) 210 (83.62) 189 (80.24)
MDX03-1 192 (90.19) 190 (45.26) 193 (31.24)
MDX03-2 210 (103.37) 189 (39.52) 178 (33.84)

5. Structural

섹션 Top-1 Top-2 Top-3
MDX01-2 194 (0.83) 198 (0.83) 175 (0.65)
MDX02-1 173 (0.61) 203 (0.56) 204 (0.56)
MDX02-2 194 (0.91) 198 (0.75) 177 (0.66)
MDX03-1 173 (0.17) 175 (0.16) 179 (0.16)
MDX03-2 205 (0.50) 206 (0.50) 173 (0.46)

6. AI-Metadata

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (1.00) 198 (0.20) 175 (0.18)
MDX02-1 189 (0.37) 192 (0.17) 179 (0.13)
MDX02-2 191 (0.42) 174 (0.13) 177 (0.13)
MDX03-1 190 (0.73) 208 (0.18) 198 (0.13)
MDX03-2 210 (0.69) 180 (0.16) 201 (0.16)

7. Weighted (BM25+CNG)

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (1.00) 210 (0.15) 211 (0.13)
MDX02-1 189 (1.00) 191 (0.51) 210 (0.44)
MDX02-2 191 (1.00) 189 (0.48) 210 (0.47)
MDX03-1 192 (1.00) 190 (0.49) 198 (0.24)
MDX03-2 210 (1.00) 189 (0.29) 192 (0.16)

8. HardFilter+BM25

섹션 Top-1 Top-2 Top-3
MDX01-2 195 (148.67) 210 (27.44) 193 (23.16)
MDX02-1 189 (37.55) 191 (24.92) 210 (18.80)
MDX02-2 191 (95.54) 189 (56.78) 210 (52.91)
MDX03-1 178 (8.60) 174 (6.35) 197 (5.51)
MDX03-2 211 (14.95) 195 (14.61) 194 (10.90)

4. 지표 요약

방법 Hit@1 Hit@3 MRR 명확5개 맞춤
1. TF-IDF 0.80 1.00 0.900 4/5
2. BM25 0.80 1.00 0.900 4/5
3. Char 2~3gram 0.80 1.00 0.900 4/5
4. Kiwi+BM25 0.80 1.00 0.900 4/5
5. Structural 0.00 0.00 0.056 0/5
6. AI-Metadata 1.00 1.00 1.000 5/5
7. Weighted (BM25+CNG) 0.80 1.00 0.900 4/5
8. HardFilter+BM25 0.60 0.60 0.620 3/5

5. 권고

  • 최고 Hit@1 방법: 6. AI-Metadata (Hit@1=1.00)
  • 최고 MRR 방법: 6. AI-Metadata (MRR=1.000)

(상세 분석은 메인 매트릭스와 Top-3 참고)

Reference in New Issue View Git Blame Copy Permalink