KyeongminandClaude Opus 4.8
b836e79ee1
- src: phase_z2 composition/mapper/pipeline/placement_planner/retry, ai_fallback(prompts/schema/validate), mdx_text_atoms 신규 - Front: PipelineTracePanel 신규, FramePanel/SlideCanvas/Home/designAgentApi 등 갱신 + 테스트 4종 추가 - templates/phase_z2: catalog(component_expansion_registry, node_slot_mapping 신규), frames, families, slide_base 갱신 - tests/matching: phase2~26 매칭 실험 스크립트·리포트·온톨로지 전체 (미커밋 진행분) - tests: b4_v4 evidence, task5~28.5 시리즈, regression(imp95 baseline) 등 신규 테스트 대량 추가 - docs/reference: MDX 구조 인벤토리, MDX→Frame 구조 계약 문서 - scripts: mdx 계약/parity/coverage/viewport 체크, gitea comment, run sync 유틸 - .gitignore: tmp*.json, chromedriver, .orchestrator, *.pkl, Front_test* 등 임시/스냅샷 제외 미완성 작업의 보존용 스냅샷 커밋 (2026-07-02) Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
401 lines
15 KiB
HTML
401 lines
15 KiB
HTML
<!DOCTYPE html>
|
||
<html lang="ko">
|
||
<head>
|
||
<meta charset="UTF-8">
|
||
<title>Phase 7 — 2~3단계 파이프라인 검증</title>
|
||
|
||
<style>
|
||
body {
|
||
font-family: -apple-system, 'Segoe UI', 'Malgun Gothic', sans-serif;
|
||
max-width: 1800px;
|
||
margin: 0 auto;
|
||
padding: 24px;
|
||
line-height: 1.6;
|
||
color: #1e293b;
|
||
background: #f8fafc;
|
||
}
|
||
h1 { color: #1e293b; border-bottom: 3px solid #2563eb; padding-bottom: 12px; }
|
||
h2 {
|
||
color: #1a365d;
|
||
background: #e0e7ff;
|
||
padding: 10px 16px;
|
||
border-radius: 6px;
|
||
margin-top: 32px;
|
||
}
|
||
hr { border: none; border-top: 1px solid #cbd5e1; margin: 24px 0; }
|
||
table {
|
||
border-collapse: collapse;
|
||
width: 100%;
|
||
margin: 12px 0 24px;
|
||
background: #fff;
|
||
box-shadow: 0 2px 6px rgba(0,0,0,0.05);
|
||
}
|
||
th, td {
|
||
border: 1px solid #e2e8f0;
|
||
padding: 10px;
|
||
text-align: left;
|
||
vertical-align: top;
|
||
}
|
||
th {
|
||
background: #1e293b;
|
||
color: #fff;
|
||
font-weight: 700;
|
||
text-align: center;
|
||
width: 120px;
|
||
}
|
||
td:first-child {
|
||
background: #f1f5f9;
|
||
font-weight: 600;
|
||
text-align: center;
|
||
width: 120px;
|
||
}
|
||
td img {
|
||
max-width: 260px;
|
||
height: auto;
|
||
display: block;
|
||
margin: 0 auto 6px;
|
||
border: 1px solid #cbd5e1;
|
||
border-radius: 4px;
|
||
}
|
||
td br + strong { color: #2563eb; }
|
||
</style>
|
||
|
||
</head>
|
||
<body>
|
||
<h1>Phase 7 — 2~3단계 파이프라인 검증</h1>
|
||
<p><strong>한 줄 결론(사용자)</strong>: semantic 단독 승자 말고, Kiwi+BM25로 top-k 후보 → 청킹+SBERT나 Cross로 rerank → 필요시 구조 감점, 2~3단계 파이프라인으로.</p>
|
||
<p><strong>방향 3 — Kiwi+BM25 recall</strong>: Top-3 4/4, Top-5 4/4
|
||
(retriever 단계에서 정답이 후보군에 들어있는가 = 파이프라인 이론 상한)</p>
|
||
<h3>Kiwi+BM25 Top-5 후보 목록</h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>유닛</th>
|
||
<th>정답</th>
|
||
<th>Top-5 후보</th>
|
||
<th>정답 포함?</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>1. (MDX 1) 팝업 — DX와 BIM의 구분</td>
|
||
<td><strong>18</strong></td>
|
||
<td>18, 16, 17, 29, 24</td>
|
||
<td>✓</td>
|
||
</tr>
|
||
<tr>
|
||
<td>2. (MDX 2) 2.2 DX 시행 주체별 기대효과</td>
|
||
<td><strong>14</strong></td>
|
||
<td>14, 12, 29, 07, 08</td>
|
||
<td>✓</td>
|
||
</tr>
|
||
<tr>
|
||
<td>3. (MDX 03) 1. DX 시행을 위한 필수요건</td>
|
||
<td><strong>13</strong></td>
|
||
<td>15, 13, 16, 20, 18</td>
|
||
<td>✓</td>
|
||
</tr>
|
||
<tr>
|
||
<td>4. (MDX 03) 2. Process 혁신과 Product 변화</td>
|
||
<td><strong>29</strong></td>
|
||
<td>29, 12, 07, 18, 08</td>
|
||
<td>✓</td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
<h3>전략별 1순위 정답률 집계</h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>전략</th>
|
||
<th>MDX1 팝업(18)</th>
|
||
<th>MDX2 2.2(14)</th>
|
||
<th>MDX03-1(13)</th>
|
||
<th>MDX03-2(29)</th>
|
||
<th>합계</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>Kiwi+BM25 단독</td>
|
||
<td>✓</td>
|
||
<td>✓</td>
|
||
<td>✗(15)</td>
|
||
<td>✓</td>
|
||
<td><strong>3/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>Cross 단독</td>
|
||
<td>✗(24)</td>
|
||
<td>✓</td>
|
||
<td>✓</td>
|
||
<td>✗(16)</td>
|
||
<td><strong>2/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>청킹+SBERT 단독</td>
|
||
<td>✓</td>
|
||
<td>✗(07)</td>
|
||
<td>✗(15)</td>
|
||
<td>✓</td>
|
||
<td><strong>2/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → Cross rerank</td>
|
||
<td>✗(24)</td>
|
||
<td>✓</td>
|
||
<td>✓</td>
|
||
<td>✓</td>
|
||
<td><strong>3/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → 청킹+SBERT rerank</td>
|
||
<td>✓</td>
|
||
<td>✗(07)</td>
|
||
<td>✗(15)</td>
|
||
<td>✓</td>
|
||
<td><strong>2/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+Cross + 구조 감점(α=0.3)</td>
|
||
<td>✗(17)</td>
|
||
<td>✓</td>
|
||
<td>✗(16)</td>
|
||
<td>✗(18)</td>
|
||
<td><strong>1/4</strong></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+SBERT-청크 + 구조 감점</td>
|
||
<td>✗(17)</td>
|
||
<td>✗(07)</td>
|
||
<td>✗(18)</td>
|
||
<td>✗(18)</td>
|
||
<td><strong>0/4</strong></td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
<hr />
|
||
<h2>유닛별 전략 Top-3 상세</h2>
|
||
<h3>1. (MDX 1) 팝업 — DX와 BIM의 구분 — 정답 Frame <strong>18</strong></h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>전략</th>
|
||
<th>1순위</th>
|
||
<th>2순위</th>
|
||
<th>3순위</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>Kiwi+BM25 단독</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
<td><img alt="17" src="../../data/figma_previews/17.png" /><br><strong>17</strong><br>현황 및 문제점</td>
|
||
</tr>
|
||
<tr>
|
||
<td>Cross 단독</td>
|
||
<td><img alt="24" src="../../data/figma_previews/24.png" /><br><strong>24</strong><br>Engn. S/W의 구성 과…</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="10" src="../../data/figma_previews/10.png" /><br><strong>10</strong><br>현장 실효성 증대 위한 **…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>청킹+SBERT 단독</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="09" src="../../data/figma_previews/09.png" /><br><strong>09</strong><br>시공 전 모델 기반 시공상세…</td>
|
||
<td><img alt="25" src="../../data/figma_previews/25.png" /><br><strong>25</strong><br>3rd Party</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → Cross rerank</td>
|
||
<td><img alt="24" src="../../data/figma_previews/24.png" /><br><strong>24</strong><br>Engn. S/W의 구성 과…</td>
|
||
<td><img alt="17" src="../../data/figma_previews/17.png" /><br><strong>17</strong><br>현황 및 문제점</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → 청킹+SBERT rerank</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="24" src="../../data/figma_previews/24.png" /><br><strong>24</strong><br>Engn. S/W의 구성 과…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+Cross + 구조 감점(α=0.3)</td>
|
||
<td><img alt="17" src="../../data/figma_previews/17.png" /><br><strong>17</strong><br>현황 및 문제점</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+SBERT-청크 + 구조 감점</td>
|
||
<td><img alt="17" src="../../data/figma_previews/17.png" /><br><strong>17</strong><br>현황 및 문제점</td>
|
||
<td>⭐ <img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
<h3>2. (MDX 2) 2.2 DX 시행 주체별 기대효과 — 정답 Frame <strong>14</strong></h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>전략</th>
|
||
<th>1순위</th>
|
||
<th>2순위</th>
|
||
<th>3순위</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>Kiwi+BM25 단독</td>
|
||
<td>⭐ <img alt="14" src="../../data/figma_previews/14.png" /><br><strong>14</strong><br></td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>Cross 단독</td>
|
||
<td>⭐ <img alt="14" src="../../data/figma_previews/14.png" /><br><strong>14</strong><br></td>
|
||
<td><img alt="23" src="../../data/figma_previews/23.png" /><br><strong>23</strong><br>Application S/W…</td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
</tr>
|
||
<tr>
|
||
<td>청킹+SBERT 단독</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="09" src="../../data/figma_previews/09.png" /><br><strong>09</strong><br>시공 전 모델 기반 시공상세…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → Cross rerank</td>
|
||
<td>⭐ <img alt="14" src="../../data/figma_previews/14.png" /><br><strong>14</strong><br></td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="08" src="../../data/figma_previews/08.png" /><br><strong>08</strong><br>효율적인 정보의 관리와 활용</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → 청킹+SBERT rerank</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="08" src="../../data/figma_previews/08.png" /><br><strong>08</strong><br>효율적인 정보의 관리와 활용</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+Cross + 구조 감점(α=0.3)</td>
|
||
<td>⭐ <img alt="14" src="../../data/figma_previews/14.png" /><br><strong>14</strong><br></td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="08" src="../../data/figma_previews/08.png" /><br><strong>08</strong><br>효율적인 정보의 관리와 활용</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+SBERT-청크 + 구조 감점</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="08" src="../../data/figma_previews/08.png" /><br><strong>08</strong><br>효율적인 정보의 관리와 활용</td>
|
||
<td><img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
<h3>3. (MDX 03) 1. DX 시행을 위한 필수요건 — 정답 Frame <strong>13</strong></h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>전략</th>
|
||
<th>1순위</th>
|
||
<th>2순위</th>
|
||
<th>3순위</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>Kiwi+BM25 단독</td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
<td>⭐ <img alt="13" src="../../data/figma_previews/13.png" /><br><strong>13</strong><br>필수조건</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
</tr>
|
||
<tr>
|
||
<td>Cross 단독</td>
|
||
<td>⭐ <img alt="13" src="../../data/figma_previews/13.png" /><br><strong>13</strong><br>필수조건</td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
<td><img alt="17" src="../../data/figma_previews/17.png" /><br><strong>17</strong><br>현황 및 문제점</td>
|
||
</tr>
|
||
<tr>
|
||
<td>청킹+SBERT 단독</td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
<td>⭐ <img alt="13" src="../../data/figma_previews/13.png" /><br><strong>13</strong><br>필수조건</td>
|
||
<td><img alt="20" src="../../data/figma_previews/20.png" /><br><strong>20</strong><br>디지털 전환(DX)은 S/W…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → Cross rerank</td>
|
||
<td>⭐ <img alt="13" src="../../data/figma_previews/13.png" /><br><strong>13</strong><br>필수조건</td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
<td><img alt="20" src="../../data/figma_previews/20.png" /><br><strong>20</strong><br>디지털 전환(DX)은 S/W…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → 청킹+SBERT rerank</td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
<td>⭐ <img alt="13" src="../../data/figma_previews/13.png" /><br><strong>13</strong><br>필수조건</td>
|
||
<td><img alt="20" src="../../data/figma_previews/20.png" /><br><strong>20</strong><br>디지털 전환(DX)은 S/W…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+Cross + 구조 감점(α=0.3)</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="20" src="../../data/figma_previews/20.png" /><br><strong>20</strong><br>디지털 전환(DX)은 S/W…</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+SBERT-청크 + 구조 감점</td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
<td><img alt="15" src="../../data/figma_previews/15.png" /><br><strong>15</strong><br>정책목표</td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
<h3>4. (MDX 03) 2. Process 혁신과 Product 변화 — 정답 Frame <strong>29</strong></h3>
|
||
<table>
|
||
<thead>
|
||
<tr>
|
||
<th>전략</th>
|
||
<th>1순위</th>
|
||
<th>2순위</th>
|
||
<th>3순위</th>
|
||
</tr>
|
||
</thead>
|
||
<tbody>
|
||
<tr>
|
||
<td>Kiwi+BM25 단독</td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
</tr>
|
||
<tr>
|
||
<td>Cross 단독</td>
|
||
<td><img alt="16" src="../../data/figma_previews/16.png" /><br><strong>16</strong><br></td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
</tr>
|
||
<tr>
|
||
<td>청킹+SBERT 단독</td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
<td><img alt="30" src="../../data/figma_previews/30.png" /><br><strong>30</strong><br>산업별 현황</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → Cross rerank</td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25 top5 → 청킹+SBERT rerank</td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+Cross + 구조 감점(α=0.3)</td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
<td><img alt="12" src="../../data/figma_previews/12.png" /><br><strong>12</strong><br>건설산업의 목표 (BIM의 …</td>
|
||
</tr>
|
||
<tr>
|
||
<td>BM25+SBERT-청크 + 구조 감점</td>
|
||
<td><img alt="18" src="../../data/figma_previews/18.png" /><br><strong>18</strong><br>BIM과 DX의 이해</td>
|
||
<td>⭐ <img alt="29" src="../../data/figma_previews/29.png" /><br><strong>29</strong><br>좌측 배너 과정 (Proce…</td>
|
||
<td><img alt="07" src="../../data/figma_previews/07.png" /><br><strong>07</strong><br></td>
|
||
</tr>
|
||
</tbody>
|
||
</table>
|
||
</body>
|
||
</html>
|