442 lines
11 KiB
YAML
442 lines
11 KiB
YAML
meta:
|
|
pipeline_step: 8.v2
|
|
description: V1 Top-K 후보를 ko-sroberta cosine 으로 재정렬 (캐스케이드 rerank 1단)
|
|
model: jhgan/ko-sroberta-multitask
|
|
similarity: cosine
|
|
top_k: 5
|
|
mdx_summary_spec: title + 첫 일반 문단(≤120자) + slot label Top-5 join (detect_mdx.build_summary)
|
|
frame_source: analysis.md "내용" 섹션 (phase_common.load_32_frames)
|
|
v1_source: mdx_matching_result.yaml rank_by_matching_score
|
|
holdout_sections:
|
|
- 01-1
|
|
- 02-1
|
|
- 02-2.1
|
|
answer_map:
|
|
01-2: 18
|
|
02-2.2: 14
|
|
03-1: 13
|
|
03-2: 29
|
|
lock_snapshot:
|
|
timestamp: '2026-04-24T07:44:36'
|
|
model: jhgan/ko-sroberta-multitask
|
|
top_k: 5
|
|
files:
|
|
pipeline_08_v2_semantic_rerank.py: 87f0873dde540acaf4944f2e95a3d02dac7e6f6da5e7880bbe393120cce47190
|
|
embeddings.py: acc50f3f93935061fb146c3b15e30bc9734b4c96c53f82a603bc758944b50c9c
|
|
detect_mdx.py: aaf18b89aeb7bebb7c206348ef7a61d560999c4234ce28df070c24701c96227a
|
|
phase_common.py: b778840c8e246d0e5210359263e4a59ef6acfa6f3c9a8a1cc110f18506cc4f94
|
|
pipeline_01_extract_nodes.py: d31dec9c25bda9a893caa7121fe79b1f0f7e533f32d83743d04abb36f5e6a343
|
|
synonyms.yaml: 57bbc60d0ca8a95c445e3e0acf1af4e1cff101957ae8c1759311ec827c961893
|
|
mdx_matching_result.yaml: 2796504d30966f85492f3fad826f223969bba8fd5ee6e6ab21b56444527472c8
|
|
principle:
|
|
- V1 baseline 고정 — 재정렬 대상만 Top-K 로 한정
|
|
- 가중합 금지 — 순수 semantic rerank
|
|
- Holdout 성적을 설계 근거로 사용하지 않음
|
|
mdx_sections:
|
|
01-2:
|
|
section_type: target
|
|
answer_frame_number: 18
|
|
mdx_title: 2. 용어간 상호관계
|
|
mdx_summary: 2. 용어간 상호관계. . DX / BIM
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281195'
|
|
frame_number: 18
|
|
v1_score: 0.937
|
|
- rank: 2
|
|
frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_score: 0.392
|
|
- rank: 3
|
|
frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_score: 0.379
|
|
- rank: 4
|
|
frame_id: '1171281172'
|
|
frame_number: 1
|
|
v1_score: 0.362
|
|
- rank: 5
|
|
frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_score: 0.358
|
|
v2_rerank:
|
|
- frame_id: '1171281195'
|
|
frame_number: 18
|
|
v1_rank: 1
|
|
v1_score: 0.937
|
|
semantic_score: 0.7295
|
|
v2_rank: 1
|
|
- frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_rank: 2
|
|
v1_score: 0.392
|
|
semantic_score: 0.6442
|
|
v2_rank: 2
|
|
- frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_rank: 3
|
|
v1_score: 0.379
|
|
semantic_score: 0.5853
|
|
v2_rank: 3
|
|
- frame_id: '1171281172'
|
|
frame_number: 1
|
|
v1_rank: 4
|
|
v1_score: 0.362
|
|
semantic_score: 0.5741
|
|
v2_rank: 4
|
|
- frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_rank: 5
|
|
v1_score: 0.358
|
|
semantic_score: 0.5556
|
|
v2_rank: 5
|
|
02-2.2:
|
|
section_type: target
|
|
answer_frame_number: 14
|
|
mdx_title: 2.2 DX 시행 주체별 기대효과
|
|
mdx_summary: 2.2 DX 시행 주체별 기대효과. DX 시행 주체별 기대효과
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281191'
|
|
frame_number: 14
|
|
v1_score: 0.84
|
|
- rank: 2
|
|
frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_score: 0.495
|
|
- rank: 3
|
|
frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_score: 0.459
|
|
- rank: 4
|
|
frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_score: 0.411
|
|
- rank: 5
|
|
frame_id: '1171281176'
|
|
frame_number: 5
|
|
v1_score: 0.404
|
|
v2_rerank:
|
|
- frame_id: '1171281191'
|
|
frame_number: 14
|
|
v1_rank: 1
|
|
v1_score: 0.84
|
|
semantic_score: 0.6416
|
|
v2_rank: 1
|
|
- frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_rank: 3
|
|
v1_score: 0.459
|
|
semantic_score: 0.4858
|
|
v2_rank: 2
|
|
- frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_rank: 4
|
|
v1_score: 0.411
|
|
semantic_score: 0.4471
|
|
v2_rank: 3
|
|
- frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_rank: 2
|
|
v1_score: 0.495
|
|
semantic_score: 0.3861
|
|
v2_rank: 4
|
|
- frame_id: '1171281176'
|
|
frame_number: 5
|
|
v1_rank: 5
|
|
v1_score: 0.404
|
|
semantic_score: 0.3762
|
|
v2_rank: 5
|
|
03-1:
|
|
section_type: target
|
|
answer_frame_number: 13
|
|
mdx_title: 1. DX 시행을 위한 필수 요건
|
|
mdx_summary: 1. DX 시행을 위한 필수 요건. 기술 / 사람 / 자연
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281190'
|
|
frame_number: 13
|
|
v1_score: 0.598
|
|
- rank: 2
|
|
frame_id: '1171281192'
|
|
frame_number: 15
|
|
v1_score: 0.542
|
|
- rank: 3
|
|
frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_score: 0.388
|
|
- rank: 4
|
|
frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_score: 0.363
|
|
- rank: 5
|
|
frame_id: '1171281197'
|
|
frame_number: 19
|
|
v1_score: 0.269
|
|
v2_rerank:
|
|
- frame_id: '1171281190'
|
|
frame_number: 13
|
|
v1_rank: 1
|
|
v1_score: 0.598
|
|
semantic_score: 0.634
|
|
v2_rank: 1
|
|
- frame_id: '1171281192'
|
|
frame_number: 15
|
|
v1_rank: 2
|
|
v1_score: 0.542
|
|
semantic_score: 0.5959
|
|
v2_rank: 2
|
|
- frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_rank: 3
|
|
v1_score: 0.388
|
|
semantic_score: 0.5188
|
|
v2_rank: 3
|
|
- frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_rank: 4
|
|
v1_score: 0.363
|
|
semantic_score: 0.4577
|
|
v2_rank: 4
|
|
- frame_id: '1171281197'
|
|
frame_number: 19
|
|
v1_rank: 5
|
|
v1_score: 0.269
|
|
semantic_score: 0.4209
|
|
v2_rank: 5
|
|
03-2:
|
|
section_type: target
|
|
answer_frame_number: 29
|
|
mdx_title: 2. Process의 혁신과 Product의 변화
|
|
mdx_summary: 2. Process의 혁신과 Product의 변화. 과정 / 결과
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281210'
|
|
frame_number: 29
|
|
v1_score: 0.705
|
|
- rank: 2
|
|
frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_score: 0.521
|
|
- rank: 3
|
|
frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_score: 0.426
|
|
- rank: 4
|
|
frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_score: 0.42
|
|
- rank: 5
|
|
frame_id: '1171281179'
|
|
frame_number: 8
|
|
v1_score: 0.383
|
|
v2_rerank:
|
|
- frame_id: '1171281210'
|
|
frame_number: 29
|
|
v1_rank: 1
|
|
v1_score: 0.705
|
|
semantic_score: 0.5991
|
|
v2_rank: 1
|
|
- frame_id: '1171281179'
|
|
frame_number: 8
|
|
v1_rank: 5
|
|
v1_score: 0.383
|
|
semantic_score: 0.4832
|
|
v2_rank: 2
|
|
- frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_rank: 4
|
|
v1_score: 0.42
|
|
semantic_score: 0.465
|
|
v2_rank: 3
|
|
- frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_rank: 2
|
|
v1_score: 0.521
|
|
semantic_score: 0.4395
|
|
v2_rank: 4
|
|
- frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_rank: 3
|
|
v1_score: 0.426
|
|
semantic_score: 0.3975
|
|
v2_rank: 5
|
|
01-1:
|
|
section_type: holdout
|
|
answer_frame_number: null
|
|
mdx_title: 1. 용어 정의
|
|
mdx_summary: '1. 용어 정의. fontSize: ''0.8rem'',. 건설산업 / BIM / DX'
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281172'
|
|
frame_number: 1
|
|
v1_score: 0.551
|
|
- rank: 2
|
|
frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_score: 0.298
|
|
- rank: 3
|
|
frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_score: 0.249
|
|
- rank: 4
|
|
frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_score: 0.248
|
|
- rank: 5
|
|
frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_score: 0.238
|
|
v2_rerank:
|
|
- frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_rank: 2
|
|
v1_score: 0.298
|
|
semantic_score: 0.5881
|
|
v2_rank: 1
|
|
- frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_rank: 3
|
|
v1_score: 0.249
|
|
semantic_score: 0.5507
|
|
v2_rank: 2
|
|
- frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_rank: 4
|
|
v1_score: 0.248
|
|
semantic_score: 0.547
|
|
v2_rank: 3
|
|
- frame_id: '1171281172'
|
|
frame_number: 1
|
|
v1_rank: 1
|
|
v1_score: 0.551
|
|
semantic_score: 0.5368
|
|
v2_rank: 4
|
|
- frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_rank: 5
|
|
v1_score: 0.238
|
|
semantic_score: 0.5005
|
|
v2_rank: 5
|
|
02-1:
|
|
section_type: holdout
|
|
answer_frame_number: null
|
|
mdx_title: 1. DX의 궁극적 목표
|
|
mdx_summary: 1. DX의 궁극적 목표. . 안전과 품질 / 생산성 향상 / 소통과 신뢰
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_score: 0.766
|
|
- rank: 2
|
|
frame_id: '1171281191'
|
|
frame_number: 14
|
|
v1_score: 0.382
|
|
- rank: 3
|
|
frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_score: 0.356
|
|
- rank: 4
|
|
frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_score: 0.302
|
|
- rank: 5
|
|
frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_score: 0.237
|
|
v2_rerank:
|
|
- frame_id: '1171281198'
|
|
frame_number: 20
|
|
v1_rank: 5
|
|
v1_score: 0.237
|
|
semantic_score: 0.5895
|
|
v2_rank: 1
|
|
- frame_id: '1171281191'
|
|
frame_number: 14
|
|
v1_rank: 2
|
|
v1_score: 0.382
|
|
semantic_score: 0.5779
|
|
v2_rank: 2
|
|
- frame_id: '1171281189'
|
|
frame_number: 12
|
|
v1_rank: 1
|
|
v1_score: 0.766
|
|
semantic_score: 0.57
|
|
v2_rank: 3
|
|
- frame_id: '1171281208'
|
|
frame_number: 27
|
|
v1_rank: 3
|
|
v1_score: 0.356
|
|
semantic_score: 0.5467
|
|
v2_rank: 4
|
|
- frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_rank: 4
|
|
v1_score: 0.302
|
|
semantic_score: 0.4707
|
|
v2_rank: 5
|
|
02-2.1:
|
|
section_type: holdout
|
|
answer_frame_number: null
|
|
mdx_title: 2.1 업무 수행 과정(Process)의 변화
|
|
mdx_summary: 2.1 업무 수행 과정(Process)의 변화. 업무 수행 과정
|
|
top_k: 5
|
|
v1_top_k:
|
|
- rank: 1
|
|
frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_score: 0.246
|
|
- rank: 2
|
|
frame_id: '1171281179'
|
|
frame_number: 8
|
|
v1_score: 0.193
|
|
- rank: 3
|
|
frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_score: 0.184
|
|
- rank: 4
|
|
frame_id: '1171281210'
|
|
frame_number: 29
|
|
v1_score: 0.176
|
|
- rank: 5
|
|
frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_score: 0.171
|
|
v2_rerank:
|
|
- frame_id: '1171281210'
|
|
frame_number: 29
|
|
v1_rank: 4
|
|
v1_score: 0.176
|
|
semantic_score: 0.5511
|
|
v2_rank: 1
|
|
- frame_id: '1171281179'
|
|
frame_number: 8
|
|
v1_rank: 2
|
|
v1_score: 0.193
|
|
semantic_score: 0.5021
|
|
v2_rank: 2
|
|
- frame_id: '1171281174'
|
|
frame_number: 3
|
|
v1_rank: 3
|
|
v1_score: 0.184
|
|
semantic_score: 0.4648
|
|
v2_rank: 3
|
|
- frame_id: '1171281182'
|
|
frame_number: 11
|
|
v1_rank: 1
|
|
v1_score: 0.246
|
|
semantic_score: 0.4311
|
|
v2_rank: 4
|
|
- frame_id: '1171281180'
|
|
frame_number: 9
|
|
v1_rank: 5
|
|
v1_score: 0.171
|
|
semantic_score: 0.4191
|
|
v2_rank: 5
|