kimminsung/recordingtest
1
0
Fork 0
Code Issues 3 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
70bf5703b32863a87b32355429b51697086e3f71
recordingtest/PROGRESS.md
minsung 70bf5703b3 player: raw scenario replay without manual cleanup (#14) 
First time box-v6.yaml (raw recorder output, 676 lines) replays end-to-end
and actually creates a Box in the SUT — no AI post-editing of target paths
or offsets required. This is the counterpart to #13's recorder-side fixes:
the player now absorbs the remaining record→replay gaps instead of demanding
a hand-cleaned scenario.

Changes (all in Recordingtest.Player):

- PlayerEngine: null-target fallbacks
  - Type with null target → host.Type() against current focus
  - Click with null target + raw_coord → click at screen-absolute raw_coord
  - Other null targets still skipped
- PlayerEngine: strip leading alt+tab hotkey steps (recording-startup noise
  that fights the player's own foreground switch)
- PlayerEngine: preserve recorded inter-step timing, clamped 150ms–3s,
  routed through new IPlayerHost.Delay so the engine itself stays Sleep-free
  (keeps the existing "no fixed sleep" DoD test passing)
- PlayerEngine: per-step console log for live debugging
- UiaPlayerHost: BringSutToForeground() — SetForeground + Focus + 600ms
  settle, called from Program.cs before engine.Run
- Step model: add RawCoord (int[]) and Ts (long?) fields, auto-mapped from
  YAML raw_coord / ts keys

Tests updated:
- PlayerEngine_NullTarget_SkipsWithoutCalling → _Fallback_Issue14
  (verifies the new Click-with-raw_coord and Type behavior)
- FakePlayerHost (both player.tests and runner.tests) implement Delay

Live smoke: box-v6.yaml raw replay produced the expected Box geometry on
the 2nd attempt; 1st attempt dropped the initial "BOX" keystrokes, tracked
as a follow-up (foreground settle is still threshold-sensitive at 600ms).

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-08 19:26:41 +09:00

5.9 KiB
Raw Blame History

PROGRESS.md — recordingtest

에이전트 간 공유 메모리. 세션 시작 시 PLAN.md와 함께 반드시 읽을 것. 작업 상태만 기록한다. 결정의 근거는 docs/history/, 전략은 CLAUDE.md / 메모리 참조.

저장소: https://gitea.hmac.kr/kimminsung/recordingtest SUT: EG-BIM Modeler/ (git 제외, 로컬 동봉) 현재 이슈: #2 컨텍스트 엔지니어링 & AI 개발환경 셋업

Done

날짜 항목 산출물
2026-04-07 히스토리 훅 설정 docs/history/2026-04-07_히스토리-훅-설정.md
2026-04-07 이슈 #2 리서치 & 에이전트 분해 메모리 project_recordingtest_plan.md
2026-04-07 구현 고려사항 정리 (8개 카테고리) 히스토리
2026-04-07 Golden-file 회귀 전략 채택 메모리 project_recordingtest_strategy.md
2026-04-07 CLAUDE.md 초안 + §0 협업 규칙 CLAUDE.md
2026-04-07 SUT(EG-BIM Modeler) 정적 분석 메모리 project_sut_egbim_modeler.md
2026-04-07 .claude/ agents·commands·skills·hooks 셋업 .claude/
2026-04-07 Harness design 채택 (Planner/Generator/Evaluator) CLAUDE.md §0.1, .claude/agents/planner.md, evaluator.md
2026-04-07 SUT 폴더 .gitignore .gitignore
2026-04-07 초기 Sprint Contracts 5건 작성 docs/contracts/*.md
2026-04-07 SUT 카탈로그 v0 (정적) docs/sut-catalog/catalog.md, plugins.md
2026-04-07 솔루션 스캐폴드(sut-prober PoC 타깃) recordingtest.sln, src/Recordingtest.SutProber/
2026-04-07 sut-prober PoC 구현 (Generator) src/Recordingtest.SutProber/, docs/sut-catalog/{plugins,json-configs,assemblies}.json
2026-04-07 sut-prober PoC Evaluator pass (#3) docs/contracts/sut-prober.evaluation.md
2026-04-07 diff-reporter PoC + Evaluator pass (#5) src/Recordingtest.DiffReporter*/, docs/contracts/diff-reporter.evaluation.md
2026-04-07 normalizer PoC + Evaluator pass v2 (#4) — sidecar log, explicit coverage mapping, 6 rules src/Recordingtest.Normalizer/, docs/contracts/normalizer.evaluation.md
2026-04-07 player PoC + Evaluator pass (#7) — 6 tests, no fixed sleeps, fake host src/Recordingtest.Player/, docs/contracts/player.evaluation.md
2026-04-07 recorder PoC + Evaluator pass v2 (#6) — drag state machine, focus events, ts/raw_coord src/Recordingtest.Recorder/, docs/contracts/recorder.evaluation.md
2026-04-07 test-runner PoC + Evaluator pass (#8) — 5-module E2E 파이프라인, 6 tests, DI src/Recordingtest.Runner/, docs/contracts/test-runner.evaluation.md
2026-04-07 engine-bridge PoC v1 + Evaluator pass (#9) — 정적 분석, HmEG 내부 후보 8000+, API 초안 src/Recordingtest.EngineBridge*/, docs/engine-catalog/, docs/engine-bridge-probe-design.md
2026-04-07 engine-bridge v2 + Evaluator pass (#10) — MEF plugin masquerade, HttpListener, HmEgHttpSnapshot, 11 tests src/Recordingtest.EgPlugin/, src/Recordingtest.EngineBridge.Client/, docs/guides/engine-bridge-deploy.md
2026-04-07 라이브 SUT smoke test 가이드 작성 docs/guides/smoke-test.md
2026-04-07 Smoke test 1회차 — integration gap 4개 발견 (recorder target null, VK 코드, player enum, null guard) scenarios/box-create.yaml
2026-04-07 Smoke gap fix + Evaluator pass (#11) — STAThread, KeyTranslator, 60 tests, regression trap 검증 commit 139fbbc
2026-04-07 Smoke test 1회차 — recorder PID attach + UIA target 정상 (box-v4), player 재생 부분 실패 docs/history/2026-04-07_smoke-1회차-결과.md, scenarios/box-v4*.yaml
2026-04-07 Smoke 2차 gap fix + Evaluator pass (#12) — full-path resolver, type target inheritance, window filter, UTF-8 BOM-less, 71 tests commit 8784fec
2026-04-07 sut-prober snake_case + scaffolding review 1회차 commit 0f0324e
2026-04-07 normalizer follow-ups + Evaluator pass — float epsilon 구성화 + JSON-path 마스크 스코핑, 77 tests commit eeee3c2
2026-04-08 Smoke test 2회차 — 첫 E2E 성공 🎉 Box geometry 생성 확인 docs/history/2026-04-08_smoke-2회차-첫-e2e-성공.md, scenarios/box-v5*.yaml
2026-04-08 이슈 #13 Gap E/F/G fix — HotkeyParseTests + FocusEventFilter + WindowPointResolver, 94 tests docs/history/2026-04-08_이슈13-smoke3-fix-generator.md
2026-04-08 이슈 #14 Raw 시나리오 E2E 성공 🎉 수동 cleanup 없이 box-v6.yaml 재생으로 Box 생성 player: null-target fallback + foreground switch + leading alt+tab strip + timing preservation, 24 player tests

In progress

(없음)

Follow-ups

  • sut-prober JSON naming snake_case — commit 0f0324e
  • normalizer: mask_volatile_settings JSON-path 스코핑 — commit eeee3c2
  • normalizer: float epsilon 구성화 — commit eeee3c2
  • diff-reporter: 실제 diff-triager 에이전트 통합 테스트. non-blocking.
  • recorder/player: 라이브 SUT 수동 smoke test — 60 FPS / 10회 중 9회 reliability DoD는 샌드박스 unit test 불가, 실제 환경에서 검증 필요.
  • player: wait_for UIA 이벤트 매핑 강화 (현재 host passthrough).
  • player: UiaPlayerHost uia_path resolver가 마지막 @AutomationId만 사용 — 전체 ancestor chain 지원 필요.
  • recorder: IME 조합 키 처리 (contract risks).
  • player: foreground settle이 경계선(600ms) — 1차 재생이 가끔 BOX 타이핑 누락. 능동 대기(focus-ready polling)로 전환 고려. (issue #14 후속)
  • recorder: null_target 이벤트 자체를 줄이기 — Automation.FocusedElement 직접 조회해 type 스텝 target 채우기 (issue #14 Gap I-1). 현재는 player fallback으로 우회.

Blocked

(없음)

Recent regression runs

(러너 미구현 — /regress 사용 불가)

Scaffolding review

  • 마지막 감사: 2026-04-07 (초기 셋업)
  • 다음 감사 권장: PoC 3개 완료 후
Reference in New Issue View Git Blame Copy Permalink