Skip to content

[test] Defer generated fixtures and report test durations - #1126

Merged
mhs4670go merged 2 commits into
Samsung:mainfrom
mhs4670go:test/stage5-harness-costs
Nov 11, 2026
Merged

mhs4670go merged 2 commits into
Samsung:mainfrom
mhs4670go:test/stage5-harness-costs

Conversation

@mhs4670go

Copy link
Copy Markdown
Contributor

Construct generated models and example inputs only when selected tests run, with fresh state per invocation and fixture errors outside negative assertions. Add opt-in collection, suite, and per-test duration reporting using unittest.

Preserve static zero-input probes because their input-value and quantization mode coverage differs from normal reference inference. Add regression coverage for lazy fixtures, runner outcomes, and real Circle validation paths.

Validation: 71 focused tests passed; the full default suite ran 5018 tests successfully with 49 skips. Full formatting and static checks passed. Existing test IDs and selections are preserved; end-to-end wall-time improvement was not established by the repeated CPU measurements.

TICO-DCO-1.0-Signed-off-by: seongwoo mhs4670go@naver.com

Construct generated models and example inputs only when selected tests run,
with fresh state per invocation and fixture errors outside negative assertions.
Add opt-in collection, suite, and per-test duration reporting using unittest.

Preserve static zero-input probes because their input-value and quantization
mode coverage differs from normal reference inference. Add regression coverage
for lazy fixtures, runner outcomes, and real Circle validation paths.

Validation: 71 focused tests passed; the full default suite ran 5018 tests
successfully with 49 skips. Full formatting and static checks passed. Existing
test IDs and selections are preserved; end-to-end wall-time improvement was
not established by the repeated CPU measurements.

TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Signed-off-by: seongwoo <mhs4670go@naver.com>
Pass shape and dtype explicitly instead of unpacking heterogeneous dictionaries
that mypy infers as object. Preserve both malformed serialized Circle cases and
their real verification and inference rejection assertions.

Validation: all 7 Circle harness tests pass, direct cache-free mypy succeeds,
and the CI-equivalent full UFMT and Pylint/MYPY checks pass.

TICO-DCO-1.0-Signed-off-by: seongwoo <mhs4670go@naver.com>
Signed-off-by: seongwoo <mhs4670go@naver.com>
@mhs4670go
mhs4670go merged commit 640b8a8 into Samsung:main Nov 11, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant