docs: close runtime quality review with consolidated lesson
Intrepid/Prometeu/Runtime/pipeline/pr-master There was a failure building this commit
Intrepid/Prometeu/Runtime/pipeline/pr-master There was a failure building this commit
This commit is contained in:
@@ -271,42 +271,39 @@ The full local `make ci-domains` validation passed with 939 tests passed and
|
||||
in verification; its final floor uses the lower measurement. All gates were
|
||||
rechecked against the verification report after that final adjustment.
|
||||
|
||||
## Ownership-repair measurement
|
||||
## Current coverage measurement
|
||||
|
||||
The [ownership-repair evidence](COVERAGE_DOMAINS_CURRENT.json) records the repaired
|
||||
module-tree ownership, fixed floors, normalized source paths, actual line
|
||||
counts and source/config/report fingerprints. Both historical JSON records
|
||||
above remain unchanged. The measurement uses the implementation working tree
|
||||
identified by its base HEAD and content fingerprints.
|
||||
The [current evidence](COVERAGE_DOMAINS_CURRENT.json) identifies the committed
|
||||
source by HEAD and content fingerprints, records the strict shared gate and
|
||||
retains the earlier ownership-repair measurement as historical evidence.
|
||||
Both original historical JSON records above remain unchanged. The latest
|
||||
measurement uses the repaired module-tree map with all 15 fixed floors.
|
||||
|
||||
| Domain | Covered / total lines | Measured lines | Fixed floor | Margin (points) |
|
||||
| --- | ---: | ---: | ---: | ---: |
|
||||
| system/os | 1410 / 1711 | 82.40% | 77.24% | 5.16 |
|
||||
| system/runtime | 2762 / 3309 | 83.46% | 76.19% | 7.27 |
|
||||
| system/fs | 1944 / 2469 | 78.73% | 76.08% | 2.65 |
|
||||
| system/runtime | 2757 / 3309 | 83.31% | 76.19% | 7.12 |
|
||||
| system/fs | 1946 / 2469 | 78.81% | 76.08% | 2.73 |
|
||||
| system/programs | 556 / 567 | 98.05% | 93.05% | 5.00 |
|
||||
| asset/bank | 3096 / 3420 | 90.52% | 86.76% | 3.76 |
|
||||
| asset/bank | 3176 / 3434 | 92.48% | 86.76% | 5.72 |
|
||||
| firmware | 1990 / 2314 | 85.99% | 83.20% | 2.79 |
|
||||
| host-dependent | 1196 / 2059 | 58.08% | 40.05% | 18.03 |
|
||||
| host-dependent | 1531 / 2393 | 63.97% | 40.05% | 23.92 |
|
||||
| host/headless | 739 / 855 | 86.43% | 83.39% | 3.04 |
|
||||
| vm/core | 8308 / 9294 | 89.39% | 84.29% | 5.10 |
|
||||
| vm/core | 8522 / 9526 | 89.46% | 84.29% | 5.17 |
|
||||
| bytecode | 3085 / 3303 | 93.39% | 88.26% | 5.13 |
|
||||
| hal/core | 2093 / 2369 | 88.34% | 83.56% | 4.78 |
|
||||
| drivers/core | 2728 / 3059 | 89.17% | 79.51% | 9.66 |
|
||||
| drivers/core | 2775 / 3107 | 89.31% | 79.51% | 9.80 |
|
||||
| system/core | 1353 / 1444 | 93.69% | 87.71% | 5.98 |
|
||||
| tooling | 396 / 612 | 64.70% | 59.75% | 4.95 |
|
||||
| dev/test-support | 99 / 115 | 86.08% | 80.96% | 5.12 |
|
||||
|
||||
The fresh macOS/aarch64 `make ci-domains` run passed all 15 coverage gates
|
||||
with 1,021 tests passed and 11 ignored. The 10 focused ownership/evidence
|
||||
tests and strict package Clippy also passed. No floor reduction or additional
|
||||
runtime behavior test was needed to pass the repaired map.
|
||||
|
||||
At the time of that ownership measurement the target used non-strict workspace
|
||||
Clippy, and a separate strict invocation failed on VM `useless_vec`,
|
||||
`cloned_ref_to_slice_refs` and `items_after_test_module` diagnostics. That historical
|
||||
record qualifies the repaired coverage map, not the later strict gate. The lint
|
||||
sources have since been corrected without blanket suppression or floor changes.
|
||||
The fresh macOS/aarch64 `make ci-domains` run passed all 15 domain gates,
|
||||
1,060 ordinary tests (13 ignored), five explicit socket tests and three
|
||||
runner regression tests. The fresh coverage replay also passed 1,060 tests;
|
||||
it is not an additional set of unique behavioral tests. All ten focused
|
||||
ownership/evidence tests passed again on the committed source. No floor
|
||||
was lowered. The retained ownership-repair measurement used the earlier
|
||||
non-strict gate; the current measurement passes strict workspace Clippy.
|
||||
|
||||
Platform-specific compilation and host scenarios can change report totals.
|
||||
Local evidence does not certify an unexecuted Linux or Intel Mac run; evaluate
|
||||
@@ -315,10 +312,10 @@ those runs against the configured floors and investigate differences.
|
||||
## Strict shared-gate qualification
|
||||
|
||||
On 2026-10-14, macOS/aarch64 with rustc 1.98.1, the shared target passed strict
|
||||
workspace/all-target/all-feature Clippy, all 1,039 ordinary tests (13 ignored),
|
||||
workspace/all-target/all-feature Clippy, all 1,060 ordinary tests (13 ignored),
|
||||
the five explicitly selected socket tests, three gate-runner regression tests,
|
||||
and all 15 fixed coverage domain gates. The separate fresh coverage execution
|
||||
also passed 1,039 tests with 13 ignored. Those repeated runs are not distinct
|
||||
also passed 1,060 tests with 13 ignored. Those repeated runs are not distinct
|
||||
behavioral tests and must not be added into a unique-test count.
|
||||
|
||||
The baseline strict invocation failed on the concrete VM lint sources above;
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@@ -95,3 +95,27 @@ availability guarantee. No human listening assessment is claimed.
|
||||
|
||||
Strict host Clippy passes. Repository-wide strict-gate status remains separate
|
||||
from these behavioral and device observations.
|
||||
|
||||
## Production decode and save pressure
|
||||
|
||||
A complementary release observation on 2026-10-14 used the same 1,000-callback,
|
||||
16-voice synthetic harness while a separate process repeatedly ran
|
||||
`qualify_file_commits_with_production_asset_decoder` from `prometeu-system`.
|
||||
Each pressure round performs twenty production glyph loads and durable 64-KiB
|
||||
FileMemcard commits. Fourteen rounds completed successfully during the audio
|
||||
process interval. The two test binaries were built before measurement; a worker
|
||||
started the first pressure process before audio and repeated it until audio
|
||||
exited, then joined the final invocation. Monotonic process intervals confirm
|
||||
concurrency in the [measurement record](audio-production-pressure-qualification.json).
|
||||
|
||||
Callback p50/p95/p99/max were 14.542/97.667/399.041/1,070.708 microseconds for the
|
||||
nominal 5,333.333-microsecond period. Allocation and deallocation counts remained
|
||||
zero; sixteen live sample owners became zero after teardown. All test processes
|
||||
exited successfully. The record identifies the committed source, toolchain,
|
||||
per-round save observations and the additional policy tests running on the host.
|
||||
|
||||
This measures host contention between processes, not an integrated console
|
||||
session or a physical callback under this exact workload. The previously named
|
||||
physical-device observation remains separate. The pressure fixture alternates
|
||||
loads and saves; deterministic production-decoder tests establish save preemption
|
||||
during decoding. None of these host-specific maxima is a real-time guarantee.
|
||||
|
||||
@@ -0,0 +1,255 @@
|
||||
{
|
||||
"scope": "Concurrent host processes: real production decode/FileMemcard fixture and 16-voice callback; not a same-process console integration",
|
||||
"audio": {
|
||||
"start_ns": 1213231353849333,
|
||||
"end_ns": 1213235637563291,
|
||||
"exit_code": 0,
|
||||
"callbacks": 1000,
|
||||
"voices": 16,
|
||||
"frames": 256,
|
||||
"nominal_period_ns": 5333333,
|
||||
"p50_ns": 14542,
|
||||
"p95_ns": 97667,
|
||||
"p99_ns": 399041,
|
||||
"max_ns": 1070708,
|
||||
"allocations": 0,
|
||||
"deallocations": 0,
|
||||
"owners_before": 16,
|
||||
"owners_after": 0
|
||||
},
|
||||
"pressure": [
|
||||
{
|
||||
"start_ns": 1213231351766125,
|
||||
"end_ns": 1213232142082875,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 8,
|
||||
"p95": 43,
|
||||
"max": 220
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 14187,
|
||||
"p95": 29711,
|
||||
"max": 30902
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213232142089250,
|
||||
"end_ns": 1213232647182500,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 6,
|
||||
"p95": 15,
|
||||
"max": 29
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 16130,
|
||||
"p95": 19710,
|
||||
"max": 23276
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213232647184250,
|
||||
"end_ns": 1213232911448208,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 8,
|
||||
"p95": 38,
|
||||
"max": 59
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8550,
|
||||
"p95": 10179,
|
||||
"max": 10965
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213232911451958,
|
||||
"end_ns": 1213233156142708,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 9,
|
||||
"p95": 15,
|
||||
"max": 26
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8981,
|
||||
"p95": 10341,
|
||||
"max": 11438
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213233156146791,
|
||||
"end_ns": 1213233422857166,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 8,
|
||||
"p95": 18,
|
||||
"max": 19
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 10074,
|
||||
"p95": 12108,
|
||||
"max": 12709
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213233422860875,
|
||||
"end_ns": 1213233691177833,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 7,
|
||||
"p95": 23,
|
||||
"max": 89
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 10453,
|
||||
"p95": 12621,
|
||||
"max": 12941
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213233691180500,
|
||||
"end_ns": 1213233907892666,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 6,
|
||||
"p95": 17,
|
||||
"max": 48
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 7962,
|
||||
"p95": 10914,
|
||||
"max": 11195
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213233907895666,
|
||||
"end_ns": 1213234115777250,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 15,
|
||||
"p95": 111,
|
||||
"max": 245
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8040,
|
||||
"p95": 12131,
|
||||
"max": 14538
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213234115783333,
|
||||
"end_ns": 1213234378236041,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 18,
|
||||
"p95": 77,
|
||||
"max": 143
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 9393,
|
||||
"p95": 11115,
|
||||
"max": 11919
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213234378243041,
|
||||
"end_ns": 1213234604680916,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 10,
|
||||
"p95": 94,
|
||||
"max": 1120
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8773,
|
||||
"p95": 10268,
|
||||
"max": 11906
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213234604683875,
|
||||
"end_ns": 1213234822563625,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 9,
|
||||
"p95": 104,
|
||||
"max": 188
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8485,
|
||||
"p95": 10250,
|
||||
"max": 11311
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213234822567208,
|
||||
"end_ns": 1213235110141666,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 17,
|
||||
"p95": 55,
|
||||
"max": 122
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 8975,
|
||||
"p95": 16481,
|
||||
"max": 16947
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213235110144333,
|
||||
"end_ns": 1213235379186208,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 13,
|
||||
"p95": 26,
|
||||
"max": 49
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 9699,
|
||||
"p95": 13929,
|
||||
"max": 15228
|
||||
},
|
||||
"samples": 20
|
||||
},
|
||||
{
|
||||
"start_ns": 1213235379189083,
|
||||
"end_ns": 1213235676903791,
|
||||
"exit_code": 0,
|
||||
"first_io_us": {
|
||||
"p50": 23,
|
||||
"p95": 1085,
|
||||
"max": 1339
|
||||
},
|
||||
"commit_us": {
|
||||
"p50": 9024,
|
||||
"p95": 20041,
|
||||
"max": 21674
|
||||
},
|
||||
"samples": 20
|
||||
}
|
||||
],
|
||||
"date": "2026-10-14",
|
||||
"git_head": "3f9d2355462d3b5675f5edc6e488ab325eb024d8",
|
||||
"source_sha256": "309a069f8b0560d1e9d1f9f4e011b709c89729383aeacd100c8c2ff5c3cff28d",
|
||||
"host": "macOS-27.0.1-arm64-arm-64bit-Mach-O",
|
||||
"rustc": "1.98.1",
|
||||
"profile": "release",
|
||||
"pressure_test": "prometeu-system: qualify_file_commits_with_production_asset_decoder",
|
||||
"audio_test": "prometeu-host-desktop-winit: callback_duration_16_voices_with_io_pressure",
|
||||
"orchestration": "Build both release test binaries first. Start a worker that repeatedly invokes the production pressure test with --ignored --nocapture. After the first pressure process starts, run the exact audio test with --ignored --exact --nocapture. Stop repetition when audio exits and join the final pressure invocation. Record monotonic start/end times and require all exits zero. Focused coverage-policy tests also ran during part of this host observation."
|
||||
}
|
||||
Reference in New Issue
Block a user