jenkins improvements
This commit is contained in:
+13
-9
@@ -26,7 +26,7 @@ The runtime edge is no longer broadly untested. The repository now already conta
|
||||
|
||||
The remaining problem is governance, not raw test absence.
|
||||
|
||||
Global coverage metrics already exist through `cargo llvm-cov`, and CI already enforces a workspace-wide minimum gate. That is useful, but insufficient on its own. A good aggregated number does not guarantee that firmware transitions, boot flow, host-dependent surfaces, or domain-specific status-first contracts are covered at the right level.
|
||||
Global coverage metrics already exist through `cargo llvm-cov`. A single aggregated workspace gate proved useful, but insufficient on its own. A good aggregated number does not guarantee that firmware transitions, boot flow, host-dependent surfaces, or domain-specific status-first contracts are covered at the right level.
|
||||
|
||||
The project therefore needs an explicit domain-based acceptance model for tests:
|
||||
|
||||
@@ -37,9 +37,9 @@ The project therefore needs an explicit domain-based acceptance model for tests:
|
||||
|
||||
## Decisao
|
||||
|
||||
PROMETEU SHALL govern runtime-edge test sufficiency through a two-layer model:
|
||||
PROMETEU SHALL govern runtime-edge test sufficiency through a domain-first model:
|
||||
|
||||
1. a mandatory global coverage gate enforced in CI; and
|
||||
1. a mandatory CI gate enforced from the canonical runtime-edge domains; and
|
||||
2. a domain-based acceptance gate driven by mandatory scenarios plus domain-scoped coverage evidence.
|
||||
|
||||
The canonical domains SHALL be:
|
||||
@@ -61,6 +61,7 @@ No PR that changes the observable contract of a canonical domain SHALL be accept
|
||||
- an explicit justification that the observable contract did not change.
|
||||
|
||||
Improved aggregate coverage SHALL NOT be accepted as sufficient evidence on its own when the changed behavior belongs to a canonical domain with mandatory scenarios.
|
||||
Workspace-wide aggregate coverage MAY still be generated as a report artifact, but it SHALL NOT be the authoritative CI acceptance gate.
|
||||
|
||||
## Rationale
|
||||
|
||||
@@ -100,11 +101,12 @@ The correct role of coverage is supporting evidence, not sole authority.
|
||||
|
||||
## Invariantes / Contrato
|
||||
|
||||
### Global Coverage Contract
|
||||
### CI Coverage Contract
|
||||
|
||||
- CI MUST keep a workspace-wide coverage gate.
|
||||
- The current `llvm-cov` based global gate remains valid as the operational baseline.
|
||||
- CI MUST enforce coverage from the canonical runtime-edge domains instead of a workspace-wide aggregate percentage.
|
||||
- The current `llvm-cov` toolchain remains valid as the operational baseline.
|
||||
- Changing the tooling is out of scope for this decision.
|
||||
- The authoritative quantitative CI gate is each domain `baseline_percent`, evaluated against domain `lines` coverage.
|
||||
|
||||
### Domain Gate Contract
|
||||
|
||||
@@ -188,13 +190,15 @@ Mandatory scenarios:
|
||||
### Tooling / CI
|
||||
|
||||
- Existing `llvm-cov` and Jenkins integration remain valid.
|
||||
- Future plans may add domain reporting, thresholds, or helper commands without changing this baseline decision.
|
||||
- Jenkins MUST call repository helpers that compute and enforce the domain coverage gate.
|
||||
- Workspace aggregate reports may continue to be published for inspection, but they are not the merge gate.
|
||||
|
||||
## Referencias
|
||||
|
||||
- `AGD-0001`
|
||||
- `Makefile`
|
||||
- `files/config/Jenkinsfile`
|
||||
- `files/config/runtime-edge-coverage-domains.json`
|
||||
- `docs/specs/runtime/12-firmware-pos-and-prometeuhub.md`
|
||||
- `crates/console/prometeu-system/src/virtual_machine_runtime/tests.rs`
|
||||
- `crates/console/prometeu-system/src/services/fs/virtual_fs.rs`
|
||||
@@ -202,8 +206,8 @@ Mandatory scenarios:
|
||||
|
||||
## Propagacao Necessaria
|
||||
|
||||
- Create an execution plan that turns the domain model into concrete work items.
|
||||
- Create or revise execution plans that turn the domain model into concrete CI and review work items.
|
||||
- Define how domain evidence will be gathered during review.
|
||||
- Decide whether to add helper commands or scripts for domain-oriented coverage inspection.
|
||||
- Keep helper commands or scripts as the canonical interface for domain-oriented coverage inspection and CI enforcement.
|
||||
- Prioritize firmware and host-dependent expansion first.
|
||||
- Define an incremental split strategy for the monolithic runtime test suite.
|
||||
|
||||
Reference in New Issue
Block a user