ci: validate real protocol artifacts and run core tests cross-platform (B-13 B-14)
- add an independent schema job with a pinned Draft 2020-12 validator that validates real Analysis v2/Trace v2/Tool artifacts and negative mutations - tighten the tool schema (SemVer, package-relative entrypoint, non-empty protocol arrays) - run cargo test --workspace plus portable CLI/analysis/trace smoke and a strict-refusal assertion on Windows and macOS - record honestly that Tool/C-ABI/worker runtime coverage remains Unix-only
This commit is contained in:
1 parent
9bceac910b
commit
20d15fd5a2
4 files changed
+207
-14
No files matched your search
+20
-1
@@ -170,6 +170,24 @@ Tool Protocol hardening (`spec/tool-v1.md`):
|
||||
* Tests cover accepted/rejected protocol declarations, auxiliary-file/extra-file
|
||||
tampering, entrypoint tampering and reserved `record.json`.
|
||||
|
||||
### S4-A/B-13 B-14 record (current)
|
||||
|
||||
* CI has an independent `schema` job that installs a pinned Draft 2020-12
|
||||
validator (`jsonschema==4.23.0`), emits real Analysis/Trace artifacts,
|
||||
validates each against its matching schema, and runs the independent Python
|
||||
consumers. `tests/consumers/validate_protocols.py` also asserts negative
|
||||
mutations (wrong type/version, missing required fields, unsupported
|
||||
truncation reason, traversal entrypoint, invalid SemVer).
|
||||
* Tool schema tightened: SemVer version pattern, package-relative entrypoint
|
||||
pattern and non-empty protocol arrays.
|
||||
* The Windows/macOS CI lane now runs `cargo test --workspace` plus portable CLI,
|
||||
Analysis and Trace smoke tests and a strict-mode refusal assertion, instead
|
||||
of `cargo check` only.
|
||||
* Still Unix-only in CI: compiled C ABI plugins, worker transport tests,
|
||||
package/Git/process tests and the shell-fixture Tool black-box suite. They are
|
||||
not counted as cross-platform evidence; `docs/STATUS.md` records this rather
|
||||
than treating `cargo test` skips as passes.
|
||||
|
||||
### M0.6 implementation progress
|
||||
|
||||
| Step | State | Evidence |
|
||||
@@ -180,13 +198,14 @@ Tool Protocol hardening (`spec/tool-v1.md`):
|
||||
| S2-B/H2-A Analysis v2 | **Done** | logical project identity, resources array, machine-path-free diagnostics, emitted-bytes digest, v2 schema + independent consumer (see §S2-B/H2-A) |
|
||||
| S2-C/H2-B Trace v2 | **Done** | logical root/digest, module-owned events, bounded/truncated trace, independent consumer, hardened worker frames (see §S2-C/H2-B) |
|
||||
| S3-A/H2-C Tool protocol | **Done** | SemVer negotiation at install+dispatch, whole-bundle manifest/digest verification, atomic install/remove, reserved record file (see §S3-A/H2-C) |
|
||||
| S4-A/B-13 B-14 quality gates | **Partial** | real schema instance validation + negative mutations in CI; Windows/macOS runtime tests for core/Analysis/Trace and strict refusal. Tool/C-ABI/worker runtime evidence remains Unix-only (see §S4-A) |
|
||||
| R0 baseline + ADRs | **Done** | this section; `docs/adr/0008`–`0012`; full workspace gate |
|
||||
| R1 package-aware identity + callable registry | **Done for statics; superseded by S1 lock v3** | `ModuleId { instance, relative_path }`; `PackageResolver` path sources; lock v3 transitive graph (ADR-0016) replaces the flat v2 lock; `CallableRegistry` for builtins/marqdo/declared ABI exports; external manifest wiring is R2 |
|
||||
| R2 ABI/Kernel/Broker | **Done (worker = crash isolation)** | `KernelRegistry` external providers; complete-name export routing; `CapabilityBroker`; static `check --plugin`; multi-export C test; isolated worker with timeout/crash tests; host handle table. Native/worker are not an OS sandbox |
|
||||
| R3 Tool Protocol | **Done (S3 hardened)** | `tool install/list/remove`; unknown-command fallback; SemVer + Analysis/Trace negotiation; whole-bundle digest verification; staged install and rename-based removal; black-box tests for arbitrary names, Unicode args, conflicts, traversal, PATH hijacking and bundle tampering |
|
||||
| R4 Analysis/Trace v2 | **Done** | `check --emit` Analysis v2 and `run/call --trace-file` Trace v2 with logical identity, resources, module-owned events, capacity bounds, schemas and independent Python consumers; stale-artifact removal; value redaction |
|
||||
| R5 environment/isolation | **Partial** | Pinned Git fetch with verified cache markers, transitive `@alias` resolution, full-closure atomic `.marqdo/env` materialization, foreign process-group cleanup. Strict OS isolation remains explicitly unavailable (fail-closed) |
|
||||
| R6 release/consumers | **Done for Linux** | examples for unknown-name Tool, multi-export plugin, external kernel and multi-version packages; Analysis/Trace/Tool JSON Schemas; CI Linux gate + Windows/macOS `cargo check`; R6 example tests |
|
||||
| R6 release/consumers | **Partial** | examples for unknown-name Tool, multi-export plugin, external kernel and multi-version packages; Analysis/Trace/Tool JSON Schemas with instance validation; Linux full gate + Windows/macOS workspace tests and portable analysis/trace smoke; Unix-only Tool/ABI/worker runtime evidence |
|
||||
|
||||
Reproduce the evidence:
|
||||
|
||||
|
||||
Reference in new issue
Block a user