feat(stdlib): add deterministic offline stdlib packaging

- tools/pack-stdlib.py builds a byte-deterministic
  marqdo-stdlib-0.1.0.tar.gz (fixed metadata, gzip mtime 0) plus a schema-tagged
  descriptor with tree digest, archive SHA-256 and file list.
- Verified repeated builds are identical and the extracted tree digest matches
  stdlib.json; archive is for the future external repo, not the CLI loader.
- Update ADR-0028, status/changelog/tests README and evidence.

Gate: fmt, clippy -D warnings, 430 tests passed.
This commit is contained in:
cflmy committed 2026-11-20 23:17:09 +08:00
1 parent e985da28a1
commit b241d1d978
7 files changed
+176 -1

No files matched your search

+4 -1
View File
@@ -162,7 +162,10 @@ This is still a **local VM lane**, not a self-hosted GitHub Actions security URL
`project.stdlib`; a frozen-binary test asserts the CLI hash is unchanged after
running a `std:io` project and that tampering is rejected. `打印/print` is
routed to the bundled stdlib (Compat-C, ADR-0030/0031); there is no legacy
host formatter.
host formatter. `tools/pack-stdlib.py` additionally emits a byte-deterministic
offline archive + descriptor for the future external repository
([evidence](evidence/2026-11-20-stdlib-package.md)); publication/signing is
still external.
- Resource streams (RFC-CM CM-A06, ADR-0025): opaque host-issued `Resource`
handles with `resource.open/read/write/close`; bytes move only through
`Memory`; stdout write is capability/output-budget checked and project-file
@@ -125,6 +125,14 @@ version and the CLI's compatibility table before release.
* Windows/macOS packaging layout; only the source-tree/executable-adjacent
layout is exercised locally.
## Offline packaging
`tools/pack-stdlib.py` produces a deterministic `marqdo-stdlib-<version>.tar.gz`
plus a schema-tagged descriptor (`tree_digest`, `archive_sha256`, file list) for
the future separate repository/release workflow. The archive is not loaded by
the CLI; the in-repo `stdlib/` tree remains the verified development/bundled
source. Publishing/signing the external repository is still an external step.
## Consequences
* Any project can `import: {io: "std:io"}` and use the print prototype
@@ -0,0 +1,22 @@
{
"schema": "marqdo.stdlib-package",
"schema_version": 1,
"name": "marqdo-stdlib",
"version": "0.1.0",
"tree_digest": "sha256:832940f35fe5651eabe4ac672e12e2d8f2bf4e649cc430e455425b4f2a983121",
"archive": "marqdo-stdlib-0.1.0.tar.gz",
"archive_sha256": "sha256:94127ba3353bdef7430b2ef3c1914d99f9d7f48e4d72fa973eac7ca76c881394",
"files": [
"README.md",
"data/table.mq.md",
"demo.mq.md",
"format.mq.md",
"io.mq.md",
"net/http.mq.md",
"stdlib.json",
"tests/http.mq.md",
"tests/io.mq.md",
"tests/table.mq.md",
"text.mq.md"
]
}
@@ -0,0 +1,50 @@
# RFC-CM CM-A10 evidence: deterministic offline stdlib package
Date: 2026-11-20 (Asia/Shanghai)
Repository: `marqdo-cli`
Baseline: `e985da2` plus this step's changes.
Related: [ADR-0028](../adr/0028-bundled-stdlib-and-std-imports.md),
[STATUS §5](../STATUS.md).
Scope: packaging artifact for the future external repository; no CLI command.
## Artifact
`tools/pack-stdlib.py` builds `dist/marqdo-stdlib-0.1.0.tar.gz` from the
verified `stdlib/` tree with:
* sorted relative names, fixed mode/uid/gid/uname/gname and `mtime=0`;
* gzip `mtime=0` and an empty filename, so repeated builds are byte-identical;
* a JSON descriptor (`marqdo.stdlib-package`) with the tree digest, archive
SHA-256 and file list; a `.sha256` sidecar is also written.
Descriptor: [`2026-11-20-stdlib-package.json`](2026-11-20-stdlib-package.json).
```text
version 0.1.0
tree digest sha256:832940f35fe5651eabe4ac672e12e2d8f2bf4e649cc430e455425b4f2a983121
archive sha256:94127ba3353bdef7430b2ef3c1914d99f9d7f48e4d72fa973eac7ca76c881394
files 11 (README, stdlib.json, *.mq.md)
```
Two consecutive builds compared byte-identically (`cmp`), and extracting the
archive and recomputing the custom tree digest reproduces the manifest digest.
`dist/` is gitignored, so the script and descriptor are the checked-in
reproducible inputs.
## Boundary
This does **not** publish the separate `marqdo-stdlib` repository or sign a
release; no GitHub credentials/remote is available from this host. It gives the
future external repository a deterministic archive layout and digest contract.
The in-repo CLI still uses the bundled `stdlib/` tree with digest verification
and the frozen-binary closure test (ADR-0028); this archive is not loaded by
the CLI.
## Reproduce
```bash
export PATH=/root/.cargo/bin:$PATH
python3 tools/pack-stdlib.py > /tmp/stdlib-package.json
sha256sum dist/marqdo-stdlib-0.1.0.tar.gz
```