Files
marqdo-cli/tests/conformance/semantics/59-utf8-encoder.mq.md
T
cflmy 92bfbf2568 feat(rfc-cm): baseline P0-P3 compute machine, stdlib and resource slices
Implements the first vertical slices of RFC-CM-0001/0002 on top of a113d89:

- P1: opaque Memory regions (64 KiB pages, budgets, grow-only), byte
  read/write, Memory-index place assignment, wire/host-boundary rejection.
- CM-A04/A05: value-semantics List/Map/Text/Table primitives and the
  recoverable Result map convention.
- CM-A06: opaque Resource handles, resource.open/read/write/close, stdout
  write, granted project-file read and buffered write, strict fail-closed.
- CM-A07 Compat-A: explicit .mq.md format/utf8/io chain matching builtin
  print for the covered value types; builtin remains default.
- P2 fixtures: allocators, list/tree/graph/hash, integer codecs, UTF-8
  encode/decode, CSV/JSON subsets, table filter/sort/join, bytecode VM.
- ADRs 0022-0027, spec updates, evidence reports and 68 semantic goldens.

Gate: cargo fmt --check, clippy -D warnings, 407 tests passed.
2026-11-20 21:16:54 +08:00

1.4 KiB

编码

(文本, 内存, 基址)

把 Unicode 标量序列按 UTF-8 编码写入 Memory,返回字节长度。 这是 .mq.md 自己实现的编码逻辑,不是 Rust 内建 UTF-8 转换。

点 = text.codepoints(文本)

下标 = 0

偏移 = 0

  • 下标 < 长度(点)

    码点 = 点[下标]

    1. 码点 < 128

      内存[基址 + 偏移] = 码点

      偏移 = 偏移 + 1

    2. 码点 < 2048

      内存[基址 + 偏移] = 192 + 码点 // 64

      内存[基址 + 偏移 + 1] = 128 + 码点 % 64

      偏移 = 偏移 + 2

    3. 码点 < 65536

      内存[基址 + 偏移] = 224 + 码点 // 4096

      内存[基址 + 偏移 + 1] = 128 + 码点 // 64 % 64

      内存[基址 + 偏移 + 2] = 128 + 码点 % 64

      偏移 = 偏移 + 3

    4. true

      内存[基址 + 偏移] = 240 + 码点 // 262144

      内存[基址 + 偏移 + 1] = 128 + 码点 // 4096 % 64

      内存[基址 + 偏移 + 2] = 128 + 码点 // 64 % 64

      内存[基址 + 偏移 + 3] = 128 + 码点 % 64

      偏移 = 偏移 + 4

    下标 = 下标 + 1

偏移

main

内存 = memory.new(1, 1)

长度 = 编码("Aé中𝄞", 内存, 0)

字节 = []

下标 = 0

  • 下标 < 长度

    字节 = list.append(字节, 内存[下标])

    下标 = 下标 + 1

[长度, 字节]