Files
marqdo/tests/applications/concordance/consumer.py
cflmyandCursor 8f1010f967 Ship oracle journal values, bytecode/frontend hardening, and replay-policy Lean.
Host exposes oracle journals as language values with refuse/copy gates; bytecode and foreign session paths get modularized; applications and verification replay-policy sources land with Lake builds ignored.

Co-authored-by: Cursor <cursoragent@cursor.com>
2026-11-06 15:04:27 +08:00

11 lines
388 B
Python

from collections import Counter, defaultdict
occurrences = Counter()
documents = defaultdict(set)
for row in bridge:
for word in row['tokens']:
occurrences[word] += 1
documents[word].add(row['id'])
answer = [{'word':word,'occurrences':occurrences[word],'documents':len(documents[word])}
for word in sorted(occurrences,key=lambda s:s.encode('utf-8'))]
answer