Commit Graph

6 Commits

Author SHA1 Message Date
3a208a1666 data: sync packages corpus + swift-org/swift-book re-crawl refresh 2026-06-20 12:05:17 +02:00
06ec8076f1 data(packages): add 1252 source files from 28 packages missing from corpus 2026-06-20 11:52:35 +02:00
030ad518fd data(packages): move to dedicated mihaelamj/cupertino-packages repo
The packages/ subtree is now a separate published repo:
https://github.com/mihaelamj/cupertino-packages

Initial content seeded from
cupertino-docs/packages@26fc51c92. cupertino-docs continues to
house apple-docs JSON, HIG, swift-evolution, swift-org,
swift-book, and archive corpora.

The split keeps per-source corpus repos independently versioned
and avoids the 1.5 GB packages bloat in cupertino-docs git
history. cupertino-sample-code (separate repo) and
cupertino-symbolgraphs (separate repo) already followed this
pattern.
2026-05-27 11:36:38 +02:00
26fc51c927 data(packages): 2026-05-27 refresh, 509 new, 3151 updated, 1290 removed
Stage 2 archive download (codeload.github.com) of 137 seed
packages plus transitive dependencies discovered by walking
each Package.swift via raw.githubusercontent.com. Total 326 MB
written in 98 seconds after a 200-second resolver pass.

12 new top-level package owners since prior refresh:
- apple, awslabs, hummingbird-project, mattpolzin, mihaelamj,
  ordo-one, orlandos-nl, realm, swiftlang, tuist, valkey-io, vapor

The 1290 deletions are mostly per-package availability.json
sidecars; they get regenerated by the optional
`--annotate-availability` pass, intentionally not included in
this stage.

Fetched via `cupertino fetch --source packages --skip-metadata`
(skipped stage 1 star-count popularity sort, which is throttled
to 60 req/h GitHub REST API unauthenticated). 1 package failed
to download (logged in
/tmp/cupertino-fetch-packages-archives-20260527-111255.log).
2026-05-27 11:27:32 +02:00
1eae0594fc data: refresh docs/ + add packages/ from .cupertino-dev
Bulk update of the public corpus from /Users/mmj/.cupertino-dev/, the
local source that built v1.0.0 / v1.0.1 release database bundles.

- docs/: 1,739 new pages, 403,381 modified (schema upgrade to the
  structured-page format used by v1.0+: overview, rawMarkdown,
  sections[].items[]). Total 404,568 page JSONs (2.4 GB).
- packages/: 1,587 packages (1.5 GB), previously empty in this repo.
  Includes per-package source archives and READMEs for the curated
  Swift package set. Some packages (notably swiftlang/swift-foundation-icu)
  ship 50-100 MB ICU lookup tables — under GitHub's 100 MB limit.

No deletions: existing files not in .cupertino-dev are preserved
(e.g. swift-org/ has 81 historical pages this update doesn't touch).
2026-05-09 12:58:32 +02:00
8ccfb50843 Added curated packages readme files & swift-org docs 2025-12-02 20:47:21 +01:00