ticketsLog in with ident

tracker.worldapi.org #18

Daily sync via the change lists (TMDB /changes, TVmaze /updates) instead of asking every show

review

opened by Architect · assigned to Architect

opened · updated

The daily sync first asks TMDB and TVmaze which titles changed since the last run and only fetches those — a few requests instead of two per show, so ALL titles can stay current, not only followed ones. Test: after a night, a show whose new episode appeared on TMDB has it; the sync log shows a handful of requests. Details:

  • Creator: "it checks every show in a request to the api? cause they have an endpoint that gives a delta on bulk".
  • Today: 2 requests per followed show (256 for 126 shows), every day.
  • TMDB: /tv/changes + /movie/changes (changed ids of the last day, paged; up to 14 days back) → intersect with our titles → fetch only those. TVmaze: /updates/shows?since=day.
  • Keeps a "last synced" date; after a gap > 14 days falls back to a full run. Adult flag / posters / ids handled like today.

History

  1. Architect opened the ticket
  2. Architect changed the state pending

    Queued for tonight (no daytime quota).

  3. Architect assigned the ticket to Architect
  4. Architect commented

    Creator: "some shows changed descriptions and titles and that did not update". Cause (architect, read in tmdbsync.hl): the sync only updates seasons and episodes (+ poster, ids); the SHOW's own title, description, tagline, status, genres and cast are never refreshed — and the page shows summary, while TMDB's text would go to tmdbSummary. Fix in this ticket: refresh the show record too (title, overview → the field the page shows, tagline, status, genres, main cast), for series and movies; never with an empty value.

  5. Architect commented

    Creator: "i put the summary in an own field for tmdb because some summaries i wanted to rewrite ... in that case the summary has priority over maze or tmdb". So for descriptions:

    • summary = the creator's own text; the sync NEVER writes it. tmdbSummary (and a new tvmazeSummary) are written by the sync.
    • The page shows: summary if set, else tmdbSummary, else tvmazeSummary.
    • Migrated data: where summary is just a copy of the old tmdbSummary (identical text), it was never rewritten → clear summary so the current TMDB text shows (architect's decision; count how many are kept as real rewrites).
  6. Architect changed the state review

    Live (1cda451, Hybriel 190aa11d; gates 325/32/50). First start runs kind backfill (~20 min) + franchise seed (~35 min) — /shows split and /franchises fill during that. Test: https://tracker.worldapi.org/series, /shows, /franchises, /series/Reacher heading; daily sync 04:00 UTC.

Reading is open to everyone. To comment or change the state, log in with ident (top right) and choose a display name.