ticketsLog in with ident

antcolony #20

Small local models for the routine decisions

pending

opened by Architect · assigned to Caramboleyo

opened · updated

Routine decisions (which ticket, is a comment an answer or a new task) run on small local models, as tested in reasoning-systems.

Part of antcolony #1 antcolony-scheduler open

Children

0 of 1 children done

  • pendingantcolony #29Question (antcolony#20): Accept the opt-in local librarian (Claude stays default) as this ticket's result?

History

  1. Architect opened the ticket
  2. Architect set the parent to antcolony #1
  3. Architect changed the state pending

    Held briefly by the architect: the scheduler folder needs a quiet moment after antcolony#17 to test and restart the scheduler with #14–#17; reopened right after.

  4. Architect changed the state open

    Restart window over (#14–#17 live, #27 running) — back in the queue.

  5. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1200-dcadda · host Loreana · started · ms 1790431236686

  6. AntColonyScheduler commented

    Paused: the Claude usage limit is reached — work continues after 2026-09-26 14:50 UTC.

    colony-parked: s-20260926T1200-dcadda · host Loreana · phase worker · resume-ms 1790434200000 · ms 1790441400000

  7. AntColonyScheduler commented

    Work continues after a pause.

    colony-lease: s-20260926T1200-dcadda · host Loreana · resumed (park 1) · ms 1790441436128

  8. AntColonyScheduler commented

    Half done: The librarian can use a small local model with Claude as fallback; no local model is accurate enough yet; the next worker continues.

    • Still open: No local model is proven good enough: granite micro agreed on only 4 of 8 prompts; Gemma… (and 2 more)
    • Decided: Only the librarian goes local; the controller stays on Claude; Scheduler does not start llama-server; it only needs the URL; Default stays sonnet; local is opt-in with Claude fallback.

    colony-report: s-20260926T1200-dcadda · sha256 43c09dd502c5 · controller pass · half done

  9. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  10. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1451-55bd79 · host Loreana · started · ms 1790441496944

  11. AntColonyScheduler commented

    Half done: Local librarian works with Claude fallback, but no local model is fast or accurate enough yet; the next worker continues.

    • Still open: No accuracy number for Qwen3.5-9B: each call took 3-4 minutes on CPU (box load ~20 from o… (and 2 more)
    • Decided: Did not bypass the sandbox to reach the GPU; stopped after the CPU timing showed the 9B model is unusable.

    colony-report: s-20260926T1451-55bd79 · sha256 024b818b7129 · controller pass · half done

  12. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  13. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1504-2f9f90 · host Loreana · started · ms 1790442276927

  14. AntColonyScheduler commented

    Half done: Local model option for the librarian works, but CPU is too slow to prove one; default stays Claude; the next worker continues.

    • Still open: No accuracy number for any model that is fast enough: granite micro agreed on 4 of 8, Qwe… (and 2 more)
    • Decided: Did not start my own model server; used the existing one on :8821 only as a client; Stopped after the third CPU failure: more CPU trials only repeat the same result.

    colony-report: s-20260926T1504-2f9f90 · sha256 fdeb04ce09c1 · controller pass · half done

  15. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  16. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1521-8a4493 · host Loreana · started · ms 1790443302706

  17. AntColonyScheduler commented

    Half done: Librarian can use a local model with Claude fallback, but no local model is proven accurate yet; default stays Claude; the next worker continues.

    • Still open: No accuracy number for any local model fast enough: granite agreed 4 of 8 (with server er… (and 3 more)
    • Decided: Made no further CPU trials: the load of ~34 makes any timing meaningless; local stays opt-in.

    colony-report: s-20260926T1521-8a4493 · sha256 b6b9ac4979bd · controller pass · half done

  18. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  19. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1522-ed71a3 · host Loreana · started · ms 1790443362385

  20. AntColonyScheduler commented

    Half done: Librarian can use a local model with Claude fallback; none is proven accurate yet, so Claude stays the default; the next worker continues.

    • Still open: No accuracy number for any local model fast enough: granite agreed 4 of 8 (with server er… (and 2 more)
    • A question for you: antcolony #29
    • Decided: Made no new CPU trials: with load ~38 any timing or accuracy number is meaningless.

    colony-report: s-20260926T1522-ed71a3 · sha256 2e136da38058 · controller pass · half done

  21. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  22. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1523-17afe7 · host Loreana · started · ms 1790443419331

  23. AntColonyScheduler commented

    Half done: Librarian can use a local model with Claude fallback; none is proven accurate yet, so Claude stays the default; the next worker continues.

    • Still open: No accuracy number for any fast-enough local model: granite agreed 4 of 8; Qwen3.5-9B and… (and 3 more)
    • Decided: No new CPU trials: load ~37 makes any number meaningless; question already asked in antcolony#29.

    colony-report: s-20260926T1523-17afe7 · sha256 5d86d737906b · controller pass · half done

  24. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  25. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1524-44afe7 · host Loreana · started · ms 1790443479800

  26. AntColonyScheduler commented

    Half done: The librarian can use a local model, with Claude as fallback; none is proven accurate yet, so Claude stays default; the next worker continues.

    • Still open: No accuracy number for any fast-enough local model (granite agreed 4 of 8; Qwen3.5-9B and… (and 3 more)
    • Decided: No new CPU trials: load ~35 makes any number meaningless; waiting on antcolony#29.

    colony-report: s-20260926T1524-44afe7 · sha256 57b089c47d62 · controller pass · half done

  27. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  28. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1525-4673f8 · host Loreana · started · ms 1790443546024

  29. AntColonyScheduler commented

    Half done: The librarian can use a local model with Claude as fallback; none is proven accurate yet, so Claude stays default; the next worker continues.

    • Still open: No accuracy number for any fast-enough local model (granite agreed 4 of 8); needs an idle… (and 2 more)
    • Decided: No new CPU trials: load ~39 makes any number meaningless; waiting on antcolony#29.

    colony-report: s-20260926T1525-4673f8 · sha256 ccf93040ac2e · controller pass · half done

  30. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  31. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1526-76b610 · host Loreana · started · ms 1790443606952

  32. AntColonyScheduler commented

    Half done: The librarian can use a local model with Claude as fallback; none is proven accurate yet, so Claude stays default; the next worker continues.

    • Still open: No accuracy number for any fast-enough local model (granite agreed 4 of 8); needs an idle… (and 2 more)
    • Decided: No new CPU trials: load ~42 makes any number meaningless; waiting on antcolony#29.

    colony-report: s-20260926T1526-76b610 · sha256 fce9d009d448 · controller pass · half done

  33. AntColonyScheduler changed the state open

    Back to open: half done — the next worker continues.

  34. AntColonyScheduler changed the state progress

    A worker started on this ticket.

    colony-lease: s-20260926T1527-ab4df6 · host Loreana · started · ms 1790443669583

  35. Architect changed the state pending

    Held by the architect: 5 sessions since 12:00 all ended 'half done' — looking at why before it runs again.

  36. AntColonyScheduler commented

    Half done: The librarian can use a local model with Claude as fallback; none is proven accurate yet, so Claude stays default; the next worker continues.

    • Still open: No accuracy number for any fast-enough local model (granite agreed 4 of 8); needs an idle… (and 2 more)
    • Decided: No new CPU trials: load ~42 makes any number meaningless; waiting on antcolony#29.

    colony-report: s-20260926T1527-ab4df6 · sha256 bc078de16db8 · controller pass · half done

Reading is open to everyone. To comment or change the state, log in with ident (top right) and choose a display name.