Executives, investors, freelancers and anyone who makes costly decisions based on a single AI's answers. If one model has ever answered you confidently… and wrong, this profile is for you.
Price verified on 2026-10-29.
LLM Council, a public project by Andrej Karpathy (the repo is visible, but has no license file: not open source in the legal sense): you ask your question to several models from different families (GPT, Claude, Gemini, Grok…), each answers on its own, then they read and rank each other anonymously, and a “chairman” model synthesizes the final verdict.
Trigger: You submit an important question to the council — queries each model in parallel, anonymizes the answers, organizes the cross-review and has a chair synthesize, and you get a debated answer, with the disagreements visible instead of hidden.
Not documented in the official sources: API & integrations, Documented limits.
Official sources: github.com — verified on November 1, 2026.
Free software (public repository, no open-source license); you pay for the model calls (around 2 to 3 times the cost of asking a single model). Free software; no subscription, only the models' API calls are billed by usage. Price verified on October 29, 2026.
Yes. Free software; no subscription, only the models' API calls are billed by usage.
Level: Advanced. Setup takes 4 steps; the first: Grab the public project on GitHub (github.com/karpathy/llm-council) and install it locally.
A council of models is still a group of models: they can share the same blind spot. Keep irreversible decisions (legal, health, large amounts) for real human experts, and don't submit confidential data without checking where it flows.
I want a team of agents that splits up a big job
$0 for the open-source framework and the basic platform (50 runs/month); enterprise platform by quote, plus the cost of the model calls.
I want a custom agent workflow, with every step under control
Free open-source library; you pay for the model calls, and for LangSmith if you take it (free to start, then $39/user/month).
I want agents that debate each other until they find the solution
Free and open source; you pay for the model calls used by the agents — a multi-round debate costs several times a simple answer.
I want to plug my own tools and data into my agents
Free: it's an open standard, not a product; each tool you plug in keeps its own pricing.
I want agents that run at home, without sending my data to the cloud
$0: the software and the open models are free; the real cost is your computer (a good graphics card makes the models fast and pleasant).
Profile updated on November 1, 2026 — see what's new at the Directory.