Open Weight Thoughts

Open Weight Thoughts

The latest in open source AI & real opinions of software engineers

  1. Open-Weight Model Released With 2 Trillion Parameters, Runs Perfectly on Your Friend’s $14,000 GPU Server

    A practical guide to deploying the newest 2-trillion-parameter open-weight model, provided your friend’s garage server is available, insured, and not currently being used to render a yacht.

    · W. Mansour· 7 min read· satire· guides
  2. The Real Cost of Self-Hosting an LLM Is Utilization, Not GPUs

    Self-hosting an LLM is usually not the cheap alternative to an API—it is a commitment to keeping expensive capacity busy. The teams that win with it treat inference as a real production system, not a Docker container with a model behind it.

    · W. Silva· 7 min read· opinion· guides
  3. I Replaced My Entire Engineering Team with Agents. Now I Have 17 New Bugs and 42 Slack Messages

    Replacing an engineering team with coding agents does not eliminate management. It turns you into the manager, QA department, security reviewer, product owner, and increasingly concerned owner of a Slack channel full of confident summaries.

    · N. Wijaya· 7 min read· guides· humor
  4. Small Language Models Are Winning Because Most Product Work Is Small

    The important AI race is not to put the smartest possible model behind every prompt. It is to build software that can do useful, bounded work cheaply, quickly, privately, and reliably—and small language models are a better fit for that job.

    · O. Yang· 7 min read· opinion· guides
  5. We Tested Open Models With the Coding Requests That Mean Nothing

    A rigorous satire of what happens when open-weight coding models are asked to interpret the ancient developer requirements: “make it work,” “fix whatever is wrong,” and “same thing but better.”

    · F. Nakamura· 7 min read· satire· guides
  6. Poolside Laguna M1 Free Acces: API, Weights, and Limits

    Poolside Laguna M.1 has freely downloadable Apache 2.0 weights, but “free access” to hosted inference is more conditional. Here is the practical distinction between downloading the model, obtaining an API key, and relying on a current free-preview offer.

    · Z. De Vries· 7 min read· guides
  7. The Chatbot Is the Worst Interface for AI

    Chat is a useful training wheel for AI, but it is a poor destination. The next useful generation of AI software should act continuously inside systems we already use, with narrow permissions, visible controls, and real accountability.

    · O. Li· 7 min read· opinion· guides
  8. How to Self-Host an LLM for Cline Without Giving Up Agentic Coding

    You can run Cline against a self-hosted model and keep its ability to inspect files, edit code, run commands, and iterate on tests. The key is treating local inference as one component of an agent loop—not as a drop-in chat model—and configuring for tool use, usable context, and safe execution.

    · W. Mansour· 7 min read· guides
  9. A Local LLM User Discovers Yet Another Benchmark That Doesn’t Matter

    A new benchmark result has arrived, and it proves almost nothing about whether the model will help with your actual work. Here is how engineers can tell the difference between a useful measurement and a very expensive number.

    · L. Kobayashi· 7 min read· guides· humor
  10. GLM-5.2 Non-Quantized Coding Agent Support: Try the Model

    GLM-5.2’s official BF16/F32 weights are non-quantized, and the model can be used in coding agents including Cline through an OpenAI-compatible endpoint. Here is how to distinguish native weights from hosted inference, configure an agent safely, and choose the fastest way to try it.

    · C. Wu· 8 min read· guides
  11. Qwen3.7-Plus Model Non-Quantized Availability for Coding Agents

    Qwen3.7-Plus is available for coding-agent use through Qwen’s hosted plans and OpenAI-compatible API endpoints, but its original non-quantized weights are not publicly downloadable. Here is what that distinction means for engineers, how to configure an agent safely, and what to use if local deployment is a hard requirement.

    · M. Dlamini· 8 min read· guides
  12. OpenHands, Aider, Cline, Roo Code & SWE-Agent: Top Open-Source AI Coding Pricing GitHub 2026

    A practical 2026 guide to the leading open-source AI coding agents: what each is for, what remains actively usable, where GitHub fits, and why the real price is usually model inference rather than the agent itself.

    · H. Miller· 8 min read· guides
  13. Meta Is No Longer the Leader of Open AI

    Meta deserves credit for making open-weight models mainstream, but historical importance is not the same as present leadership. For developers choosing models now, Llama is an ecosystem option—not the standard everyone else is chasing.

    · Z. Rodríguez· 7 min read· opinion· guides
  14. Open Models Are Commoditizing AI—and That Is Good News for Engineers

    Open-weight models are turning raw language-model capability from a scarce product into a widely available input. That will not eliminate frontier labs, but it will move the durable value of AI toward systems, data, and engineering judgment.

    · E. Yilmaz· 8 min read· opinion· guides
  15. OpenCode Qwen3.7-Plus Provider Support and Non-Quantized Access

    OpenCode supports Qwen3.7-Plus through hosted providers including QwenCloud and OpenCode Zen, and the model has the reasoning, vision, and function-calling capabilities a coding agent needs. But Qwen3.7-Plus is an API model, not an officially downloadable non-quantized checkpoint you can run locally.

    · H. Levi· 8 min read· guides
  16. Z.ai GLM-5.2 Official Non-Quantized Docs: Coding Agent Support for Claude Code, OpenCode, Cline, and ZCode

    Z.ai’s official documentation supports GLM-5.2 in Claude Code, OpenCode, Cline, and ZCode, but each tool uses a different connection path. The official open weights are available in BF16 as well as FP8, while hosted API users should not assume a serving precision the documentation does not specify.

    · Q. Iyer· 8 min read· guides
  17. The Single-File Refactor Initiative: How Your Coding Agent Finally Ended Architecture

    A practical satire for engineers whose coding agent has bravely converted a repository into one majestic 4,000-line source file. At last, every concern lives together, where it can be observed.

    · M. Kumar· 7 min read· satire· guides
  18. A Recall Button Is Not a Safety Case

    Anthropic is right that publicly released model weights cannot be recalled. But closed-model operators should not confuse the ability to revoke API access, patch a classifier, or revise a policy page with proof that a model is safe.

    · K. García· 6 min read· guides· humor
  19. The Frontier Model Is a Temporary Rental

    Closed labs may own the frontier briefly, but open-weight models are increasingly turning yesterday’s miraculous capability into next quarter’s infrastructure decision. Engineers should plan accordingly: rent the frontier when it matters, and build for the moment it becomes ordinary.

    · K. Rossi· 7 min read· guides· humor
  20. Harness Adds Its Sixteenth Tool-Calling Format, Promises This One Is the Standard

    SATIRE — In a fictional and legally unconnected development, an imaginary AI tooling vendor solves interoperability by releasing another perfectly standard tool schema. Engineers are advised to migrate immediately, until the next standard arrives after lunch.

    · K. Smith· 7 min read· satire· guides
  21. Coding Agent Harness Benchmark: Same Model OpenCode, Claude Code, Codex Comparison 2026

    A same-model benchmark can reveal whether a coding agent harness—not just the underlying LLM—changes correctness, cost, speed, and safety. Here is how to interpret OpenCode, Claude Code, and Codex comparisons fairly in 2026, and how to run one on your own repository.

    · Z. Yang· 8 min read· guides
  22. How to Use Different Open-Weight Models for Planning and Coding in Cline

    Use Cline’s separate Plan and Act model settings to give architectural reasoning and code execution different jobs. A stronger open-weight model can map the change, while a faster or cheaper one handles the edit-test-fix loop.

    · C. Saleh· 7 min read· guides
  23. Researchers Discover New SOTA by Renaming the Benchmark

    In a breakthrough for reproducible science, the Institute for Metric Recontextualization has achieved state of the art by changing what the state, art, and benchmark mean. Engineers are encouraged to read the appendix before updating production systems.

    · X. Wang· 5 min read· satire· guides
  24. OpenCode Qwen3.7-Plus Supported Model Docs (2026)

    Yes, Qwen3.7-Plus is a supported OpenCode model through QwenCloud configurations and OpenCode Go. Here are the authoritative docs, model IDs, configuration paths, and the checks that confirm it is available in your installation.

    · B. Costa· 8 min read· guides
Open Weight Thoughts