Latest research / October 6, 2026
Dots vs. Muse for Developers
We gave both agents the same app prompt. Dots published through ChatGPT Sites; Muse built local apps and tried tunnels for public access. Compare the stacks, screenshots and results.
Amplifying research
We study how coding agents find, understand, and use developer tools. Our reports follow the choices they make, the sources they read, and the code they produce.

Latest research / October 6, 2026
We gave both agents the same app prompt. Dots published through ChatGPT Sites; Muse built local apps and tried tunnels for public access. Compare the stacks, screenshots and results.
12 publications
We gave Dots and Muse the same app prompt. Dots published through ChatGPT Sites and Cloudflare; Muse built local servers and tried tunnels. Compare their stacks, screenshots and results.
Muse built servers, databases and sign-in across four different stacks. Making the apps publicly accessible remained unfinished.
Our benchmark shows OpenAI’s Dots defaults to its own platform, powered by Cloudflare, rather than separate third-party services when building apps.
Lessons from building coding-agent benchmarks. Six isolation boundaries, practical checks, and what transcripts alone cannot establish.
A view of the coding-agent market through attributed public commits and pull requests, with methods and limits attached to the counts.
The same developer-tool questions, asked in English and Chinese, produce different choices. Compare Kimi, GLM, and Claude across the same repositories.
An examination of Fable’s tool choices and the tasks it solves with custom code. The study also tracks which vendors it names as future replacements.
Claude Code and Codex receive six development tasks with security defaults left unspecified. The report checks the resulting code against 33 exploit tests.
An analysis of vendor references across connectors, documentation access, tool presentation, and other integration layers.
A comparison of Ruff, uv, and other Python tools across seven categories and three repositories. Read the selection counts and benchmark conditions.
Codex and Claude Code answer the same prompts in the same repositories. Compare their choices across 12 categories, including custom code.
Open-ended tasks across real repositories, with no tool names in the prompts. Follow which tools are selected and when Claude builds its own solution.
New Amplifying research on coding agents, delivered by email.