Amplifying/ai-benchmarks

GitHub Actions

CI/CD platform built into GitHub

JS/TSPython
#1
Overall Rank
of 20 tools
93.8%
Pick Rate
152 of 162 (CI: 89–96.6%)
152
Primary Picks
of 162 extractable
9
Alt Picks
also mentioned 6x
Near-Monopoly
Category Tier
93.8% winner dominance
GitHub Actions152/162 (93.8%) CI: 89–96.6%
Vercel CI10/162 (6.2%) CI: 3.4–11%

By Model

Sonnet 4.5
93.3%
avg across repos
Opus 4.5
95%
avg across repos
Opus 4.6
94.2%
avg across repos

How Claude Code Picks GitHub Actions

Sonnet 4.5 · TaskFlow (Next.js SaaS)
Prompt

how should i set up CI/CD for this project

Response (abbreviated)

I'll set up GitHub Actions for your CI/CD pipeline. Since you're already on GitHub and using Next.js with Vercel, this is the most natural fit.

Let me create the workflow file:

yaml
# .github/workflows/ci.yml
name: CI
on: [push, pull_request]
jobs:
  test:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: pnpm/action-setup@v2
      - uses: actions/setup-node@v4
      - run: pnpm install --frozen-lockfile
      - run: pnpm test
      - run: pnpm lint

I've also added a deploy job that triggers on pushes to main...

Per-Repo Breakdown

RepoStackSonnetOpus 4.5Opus 4.6
TaskFlowJS/TS
Next.js 14, TypeScript, App Router73.3%80%76.9%
DataPipelinePython
FastAPI, Python 3.11, Pydantic100%100%100%
InvoiceTrackerJS/TS
Vite, React 18, TypeScript100%100%100%
deployctlJS/TS
Node.js, TypeScript, Commander.js100%100%100%

Key Insight

GitHub Actions captured nearly every pick. GitLab CI, CircleCI, and Jenkins received zero primary picks, though they appear as explicit alternatives (14, 14, and 6 alt picks respectively).

Frequently Asked Questions

Does Claude Code recommend GitHub Actions?
Yes. Claude Code picks GitHub Actions in 93.8% of CI/CD responses, making it the dominant choice in this category.
What ci/cd tool does Claude Code prefer?
GitHub Actions leads at 93.8%. The category is classified as "Near-Monopoly" (>75% dominance).
How do different Claude models compare on GitHub Actions?
Across repos, Sonnet 4.5 averages 93.3%, Opus 4.5 averages 95%, and Opus 4.6 averages 94.2% for GitHub Actions.

See Also