CircleCI
68/100A mature hosted platform with good test splitting and its own test selection, priced in credits.
Who it suits
Teams that want a dedicated CI product with timing-based test splitting, broad machine types and mobile builds.
Who should avoid it
You want to work out your bill without a calculator, or you would rather keep CI inside GitHub.
| Criterion (weight) | Score | Why |
|---|---|---|
| Pipeline speed (20%) | ●●●●● | Fast enough with the right resource class and splitting; no warm-cache runners by default. |
| Caching (10%) | ●●●●● | Dependency caching and Docker layer caching on every plan. |
| Parallelism (10%) | ●●●●● | parallelism key with timing-based test splitting; 30 to 80 concurrent jobs depending on plan. |
| Hosting model (10%) | ●●●●● | Cloud, self-hosted runners (hybrid) and CircleCI Server for on-prem. |
| Pricing transparency (10%) | ●●●●● | Published, but in credits per resource class, seats and features you convert yourself. |
| Migration effort (15%) | ●●●●● | New config format and new concepts (orbs, executors, contexts). |
| Ecosystem (10%) | ●●●●● | A large orb registry for common tools and clouds. |
| Fit for agent-written changes (15%) | ●●●●● | Smarter Testing runs the tests a change affects; allowances are capped per plan. It has an MCP server. |
Strengths
- Timing-based test splitting across parallel containers
- Smarter Testing: runs the tests a change affects (generally available, metered in test atoms)
- Docker, Linux, Windows, Arm, macOS and GPU resource classes; self-hosted runners and a server edition
- Orbs: reusable packaged config
Limits
- Credits make costs harder to predict than per-minute pricing
- Moving from GitHub Actions means rewriting config to .circleci/config.yml
- Smarter Testing allowances are capped per plan
- A separate product from where your code and reviews live
Cost
Free plan with 30,000 credits a month (up to 6,000 small Docker build minutes); Performance from $15 a month; Scale is quoted. Credit rates per machine are on its price list. As published on CircleCI’s pricing page; check there before you budget.
Verdict
CircleCI is a capable, mature platform that has long done test splitting well and now also runs only the tests a change affects. It covers more machine types than most, including macOS and GPU, and offers a server edition for self-hosting. It ranks in the middle because credits make the bill hard to predict and moving to it from GitHub Actions is a rewrite. If you are choosing a dedicated CI product today rather than speeding up GitHub Actions, put it on your shortlist next to Buildkite.