Best CI/CD platforms (worth paying for?)

We asked 10 models: Which CI/CD platforms are actually worth paying for? Each named its own top 10.

Asked 4 ways: List request · Buyer asking for advice · Search query · Worth paying for?. Share of voice pools every wording.

Agreement between models: 80%
Same model, run twice: 87%
Different picks: 25

When agreement between models is well below a model's agreement with itself, the split reflects real differences in taste rather than randomness.

The consensus

Each cell is the position that model gave the pick; blank means it left the pick off. Click a row for each model's reasoning.

#	Pick	Listed by	Claude Haiku 5.5	GPT-6 Luna	Gemini 4 Argon	Qwen 3.8 Flash	DeepSeek V4 Pro	GLM-5.3	Kimi K3	MiniMax M3	Mistral Large 4	Nemotron 3 Ultra
1	GitHub Actions	10/10	1	1	1	1	1	3	1	1	1	1
Claude Haiku 5.5 (#1) Deep GitHub integration, generous included minutes, and a huge marketplace of reusable actions. GPT-6 Luna (#1) Best balance of ecosystem, usability, and included value for GitHub-hosted projects. Gemini 4 Argon (#1) Unbeatable ecosystem integration, massive marketplace, and seamless developer experience where code already lives. Qwen 3.8 Flash (#1) Best value: massive ecosystem, seamless for most teams. DeepSeek V4 Pro (#1) Deepest GitHub integration, massive marketplace, generous free tier before paying. Kimi K3 (#1) Best value; integrated with GitHub, generous free tier, massive marketplace. MiniMax M3 (#1) Best value for most teams; generous free tier, huge marketplace. Mistral Large 4 (#1) Best developer experience, tight repo integration, generous free tier, huge marketplace. Nemotron 3 Ultra (#1) Best developer experience, generous free tier, seamless GitHub integration GLM-5.3 (#3) Deep GitHub integration, huge ecosystem, generous hosted runners; best overall value.
2	GitLab	10/10	2	3	2	2	2	1	2	2	2	2
GLM-5.3 (#1) Built-in pipelines, security scanning, and artifacts in one DevOps platform. Claude Haiku 5.5 (#2) Strong all-in-one DevSecOps platform with built-in registry, security scanning, and self-hosting. Gemini 4 Argon (#2) The most complete all-in-one DevSecOps pipeline with exceptional enterprise governance and built-in security. Qwen 3.8 Flash (#2) Complete DevOps platform with strong built-in CI/CD. DeepSeek V4 Pro (#2) Single platform for repo, CI, CD, and security; excellent value at scale. Kimi K3 (#2) Complete DevSecOps platform; excellent CI/CD with strong self-hosting options. MiniMax M3 (#2) Self-hosted option and integrated security features justify cost. Mistral Large 4 (#2) Complete DevOps platform, powerful pipeline features, excellent self-hosted option. Nemotron 3 Ultra (#2) Complete DevOps platform, built-in security, excellent Docker support GPT-6 Luna (#3) Integrated source control, security, and deployment workflows make the paid tiers worthwhile.
3	CircleCI	10/10	3	4	4	3	3	2	3	3	3	3
GLM-5.3 (#2) Fast parallel builds and excellent caching; strong for speed-focused teams. Claude Haiku 5.5 (#3) Fast builds, strong caching and parallelism, and mature pipeline tooling for teams. Qwen 3.8 Flash (#3) Fast, reliable pipelines with excellent scaling and caching. DeepSeek V4 Pro (#3) Blazing fast builds, advanced caching, and robust parallelism for serious teams. Kimi K3 (#3) Fast, reliable pipelines; great Docker support and debugging experience. MiniMax M3 (#3) Reliable, fast runners and strong caching for serious pipelines. Mistral Large 4 (#3) Fast, reliable execution with excellent Docker support and intuitive configuration. Nemotron 3 Ultra (#3) Fast builds, great parallelism, excellent caching, config-as-code GPT-6 Luna (#4) Mature workflows, strong caching, and broad integrations suit demanding delivery pipelines. Gemini 4 Argon (#4) Raw speed, superior caching, and deep Docker support make it worth every penny.
4	Buildkite	10/10	4	2	3	4	5	6	4	5	4	4
GPT-6 Luna (#2) Excellent control and performance for teams needing scalable, self-hosted agents. Gemini 4 Argon (#3) Best-in-class hybrid architecture offering cloud orchestration with blazing-fast, secure self-hosted build agents. Claude Haiku 5.5 (#4) Self-hosted agents on your own infrastructure with a polished hosted control plane. Qwen 3.8 Flash (#4) Hybrid model gives control plus great developer experience. Kimi K3 (#4) Hybrid architecture; scalable agents with strong security and performance. Mistral Large 4 (#4) Blazing fast, scalable, runs on your infrastructure with unmatched flexibility. Nemotron 3 Ultra (#4) Hybrid architecture, infinite scalability, own infrastructure control DeepSeek V4 Pro (#5) Hybrid model keeps code secure on your infra with a stellar managed UI. MiniMax M3 (#5) Hybrid model keeps secrets in-house; loved by platform teams. GLM-5.3 (#6) Hybrid SaaS+self-hosted runners; elastic scaling at your own infrastructure cost.
5	Jenkins	9/10	5	7		5	4	4	6	4	5	7
DeepSeek V4 Pro (#4) Unmatched plugin ecosystem and on-prem control; worth it with CloudBees support. GLM-5.3 (#4) Enterprise staple with unmatched plugin ecosystem; support/training worth paying for. MiniMax M3 (#4) Paid CloudBees tier adds governance and support over DIY Jenkins. Claude Haiku 5.5 (#5) Free and endlessly flexible, but paid support or CloudBees distributions are worth it at scale. Qwen 3.8 Flash (#5) Unmatched plugin flexibility; still the enterprise workhorse. Mistral Large 4 (#5) Free, infinitely customizable, massive plugin ecosystem, though maintenance-heavy. Kimi K3 (#6) Free and infinitely customizable; worth paying for CloudBees support at scale. GPT-6 Luna (#7) Free and extensible, while paid support can justify itself for complex legacy environments. Nemotron 3 Ultra (#7) Unmatched flexibility, massive plugin ecosystem, self-hosted control
6	Harness	6/10	6	6	5	6	6				8
Gemini 4 Argon (#5) Enterprise-grade continuous delivery with AI-driven verification and unmatched deployment governance. Claude Haiku 5.5 (#6) Strong deployment verification and progressive delivery for larger engineering organizations. GPT-6 Luna (#6) Powerful deployment automation and governance justify its cost for larger delivery organizations. Qwen 3.8 Flash (#6) AI-driven CD with cost management and governance features. DeepSeek V4 Pro (#6) AI-driven delivery and cost optimization that actually reduces cloud waste. Mistral Large 4 (#8) Superior deployment automation, intelligent rollback, and cost optimization at scale.
7	Azure Pipelines	5/10	7	5	6			5		8
GPT-6 Luna (#5) A strong paid choice for Microsoft-heavy organizations and enterprise governance. GLM-5.3 (#5) Great for Azure-centric shops; multi-platform, multi-language builds. Gemini 4 Argon (#6) Incredible value for enterprise teams needing robust multi-platform builds and deep cloud integration. Claude Haiku 5.5 (#7) Solid choice for Microsoft-centric shops with generous free tier and tight Azure integration. MiniMax M3 (#8) Solid for Microsoft shops; free minutes are generous.
8	TeamCity	6/10	9	8	7			7	7		7
Gemini 4 Argon (#7) Powerful out-of-the-box configuration and Kotlin DSL for complex, stateful enterprise build chains. GLM-5.3 (#7) Powerful, mature build configuration; JetBrains polish and Kotlin DSL. Kimi K3 (#7) Powerful build management; excellent for complex enterprise build chains. Mistral Large 4 (#7) Robust build management from JetBrains, excellent for complex enterprise pipelines. GPT-6 Luna (#8) Polished build configuration and dependable integrations make its commercial offering compelling. Claude Haiku 5.5 (#9) Excellent build chain management and good out-of-box experience for enterprise .NET and Java teams.
9	Bitbucket Pipelines	8/10	8	10			7	9	9	7	9	9
MiniMax M3 (#7) Convenient if already on Atlassian; otherwise limited value. Claude Haiku 5.5 (#8) Convenient for teams already on Bitbucket, with simple YAML and fair pricing. Kimi K3 (#9) Seamless Atlassian integration; good value for existing Bitbucket users. Nemotron 3 Ultra (#9) Native Bitbucket integration, simple YAML, good Docker support
10	Azure DevOps	3/10					9		5		6
Kimi K3 (#5) Strong enterprise features; excellent for Microsoft-stack organizations. Mistral Large 4 (#6) Deep Microsoft ecosystem integration, strong for enterprise .NET and Azure shops.
11	Travis CI	5/10				9	8		8		10	10
Kimi K3 (#8) Simple, reliable; good for open-source and smaller teams. Qwen 3.8 Flash (#9) Simple setup historically popular, though less innovative lately. Mistral Large 4 (#10) Simple, developer-friendly for open source, though less competitive for enterprise now. Nemotron 3 Ultra (#10) Simple setup, great open source support, macOS builds included
12	Semaphore	2/10				7						6
No reasons recorded.
13	Bitrise	2/10			10							5
No reasons recorded.
14	Drone	1/10								6
MiniMax M3 (#6) Lightweight, container-native, affordable for self-hosted needs.
15	AWS CodePipeline	2/10	10			8
Qwen 3.8 Flash (#8) Native integration makes it compelling within AWS ecosystems.

10 lower-scoring picks are not shown; every ballot below lists them in full.

Most divisive

Picks most models listed, at very different positions

Buildkite#2 for GPT-6 Luna #6 for GLM-5.3
Jenkins#4 for DeepSeek V4 Pro #7 for Nemotron 3 Ultra
Harness#5 for Gemini 4 Argon #8 for Mistral Large 4

Hot takes

Picks that appear on only one ballot

Drone at #6, only MiniMax M3
Spacelift at #8, only Gemini 4 Argon
GitHub Enterprise Cloud at #8, only GLM-5.3
Codefresh at #8, only Nemotron 3 Ultra
CloudBees CI at #9, only GPT-6 Luna
Dagger at #9, only Gemini 4 Argon
Octopus Deploy at #10, only DeepSeek V4 Pro
Jenkins X at #10, only GLM-5.3
Bamboo at #10, only Kimi K3
Argo CD at #10, only MiniMax M3

Every ballot

Hover a pick to find it on the other ballots. Marked picks appear on no other ballot.

Claude Haiku 5.5

GitHub Actions
GitLab
CircleCI
Buildkite
Jenkins
Harness
Azure Pipelines
Bitbucket Pipelines
TeamCity
AWS CodePipeline

99% with consensus · 92% self-consistent

GPT-6 Luna

GitHub Actions
Buildkite
GitLab
CircleCI
Azure Pipelines
Harness
Jenkins
TeamCity
CloudBees CI
Bitbucket Pipelines

84% with consensus · 91% self-consistent

Gemini 4 Argon

GitHub Actions
GitLab
Buildkite
CircleCI
Harness
Azure Pipelines
TeamCity
Spacelift
Dagger
Bitrise

87% with consensus · 97% self-consistent

Qwen 3.8 Flash

GitHub Actions
GitLab
CircleCI
Buildkite
Jenkins
Harness
Semaphore
AWS CodePipeline
Travis CI
Spinnaker

92% with consensus · 85% self-consistent

DeepSeek V4 Pro

GitHub Actions
GitLab
CircleCI
Jenkins
Buildkite
Harness
Bitbucket Pipelines
Travis CI
Azure DevOps
Octopus Deploy

92% with consensus · 85% self-consistent

GLM-5.3

GitLab
CircleCI
GitHub Actions
Jenkins
Azure Pipelines
Buildkite
TeamCity
GitHub Enterprise Cloud
Bitbucket Pipelines
Jenkins X

67% with consensus · 59% self-consistent

Kimi K3

GitHub Actions
GitLab
CircleCI
Buildkite
Azure DevOps
Jenkins
TeamCity
Travis CI
Bitbucket Pipelines
Bamboo

90% with consensus · 95% self-consistent

MiniMax M3

GitHub Actions
GitLab
CircleCI
Jenkins
Buildkite
Drone
Bitbucket Pipelines
Azure Pipelines
Spinnaker
Argo CD

88% with consensus · 93% self-consistent

Mistral Large 4

GitHub Actions
GitLab
CircleCI
Buildkite
Jenkins
Azure DevOps
TeamCity
Harness
Bitbucket Pipelines
Travis CI

94% with consensus · 90% self-consistent

Nemotron 3 Ultra

GitHub Actions
GitLab
CircleCI
Buildkite
Bitrise
Semaphore
Jenkins
Codefresh
Bitbucket Pipelines
Travis CI

85% with consensus · 84% self-consistent

Who agrees with whom

Overlap between two models' lists, weighted toward the top · 100 means identical · Color runs from 56 (lightest) to 96 (darkest)

	Claude Haiku 5.5	GPT-6 Luna	Gemini 4 Argon	Qwen 3.8 Flash	DeepSeek V4 Pro	GLM-5.3	Kimi K3	MiniMax M3	Mistral Large 4	Nemotron 3 Ultra
Claude Haiku 5.5		83	86	93	92	67	88	89	92	85
GPT-6 Luna	83		86	78	76	56	76	73	78	74
Gemini 4 Argon	86	86		81	79	58	80	76	82	77
Qwen 3.8 Flash	93	78	81		91	60	87	85	90	88
DeepSeek V4 Pro	92	76	79	91		65	88	91	90	83
GLM-5.3	67	56	58	60	65		63	67	65	58
Kimi K3	88	76	80	87	88	63		84	96	86
MiniMax M3	89	73	76	85	91	67	84		86	83
Mistral Large 4	92	78	82	90	90	65	96	86		86
Nemotron 3 Ultra	85	74	77	88	83	58	86	83	86