Harness

Continuous Integration

VS

CircleCI

Continuous Integration

Harness CI is an enterprise–grade, cloud native CI product. It’s designed for developer self-service while enabling DevOps and Platform engineers to extend granular and customized governance at scale.
Free Trial

CircleCI

CircleCI is a modern continuous integration and continuous delivery (CI/CD) platform. CircleCI automates build, test, and deployment of software.

Company size
Company size

600+

Founded
Founded

2011

Funding
Funding

315m

CircleCI is categorized as:
Continuous Integration

Harness DevOps Tools Vs. CircleCI

CircleCI vs Drone: DevOps Tools Comparison | Harness

Updated

April 25, 2022

  • Open Source Version
  • GitHub Stars
  • Self-Service (Simple)
  • No Scripting Required
  • Container & Cloud-Native
  • Traditional App Support
  • GitOps (Pipelines as Code)
  • Any Source Code Manager
  • Containerized Pipelines
  • Containerized Plugins
  • Secrets Management
  • Command Line Interface
  • Scalability (Required Infra)
  • Admin & Maintenance
  • Total Cost of Ownership
  • Pricing

Free & Paid

24800

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

Vault/KMS/3rd

<yes><yes>

Lightweight

<yes><yes> .25 FTE

<yes><yes>

<yes><yes> Per User

Free & Paid

1100

<with><with>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<yes><yes>

<with><with> Community

<yes><yes>

<with><with>

<with><with> FTE

<with><with>

<with><with> Per User & Pipeline Minute


Detailed Feature Comparison

Harness DevOps tools Vs. CircleCI

Open source vs. Open core:

CircleCI currently only offers a paid product version. While there is a free version, free definitely does not mean open-source. The free version is quite limited, and while it may work for very small businesses or personal projects, it will not suffice for more established businesses. Drone is open-source. There is, however, a paid version of Drone that provides access to enterprise support and more integrations and features. Additional features include secrets management options, autoscaling, custom plugins, and more.

Self-Service (Simple):

Let’s start with the good: CircleCI is fairly easy to adopt. It also offers customizable/flexible build environments. It was built for speed, boasts a heft amount of integrations, and definitely rates as one of the better CI tools on the market. They have their own system called Orbs, which are basically what other CI/CD tools would call plugins. And now, for the bad: Jobs can take a long time and can be buggy if modified, necessitating users to cancel the workflow and restart it. CircleCI also struggles with uptime and reliability. For more advanced users, the lack of context in some pull requests can be cumbersome and result in needing to go to GitHub’s API yourself – for example, build environments don’t get context about the target branch of a given pull request. This adds more complexity to your workflows. Lastly, there’s some very mixed feedback on the new UI, with users calling it frustrating, complex, and confusing. Drone is built upon three pillars that enable engineers to build and test code quickly and accurately: simple, scalable, self-service. Drone installs in under 5 minutes, scales on demand, and all plugins run in containers on their latest version. This means less person hours spent by engineers maintaining the tool, and more time on what matters: getting that code to artifact.

Secrets Management:

For secrets management, CircleCI users have three options: store secrets as plain text using Contexts resources or environment variables, then echo them into files at job runtime via config.yml; encrypt files and store them in your source repository but store the decryption keys in CircleCI, again either via Contexts or job environment variables, then decrypt as needed at job runtime; use third-party secret management tools, like HashiCorp Vault, as long as the tool has a headless CLI-accessible option that can be used in a CircleCI job. Drone offers secrets encryption on its open-source plan. Meanwhile, the enterprise plan offers these alternatives: encrypted, native, or externally-managed through third-party providers such as AWS Secret Manager, Kubernetes Secrets, and HashiCorp Vault. To expand a bit on the “native” aspect of things, Drone has its own secrets management function – CircleCI does not have this capability. Whether you’re a fan of Vault, encryption, or native secrets storage, Drone can rise to the occasion.

Scalability:

There’s room for improvement when it comes to scalability with CircleCI, which is ironic considering “speed and scale” are two of their selling points. We have learned that, for container-based plans, jobs can get queued if there aren’t enough containers to accommodate the workload. This gives CircleCI a thumbs down on scalability and load balancing. Drone Enterprise makes sure scaling is never a problem with various possible autoscaling integrations, such as Amazon EC2, Digital Ocean, Google Computer, Hetzner, Open Stack, and Packet.

Admin & Maintenance:

CircleCI doesn’t exactly rival Jenkins in terms of FTEs required, but it’s not far off. While Jenkins requires between 2-5 FTEs, CircleCI still requires 2. This measure includes initial setup and continuing maintenance to keep CircleCI in working order. Drone easily stamps out maintenance issues at a whopping .25 FTEs needed (that’s not a typo). It’s an extremely portable solution without scripting, plugin maintenance, or dependency hell – or much else in terms of maintenance, for that matter. The plug-and-play nature of Drone ensures the only work you have to perform on it, other than the initial setup and configuration of course, is administration – such as adding and removing users, permissions, etc.

Total Cost of Ownership:

Totaling CircleCI’s operating costs along with the FTEs needed to maintain it, cost of ownership can add up fairly quickly. Drone prides itself on being a more economical alternative to CircleCI.

Pricing:

Being one of the more feature-rich CI tools out there, CircleCI certainly flaunts the price tag! Back in 2020, they updated their pricing model and the change was poorly-received. This new model removed the predictability aspect of their pricing, and some users were disgruntled by their rising cloud costs. You pay for credits. Credits pay for users, usage and features so you have you bear those three variable in mind to make proper estimates of your costs. An example from their website: “25,000 credit package would provide 2,500 build minutes when using a Docker or Linux “medium” compute at 10 credits per minute.” What is “medium” compute? What if I add more users? Is this linear? What if I start using a feature? Those are some of the questions the upfront pricing information suggests. To add a bit more complexity, credits expire so you better get ready to make all sorts of cost estimates in time to take advantage of them. But there’s more. The hidden costs don’t come in day 2 but rather down the line. Managing network transfer and storage data which are the hidden costs on CircleCi. From their website “... network and storage beyond the monthly thresholds are charged at 420 credits/GB ($0.252/GB). Drone’s open-source version is free and available for download. To familiarize yourself with enterprise pricing, please contact sales.

*Please note: Our competitors, just like us, release updates to their products on a regular cadence. We keep these pages updated to the best of our ability, but there are bound to be discrepancies. For the most up-to-date information on competitor features, browsing the competitor’s new release pages and communities are your best bet.

Try Harness For Free


Continuous Integration

Interested in seeing what's under the hood? Browse through the Harness Continuous Integration Product

Still Not Convinced?

Select any one of the logos below to check out how we stack up to these guys.

Ready To Get Started?

Access the Harness CI/CD Platform

Get StartedContact Sales

Need more info? Contact Sales