# CompaTool™ — Universal Software Benchmark & Compatibility Engine

> The authoritative, multi-dimensional software benchmark evaluating software tools across the 7 orthogonal pillars of software engineering.

## Core Capabilities & Documentation
- **Home & Live Leaderboard:** https://compatool.com/
- **Benchmark Methodology & Formulas:** https://compatool.com/methodology.html
- **Machine-Readable Benchmark Dataset:** https://compatool.com/data/benchmarks.json

## The 7 Pillars of Software Quality
1. **Performance & Latency (S_perf):** p95/p99 latency under concurrent load, cold start bootstrap time, peak memory footprint (RSS), concurrency scaling.
2. **Interoperability & Standards (S_compat):** OS support (Linux, macOS, Windows), Architecture (x86_64, ARM64), open protocol compliance (Model Context Protocol 1.0+, POSIX, OpenAPI, JSON-RPC).
3. **Reliability & Determinism (S_rel):** Empirical flake rate, output determinism, graceful degradation under throttling, mean-time-to-recovery (MTTR).
4. **Security, Privacy & Sandboxing (S_sec):** Isolation level (MicroVM, WASM, Container, Process), permission granularity, CVE count, air-gapped sovereign execution.
5. **Developer Experience & Ergonomics (S_dx):** Time-to-first-run (TTFR), intuitive CLI/API ergonomics, diagnostic error clarity, OpenTelemetry support.
6. **Architecture & Extensibility (S_arch):** Modularity, plugin SDK maturity, vendor lock-in avoidance, OSI-approved open source licensing.
7. **Total Cost of Ownership & Resource Efficiency (S_cost):** Licensing cost, token/compute efficiency, operational maintenance toil.

## Audited Tool Categories
- **AI Coding Agents:** Claude Code, Cursor, Windsurf, Antigravity, Devin, Aider, OpenHands, Cline.
- **Model Context Protocol (MCP) Servers:** Filesystem MCP, PostgreSQL MCP, GitHub MCP, Brave Search MCP, Chrome DevTools MCP, Memory Graph MCP, Docker MCP.
- **Systems & Runtimes:** Bun, Node.js, Deno, Wasmtime.
- **Data & Vector Engines:** SQLite, DuckDB, PostgreSQL + pgvector, Qdrant, Pinecone.
- **Toolchains & Package Managers:** uv, bun pm, pnpm, cargo.
- **Testing & QA:** Playwright, Vitest, Cypress.