Symbol index for AI coding agents — 47-4400× faster than grep -rn, 85% fewer bytes, structured JSON output. Rust + SQLite + Tantivy + tree-sitter.
  • Rust 76.1%
  • Shell 17.4%
  • Python 2.7%
  • HTML 2.3%
  • Nix 0.6%
  • Other 0.8%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
dependabot[bot] 9cd74503c6
chore(deps): bump sysinfo from 0.39.6 to 0.40.1 (#821)
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.39.6
to 0.40.1.
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/GuillaumeGomez/sysinfo/blob/main/CHANGELOG.md">sysinfo's
changelog</a>.</em></p>
<blockquote>
<h1>0.40.1</h1>
<ul>
<li>Add back <code>From&lt;X&gt; for Vec&lt;Y&gt;</code> trait
implementations for <code>Disks</code>, <code>Gpus</code>,
<code>Groups</code> and <code>Users</code>.</li>
<li>Windows: <code>System::load_average</code> now returns
<code>Err(Error::Unsupported)</code>.</li>
</ul>
<h1>0.40.0</h1>
<ul>
<li>Add new <code>gpu</code> feature.</li>
<li>Add new <code>Process::gpu_usage</code> and
<code>Process::gpu_memory</code> API.</li>
<li>Add new <code>GPUs</code> API.</li>
<li>Add new <code>NetworkData::transmit_link_speed</code> and
<code>NetworkData::receive_link_speed</code> API.</li>
<li>Add new <code>Disk::id</code> API.</li>
<li>Remove <code>IS_SUPPORTED_SYSTEM</code> constant.</li>
<li>Remove <code>set_open_files_limit</code> API.</li>
<li>Remove <code>list[_mut]</code> methods for <code>Users</code>,
<code>Components</code> and <code>Disks</code>.</li>
<li>Remove <code>Networks::list</code> method.</li>
<li>Remove <code>From</code> trait implementations for
<code>Users</code>, <code>Groups</code> and <code>Disks</code>.</li>
<li>Fix <code>Networks</code> refresh.</li>
<li><code>Networks</code> interface names have been switched from
<code>String</code> to <code>OsString</code>.</li>
<li>Unix: Fix not thread-safe code in <code>Groups</code>.</li>
<li>Unix: Fix potential crash when a user's group cannot be
retrieved.</li>
<li>Linux: Correctly mark a process as existing after update.</li>
<li>Linux: Fix cgroup memory information retrieval.</li>
<li>Linux: Multiple performance optimizations and memory usage
reduction.</li>
<li>Linux: Fixes for thermal zone temperatures.</li>
<li>Linux: Keep <code>Component</code> max temperature across
refreshes.</li>
<li>Android: Fall back to <code>/proc/cpuinfo</code> when
<code>/proc/stat</code> is unreadable.</li>
<li>Raspberry Pi: Fix toolchain package name in README.</li>
<li>FreeBSD/NetBSD: Fix <code>System::free_memory</code> and
<code>System::available_memory</code>.</li>
<li>FreeBSD: Correctly query <code>sysctl</code> values.</li>
<li>FreeBSD: Fix swap memory information retrieval.</li>
<li>NetBSD: Fix <code>Process::accumulated_cpu_time</code> unit.</li>
<li>macOS: Implement <code>System::open_files_limit</code>.</li>
<li>macOS: Fix bug in <code>Disks::refresh</code>.</li>
<li>iOS: Mark <code>Networks</code> as unsupported.</li>
<li>iOS: Make <code>Process::open_files</code> return
<code>None</code>.</li>
<li>Windows: Don't keep thread-less processes alive.</li>
<li>Windows: Fix CPU brand on ARM64.</li>
<li>Windows: Fix crash in <code>Components::refresh</code>.</li>
</ul>
</blockquote>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="75dcd2c681"><code>75dcd2c</code></a>
Merge pull request <a
href="https://redirect.github.com/GuillaumeGomez/sysinfo/issues/1790">#1790</a>
from GuillaumeGomez/update</li>
<li><a
href="15a5e93c71"><code>15a5e93</code></a>
Update crate version to <code>0.40.1</code></li>
<li><a
href="4f252bd13c"><code>4f252bd</code></a>
Update CHANGELOG for <code>0.40.1</code></li>
<li><a
href="4a7b9e7c8f"><code>4a7b9e7</code></a>
Merge pull request <a
href="https://redirect.github.com/GuillaumeGomez/sysinfo/issues/1789">#1789</a>
from GuillaumeGomez/from</li>
<li><a
href="b19150a017"><code>b19150a</code></a>
Add back <code>From\&lt;X&lt;Y&gt;&gt; for Vec\&lt;Y&gt;</code>
implementations for <code>Users</code>, <code>Groups</code> and
`G...</li>
<li><a
href="e27239a5b8"><code>e27239a</code></a>
Windows: mark <code>System::load_average</code> as unsupported (<a
href="https://redirect.github.com/GuillaumeGomez/sysinfo/issues/1788">#1788</a>)</li>
<li><a
href="70c58c7701"><code>70c58c7</code></a>
Fix wrong supported system list for <code>GPUs</code></li>
<li><a
href="13e94d5533"><code>13e94d5</code></a>
Windows: mark <code>System::load_average</code> as unsupported</li>
<li><a
href="34677fe75c"><code>34677fe</code></a>
allow getting owned <code>Disk</code> from <code>Disks</code> (<a
href="https://redirect.github.com/GuillaumeGomez/sysinfo/issues/1786">#1786</a>)</li>
<li><a
href="48972c49bf"><code>48972c4</code></a>
Merge pull request <a
href="https://redirect.github.com/GuillaumeGomez/sysinfo/issues/1784">#1784</a>
from GuillaumeGomez/update</li>
<li>Additional commits viewable in <a
href="https://github.com/GuillaumeGomez/sysinfo/compare/v0.39.6...v0.40.1">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=sysinfo&package-manager=cargo&previous-version=0.39.6&new-version=0.40.1)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

<!-- codesmith:footer -->
---
<a
href="https://backend.blacksmith.sh/track/enable-autofix?expires=1796440622&installation_model_id=429074&pr_number=821&ref=codesmith_pr_footer&repository=8b-is%2Fcrabcc&return_to=https%3A%2F%2Fgithub.com%2F8b-is%2Fcrabcc%2Fpull%2F821&signature=c2dfafd207769b1dd32911a8fbc44fd89da3c2e2698f93778cb31f54bb9c2f2d"><picture><source
media="(prefers-color-scheme: dark)"
srcset="https://pr-comments-assets.blacksmith.sh/codesmith/autofix-with-codesmith-dark.svg"><source
media="(prefers-color-scheme: light)"
srcset="https://pr-comments-assets.blacksmith.sh/codesmith/autofix-with-codesmith-light.svg"><img
alt="Autofix with [code]smith"
src="https://pr-comments-assets.blacksmith.sh/codesmith/autofix-with-codesmith-dark-3x.png"
width="190" height="28"></picture></a>
<sup><a
href="https://app.blacksmith.sh/8b-is/codesmith/crabcc/pr/821?autoLogin=true&ref=codesmith_pr_footer">Open
in [code]smith</a> · Need help on this PR? Tag
<code>@codesmith-bot</code> with what you need.</sup>

<!-- codesmith:autofix:disabled -->
<!-- /codesmith:footer -->

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: 8bit-Wraith <wraith@8b.is>
Co-authored-by: Codex <codex@localhost>
2026-11-15 18:41:16 -05:00
.cargo perf(build): bundle of zero-risk compile-time cuts (#179) 2026-04-30 22:42:46 +02:00
.claude chore: stop dead hook entries from erroring on every event 2026-08-12 23:26:59 +02:00
.codex chore(devenv): add .codex/environment.json, fix devcontainer system deps 2026-06-11 11:44:58 +02:00
.config chore(deps): bump sysinfo from 0.39.6 to 0.40.1 (#821) 2026-11-15 18:41:16 -05:00
.cursor chore(cursor): add fast non-blocking hook for Rust edits 2026-05-08 13:30:25 +02:00
.devcontainer chore(devenv): add .codex/environment.json, fix devcontainer system deps 2026-06-11 11:44:58 +02:00
.github chore(actions): bump the github-actions group with 4 updates (#825) 2026-11-12 04:29:30 +00:00
agents task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
apps task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
assets task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
commands task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
compact-server task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
crates chore(deps): bump sysinfo from 0.39.6 to 0.40.1 (#821) 2026-11-15 18:41:16 -05:00
docs task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
editors/zed/crabcc task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
examples task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
experiments/codon task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
extensions/crabcc-devshell task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
install task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
internal_agents task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
nix fix(ci): stop building packages the workspace no longer has (#800) 2026-10-26 02:17:19 +09:00
patches task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
schema cleanup: restore schema, trim README 2026-06-22 11:51:25 +02:00
scripts fix(dev): drop the bench lane whose crate was removed (#801) 2026-10-26 02:14:20 +09:00
skill task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
taskfiles task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
tools task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
.actrc feat(viz): mobile UI, GitHub PR forge, git analytics, and PR impact graph (#585) 2026-05-22 13:16:27 +02:00
.cccignore chore+feat: drop Repowise; add install --target-home for multi-profile (#726) 2026-06-05 08:16:25 +02:00
.crabcc-cli.conf perf: per-session MCP Store + shell status, agent-mcp bench, memory query_brute defer-decode (#648) 2026-06-06 05:17:38 +02:00
.dockerignore feat(viz): mobile UI, GitHub PR forge, git analytics, and PR impact graph (#585) 2026-05-22 13:16:27 +02:00
.editorconfig feat: FSST string compression (issue #1) — v2.0.0-alpha foundation (#10) 2026-04-30 01:59:45 +02:00
.envrc feat: token-opt commands (csv/squeeze) + Nix devShell + superpowers; v6.1.0 (#686) 2026-06-04 19:55:06 +02:00
.gitignore chore: gitignore .tmp.driveupload/ — 5.57 GB of Google Drive blobs swept from history, keep them out 2026-08-12 23:56:45 +02:00
.mcp.json chore+feat: drop Repowise; add install --target-home for multi-profile (#726) 2026-06-05 08:16:25 +02:00
.pr_agent.toml fix(pr-agent): route through OpenRouter via .pr_agent.toml (#597) 2026-06-03 21:33:30 +02:00
.repomixignore Retire the macOS app layer (Crabcc.app / DMG / LaunchAgents) 2026-06-05 13:01:29 +02:00
.tools feat: token-opt commands (csv/squeeze) + Nix devShell + superpowers; v6.1.0 (#686) 2026-06-04 19:55:06 +02:00
AGENTS.md feat(scripting): adopt Amber as shell scripting standard; fix find_swaps_to_ripgrep regression 2026-06-11 13:59:43 +02:00
Cargo.lock chore(deps): bump sysinfo from 0.39.6 to 0.40.1 (#821) 2026-11-15 18:41:16 -05:00
Cargo.toml chore(deps): bump fsst-rs from 0.6.0 to 0.7.0 (#822) 2026-11-06 10:58:03 +00:00
CHANGELOG.md ci: faster review+merge — advisory perf/lint on PR, de-flood Codex, proactive auto-fix (#752) 2026-06-11 21:46:34 +02:00
CLAUDE.md docs: align CLAUDE.md/AGENTS.md with Claude Code memory best practices (#724) 2026-06-06 05:13:18 +02:00
clippy.toml feat: FSST string compression (issue #1) — v2.0.0-alpha foundation (#10) 2026-04-30 01:59:45 +02:00
CONTRIBUTING.md Hybrid memory search + repo filter; retire the desktop app 2026-06-05 13:01:29 +02:00
deny.toml feat(memory): markdown sanitizer for drawer bodies (closes #54) (#73) 2026-04-30 08:02:26 +02:00
Dockerfile feat: crabcc upgrade (CLI+MCP+slash-cmd) + shell completions (#13) 2026-04-30 02:34:55 +02:00
flake.nix fix(ci): stop building packages the workspace no longer has (#800) 2026-10-26 02:17:19 +09:00
install.sh fix: make crabcc build from a clean clone under 8b-is (#780) 2026-10-11 06:54:53 +09:00
README.md task: add review - pre-push self-review (crabcc affected + /code-review) (#753) 2026-10-11 06:58:55 +09:00
repomix.config.json chore(repomix): strict .repomixignore + repomix.config.json + targeted-pack task (#120) 2026-04-30 12:43:07 +02:00
rust-toolchain.toml chore(toolchain): switch to nightly Rust + update all deps 2026-06-11 11:46:25 +02:00
rustfmt.toml feat: FSST string compression (issue #1) — v2.0.0-alpha foundation (#10) 2026-04-30 01:59:45 +02:00
SECURITY.md chore: remove standalone BullMQ worker app + jobs infra remnants (#674) 2026-06-04 16:25:06 +02:00
Taskfile.yml fix(task): fix Taskfile.yml YAML parse errors (mastodon-verify + release-post) 2026-06-11 11:44:36 +02:00

crabcc

Symbol index for AI coding agents.

4412× faster than grep. 85% fewer bytes sent to the LLM. MCP-native.

Quick start

# Install
curl -fsSL https://raw.githubusercontent.com/8b-is/crabcc/main/install.sh | bash

# Index a repo
cd your-project
crabcc index

# Query
crabcc lookup sym ParseError        # find symbol definition
crabcc lookup refs ParseError       # find all references
crabcc lookup outline src/main.rs   # structural outline

# MCP server (for AI agent tools)
crabcc serve

Core commands

Command What
crabcc index Build symbol database (~5-30s for monorepo)
crabcc lookup sym <name> Find symbol definition
crabcc lookup refs <name> Find all references
crabcc lookup outline <file> Structural outline
crabcc graph Call-graph operations
crabcc memory AI memory (past findings)
crabcc serve MCP server + localhost viewer

Internal agents (per-crate specialists)

crabcc agent --profile internal/<name> loads a per-crate agent profile from internal_agents/. Each profile pairs a TOML config (model, max-iterations, env, gate commands) with a Markdown system prompt that specialises an agent for one crate. Five profiles ship today:

Profile Owns Bench gates
internal/crabcc-core indexing + storage + query primitives task bench-compress, task bench
internal/crabcc-cli clap surface + agent runtime + manager —
internal/crabcc-mcp stdio MCP server + tool surface cargo bench -p crabcc-mcp
internal/crabcc-memory AI memory layer + miners + embedders task memory-bench
internal/crabcc-viz localhost dashboard + sync HTTP —

Each profile pulls in internal_agents/shared.agent.md as a preamble (rebase-first workflow, lint/test/PR contract, manager coordination). Missing profiles error hard with the available list — typos never silently fall through to "no profile". Profile env (default CRABCC_BUILD_PROFILE=release-native) is exported to the spawned agent's child process.

# Drive a single crate-specialist on the host:
crabcc agent --profile internal/crabcc-core --run "audit hot loops in extract.rs"

# Per-crate repomix bundle (much smaller than full repo) for the agent:
task repomix-crate CRATE=crabcc-core

Running all five in parallel via Apple container

Apple's container is a Mac-native OCI runtime backed by Virtualization.framework — drop-in for Docker on arm64. The bundled install/internal-agents/{Containerfile,compose.yml} work with both.

# 1. Install Apple container (one-time, macOS 15+):
brew install apple/container/container          # Homebrew tap
# Or from the official release: https://github.com/apple/container/releases

# 2. Build the image (uses the BuildKit-style Containerfile):
container build -t crabcc-internal-agents:dev \
    -f install/internal-agents/Containerfile .

# 3. Bring up all five per-crate agents:
container compose -f install/internal-agents/compose.yml up

# 4. Stream one agent's logs:
container compose -f install/internal-agents/compose.yml logs -f crabcc-core

# 5. Bash into a running agent:
container exec -it crabcc-agent-core bash

# 6. Tear down:
container compose -f install/internal-agents/compose.yml down

Same compose file works under Docker / Podman without changes — every service entry is OCI-compatible, no Apple-specific keys.

Verifying agents work inside the container

The Containerfile bakes in cargo, task, gh, repomix, plus a CARGO_HOME=/cargo named volume so agents share dep compiles (~5× faster on a warm cache). Quick smoke:

container run --rm \
    -v "$PWD":/workspace \
    -e CRABCC_PROFILE=internal/crabcc-core \
    crabcc-internal-agents:dev \
    "noop"           # runs `crabcc agent --profile internal/crabcc-core --run noop`

A successful run prints crabcc agent: id=<hex> and writes a row to ~/.crabcc/_internal.db (host-visible because the repo is bind-mounted).

Useful run-time flags

Apple container's VMs run with a default 1 GiB / 4 CPU envelope and a locked-down capability set; for resource-intensive agent work you can override per-invocation. The bundled compose.yml already sets mem_limit: 4g + cpus: 4 + cap_drop: ALL + the SSH-agent passthrough on every service; the table below is the equivalent for ad-hoc container run:

Flag What it does
--memory 32g --cpus 8 Override the per-VM ceiling (default 1 GiB / 4 CPU). For repo-wide refactors against the memory crate's bench harness.
--init Runs the lightweight init as PID 1 — forwards signals + reaps zombies. Always pass this for agents that spawn cargo/rustc/gh.
--ssh Mounts ${SSH_AUTH_SOCK} at /run/host-services/ssh-auth.sock. Survives logout/login — git clone git@github.com:... Just Works.
--volume $PWD:/workspace Repo root bind-mount. RW; backup loop reads from here.
--cap-drop ALL --cap-add CHOWN --cap-add DAC_OVERRIDE Minimum-viable cap set for agent edits. Compose has these.
--publish 127.0.0.1:7878:7878 Forward the live dashboard port if you crabcc serve inside the agent VM.
--rm Don't accumulate stopped containers. Always pass for short-lived agents.

Resource-heavy build of the image itself? Bump the builder VM:

container builder stop && container builder delete
container builder start --cpus 8 --memory 16g
container build -t crabcc-internal-agents:dev -f install/internal-agents/Containerfile .

Resource snapshot

container stats                              # all running, top-style
container stats crabcc-agent-core            # one specific
container stats --no-stream --format json    # one-shot JSON for scripting

Logs

container compose -f install/internal-agents/compose.yml logs -f crabcc-core
container logs crabcc-agent-core              # alt ad-hoc form
container logs --boot crabcc-agent-core       # VM boot + init dmesg (debugging)

Inspect

container ls --format json --all | jq
container inspect crabcc-agent-core | jq
container image inspect crabcc-internal-agents:dev | jq

Architecture

Prefer diagrams? See docs/OVERVIEW.md for the full Mermaid map (indexing, query router, memory RRF, integrations). This section keeps ASCII traces for copy-paste debugging.

6 crates:
  crabcc-cli     — CLI binary
  crabcc-compact — memory compaction
  crabcc-core    — indexing engine (tree-sitter based)
  crabcc-fetch   — URL fetch + crawl
  crabcc-mcp     — MCP server
  crabcc-memory  — AI memory (BM25 + sqlite-vec)

Install options

brew install 8b-is/tap/crabcc
cargo install crabcc-cli
# or: curl -fsSL https://raw.githubusercontent.com/8b-is/crabcc/main/install.sh | bash

License

MIT