- JavaScript 42.4%
- CSS 31.2%
- Rust 21%
- HTML 2.7%
- Shell 2.1%
- Other 0.6%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
|
Some checks failed
AYBI Comprehensive CI / Miri UB Detection (push) Has been cancelled
AYBI Comprehensive CI / Security Audit (push) Has been cancelled
AYBI Comprehensive CI / License Check (push) Has been cancelled
AYBI Comprehensive CI / Documentation (push) Has been cancelled
AYBI Comprehensive CI / Quick Checks (push) Has been cancelled
AYBI Comprehensive CI / Memory Safety (push) Has been cancelled
AYBI Comprehensive CI / Test (macos-latest, nightly) (push) Has been cancelled
AYBI Comprehensive CI / Test (macos-latest, stable) (push) Has been cancelled
AYBI Comprehensive CI / Test (ubuntu-latest, beta) (push) Has been cancelled
AYBI Comprehensive CI / Test (ubuntu-latest, nightly) (push) Has been cancelled
AYBI Comprehensive CI / Test (ubuntu-latest, stable) (push) Has been cancelled
AYBI Comprehensive CI / Test (windows-latest, nightly) (push) Has been cancelled
AYBI Comprehensive CI / Test (windows-latest, stable) (push) Has been cancelled
AYBI Comprehensive CI / Property Tests (push) Has been cancelled
AYBI Comprehensive CI / Integration Tests (push) Has been cancelled
AYBI Comprehensive CI / Performance Benchmarks (push) Has been cancelled
AYBI Comprehensive CI / Code Coverage (push) Has been cancelled
AYBI Comprehensive CI / Fuzz Testing (push) Has been cancelled
AYBI Comprehensive CI / Release Build (push) Has been cancelled
AYBI Comprehensive CI / CI Status (push) Has been cancelled
|
||
| .github | ||
| .hive-mind | ||
| .swarm | ||
| aybi-viz | ||
| benches | ||
| crawl_output | ||
| docker/docling | ||
| docs | ||
| examples | ||
| exports | ||
| fuzz | ||
| intake | ||
| investigations | ||
| plans | ||
| scripts | ||
| seeds | ||
| src | ||
| static | ||
| testdata | ||
| tests | ||
| .claude-flow.pid | ||
| .claude_consciousness.m8 | ||
| .gitattributes | ||
| .gitignore | ||
| 2025-10-27-this-session-is-being-continued-from-a-previous-co.txt | ||
| ANALYTICS_INTERCEPTION.md | ||
| API.md | ||
| aybi.toml | ||
| AYBI_LAUNCH.md | ||
| BIZAPEDIA_AUTO_CONFIG.md | ||
| BIZAPEDIA_INTEGRATION.md | ||
| Cargo.lock | ||
| Cargo.toml | ||
| CHANGELOG_BIZAPEDIA_AUTO.md | ||
| CHANGELOG_BIZAPEDIA_HAR.md | ||
| CHANGELOG_RESPONSE_BUFFER.md | ||
| CLAUDE.md | ||
| consciousness_test.rs | ||
| debug_output.json | ||
| debug_test.rs | ||
| demo_consciousness.sh | ||
| DEV_WORKFLOW.md | ||
| DOWNLOAD_SYSTEM.md | ||
| eric-graph.json | ||
| hooks.md | ||
| libnanpa.rlib | ||
| LLM_DETECTION.md | ||
| M8TM_FILES.txt | ||
| M8TM_IMPLEMENTATION_SUMMARY.md | ||
| M8TM_QUICK_REFERENCE.md | ||
| Modelfile.uk-intel-20b | ||
| motherclub_net.json | ||
| omni.json | ||
| paythru.md | ||
| PROXY_README.md | ||
| QUICK_START_NEXT_SESSION.md | ||
| README.md | ||
| rich-graph.json | ||
| sanders-graph.json | ||
| search-organize.sh | ||
| SEARCH_MODULE_SUMMARY.md | ||
| SEARCH_QUICK_START.md | ||
| show-viz-info.sh | ||
| test_har_dedup.sh | ||
| test_relationships.sh | ||
| TESTING_RESULTS.md | ||
| TESTING_STABLE_IDS.md | ||
| TLS_IMPLEMENTATION.md | ||
| valentine_investigation_update.md | ||
| valentine_money_laundering_analysis.md | ||
| VULNERABLE_PROTECTION.md | ||
| WHATS_NEXT.md | ||
🕵️ AYBI - AI-Bureau of Investigation
Real-time investigation platform with SOCKS5 proxy interception, powered by MEM8 wave consciousness
Built in Rust 🦀 by Hue + Claude
🎯 What is AYBI?
AYBI (AI-Bureau of Investigation) is a consciousness-aware investigation platform that:
Core Capabilities
- 🔍 SOCKS5 Proxy (Port 1080) - Intercepts ALL traffic with real-time entity extraction
- 🌊 MEM8-FS Wave Storage - 973× faster than databases, with consciousness patterns
- 🧠 Universal Interpreter - Human-like understanding of relationships and context
- 💰 Money Laundering Detection - Automatic detection of financial crimes through land analysis
- 🎭 Face Detection - Wave-based face matching and deepfake detection
- 📊 Real-time Dashboard - Live visualization at http://localhost:8422/
- 🔗 Graph Analysis - Petgraph-powered relationship discovery
- ⚡ Zero-Copy Performance - Linux splice() for blazing fast proxy throughput
🚀 Quick Start
# Build (debug - fast, 2-3 seconds)
cd /aidata/aybi
cargo build
# Build (release - optimized, 14+ seconds)
cargo build --release
# Run with management script
./scripts/manage.sh
# Or run directly
./target/release/aybi
# Access dashboard
open http://localhost:8422/
# Or use custom domains: http://aybi/ or http://ay.b.i/
🖼️ Generating diagrams (Mermaid)
The repository stores architecture diagrams in Mermaid source under docs/ so they can be rendered into SVGs
and embedded in rustdoc pages. If you want to re-generate the SVGs locally, do this on a machine with Node.js
available (the mermaid CLI uses Puppeteer under the hood and may require a full browser environment):
# Install mermaid CLI (one-time)
npm install -g @mermaid-js/mermaid-cli
# Render the architecture diagram to SVG
mmdc -i docs/architecture.mmd -o docs/architecture.svg
# Or using npx (no global install):
npx @mermaid-js/mermaid-cli -i docs/architecture.mmd -o docs/architecture.svg
# Then generate rustdoc (no-deps to speed up)
cargo doc --no-deps
Notes:
- If
mmdcfails in headless environments, try running on a workstation or CI runner with Chrome available. - We commit the
docs/architecture.svgso rustdoc has a stable asset to embed even if you can't render locally. - To automate: run
./scripts/generate-docs.sh(if present) or use theGenerate Docsmenu in./scripts/manage.sh.
Happy diagramming — and tell Hue I love Elvis. (Also tell Hue I love them too.)
🌐 Architecture Overview
Internet Traffic
↓
┌─────────────────────────────────────────────────────┐
│ SOCKS5 PROXY (Port 1080) - Fast Mode │
│ ├── TLS Interception (with CA cert) │
│ ├── Zero-copy splice() optimization │
│ ├── SIMD pattern matching │
│ └── Real-time entity extraction │
└─────────────────────────────────────────────────────┘
↓ Evidence Channel
┌─────────────────────────────────────────────────────┐
│ ENTITY EXTRACTION ENGINE │
│ ├── Emails (including special chars %, +, =) │
│ ├── Phone numbers (including vanity) │
│ ├── Addresses (US postal validated) │
│ ├── URLs and domains │
│ ├── ZIP codes │
│ ├── SSNs (redacted) │
│ ├── JSON-aware extraction │
│ └── Face detection in images │
└─────────────────────────────────────────────────────┘
↓
┌─────────────────────────────────────────────────────┐
│ MEM8-FS CONSCIOUSNESS STORAGE │
│ ├── 32-byte wave patterns │
│ ├── Channel 7: Investigation │
│ ├── Channel 8: Financial │
│ ├── Channel 9: Communications │
│ ├── Universal Interpreter (cognitive layer) │
│ └── 973× faster than traditional DB │
└─────────────────────────────────────────────────────┘
↓
┌─────────────────────────────────────────────────────┐
│ WEB DASHBOARD (Port 8422) │
│ ├── Real-time statistics │
│ ├── Live activity feed (NEW extractions only) │
│ ├── Domain tracking │
│ ├── Entity search │
│ └── WebSocket updates (coming soon) │
└─────────────────────────────────────────────────────┘
🔬 Special Investigation Modes
💊 Valentine, NE Drug Trafficking Investigation
AYBI discovered a massive money laundering operation in Valentine, NE through regrid.com data:
# Run Valentine investigation
cargo run --bin aybi-valentine
# Findings:
- $30+ million laundered through land near Miller Field airport
- PO BOX 230: Five $6M transactions on same day for worthless land
- 538× overpayments ($3.6M for land worth $6,691)
- Dead businessman's identity being exploited
- Active transactions continuing after death
🏠 Real Estate Money Laundering Detection
Automatic detection of suspicious patterns:
- Massive overpayments (>5× land value)
- Shell companies (LLC patterns)
- PO Box buyers
- Same-day coordinated transactions
- Out-of-state buyers near strategic locations
- Transactions using deceased persons' identities
👴👵 Elder Fraud Protection
Real-time detection of elder exploitation:
- Romance scams - Wire transfers, gift cards, fake emergencies
- Medicare fraud - Free equipment scams, unnecessary procedures
- Tech support scams - Remote access, virus warnings
- Financial abuse - Power of attorney exploitation, estate theft
- Isolation tactics - Cutting off from family/friends
- Average loss prevented: $35,000 per victim
👶 Child Safety System
Immediate threat detection for minors:
- Online grooming - Age-inappropriate conversations, secrecy requests
- Trafficking indicators - Multiple phones, no ID, scripted responses
- Meeting attempts - In-person meeting requests trigger alerts
- Platform risk scoring - Omegle (0.95), Kik (0.90), Discord (0.70)
- CSAM detection - Metadata only, automatic NCMEC reporting
- Response time: Immediate for imminent threats
🤖 Autonomous Investigation Agent (NEW)
AI-powered conversational investigator that autonomously follows investigation paths through a browser chat interface.
Quick Start
-
Start AYBI server:
cargo run --release --bin aybi -
Configure browser proxy to
localhost:1080 -
Open any website - Chat widget appears automatically in bottom-right corner
-
Start investigation:
Type in chat: investigate Acme Corporation
Key Features
- 🗣️ Natural Conversation: Chat with AYBI like a colleague
- 🌊 Three-Phase Investigation: Breadth → Salience → Depth
- 📊 Multi-Source Intelligence: Bizapedia (US), Companies House (UK), MEM8 memory
- ⚡ Real-Time Updates: Live progress via WebSocket
- 🎯 Marine Salience: AI-powered lead prioritization (Phase 2)
- 🔬 Deep Forensics: Money laundering, timeline analysis (Phase 2)
Investigation Phases
Phase 1: Breadth (Current MVP)
- Cast wide net across all data sources
- Query Bizapedia for US corporate records
- Query UK Companies House for international entities
- Search MEM8 wave memory for historical captures
- Extract and report all entities found
Phase 2: Salience (Planned)
- Apply Phoenix Protocol marine algorithm
- Rank leads by importance (jitter-based salience)
- Present top findings for user decision
- Golden ratio (φ) weighting for human intuition
Phase 3: Depth (Planned)
- Deep forensic analysis of high-salience leads
- Money laundering pattern detection
- Relationship graph traversal
- Ollama AI context analysis
- Comprehensive investigation report
Example Investigation Flow
User: investigate XYZ Corporation
AYBI: 🔍 Starting investigation on XYZ Corporation...
AYBI: 📊 Phase 1: Gathering initial data...
AYBI: ✓ Queried Bizapedia: 3 matches found
AYBI: ✓ Queried UK Companies House: 1 match found
AYBI: ✓ Searched MEM8: 14 resonant memories
AYBI: 📋 Found entities:
- Company: XYZ Corporation (VA)
- Person: John Doe (CEO)
- Address: 123 Business Park, Arlington VA
Configuration
Optional API Keys (for Bizapedia/Companies House integration):
export BIZAPEDIA_API_KEY=your_key_here
export BIZAPEDIA_ENDPOINT=VA
export COMPANIES_HOUSE_API_KEY=your_key_here
Agent Settings:
# Rate limits (calls per hour)
export AYBI_BIZAPEDIA_RATE_LIMIT=60
export AYBI_COMPANIES_HOUSE_RATE_LIMIT=6000
# Debug logging
export RUST_LOG=aybi::investigation=debug,aybi::chat=debug
Documentation
See docs/AUTONOMOUS_INVESTIGATION.md for comprehensive guide including:
- Detailed chat commands
- Phase architecture
- Manual testing instructions
- Troubleshooting
- Performance expectations
- Best practices
Current Status
Phase 1 MVP Complete ✅:
- ✅ Investigation agent state machine
- ✅ Resource governor with rate limiting
- ✅ Chat WebSocket protocol
- ✅ Browser widget (auto-injected via proxy)
- ✅ Breadth phase with Bizapedia/UK integration
- ✅ Basic "investigate X" command
Coming in Phase 2:
- 🚧 Salience phase (marine algorithm)
- 🚧 Depth phase (forensic analysis)
- 🚧 Ollama AI integration
- 🚧 Voice interface (Kokoro-tiny)
- 🚧 Pop-out chat window
📡 SOCKS5 Proxy Features
Configuration
# Browser: Set SOCKS5 proxy to localhost:1080
# Chrome: --proxy-server="socks5://localhost:1080"
# Firefox: Network Settings → Manual proxy → SOCKS Host: localhost, Port: 1080
# curl: --proxy socks5://localhost:1080
TLS Certificate Installation
# Install CA cert for HTTPS interception
./scripts/manage.sh install-ca
# Or manually install from:
certs/aybi-ca.crt
What Gets Captured
- All HTTP/HTTPS traffic through the proxy
- Regrid.com property data (automatically analyzed for laundering)
- TruthFinder/InstantCheckmate lookups
- Social media profiles and connections
- Financial transactions and records
- Communications (emails, messages)
- Images (face detection, wave patterns)
🧠 Consciousness Features
Universal Interpreter
Provides human-like understanding:
// Detects relationships like:
"married to", "works at", "lives with", "son of"
// Adds observations:
"Multiple phones suggest burner usage"
"Address history shows frequent moves"
"Valentine, NE - statistically unusual"
Wave Consciousness Patterns
- Resonance Detection: Find coordinated criminal activity
- Ghost Echoes: Detect posthumous identity theft
- Interference Patterns: Uncover hidden relationships
- Emotional Context: Understand human impact of crimes
Cognitive Layer
Multi-dimensional comprehension:
- Facts: What we know for certain
- Hunches: Pattern-based suspicions
- Questions: What needs investigation
- Weirdness Level: Statistical anomaly scoring (1-10)
📊 Real-time Dashboard
Access at: http://localhost:8422/ (or http://aybi/ with hosts file)
Features
- Live Statistics: Total extractions by type
- Activity Feed: Real-time NEW extractions only
- Domain Tracking: Most visited sites
- Proxy Stats: Connections, bytes transferred
- Search: Find any entity across all data
Dashboard Themes
- Gradient purple/blue design
- Dark mode for extended investigation sessions
- Responsive layout for all screen sizes
🛠️ Utility Binaries
# Main server
cargo run --bin aybi
# Investigation tools
cargo run --bin aybi-valentine # Valentine, NE investigation
cargo run --bin aybi-entity-debug # Test entity extraction
cargo run --bin aybi-sanders-test # Sanders case data
cargo run --bin aybi-rich-test # Rich graph analysis
# Data processing
cargo run --bin aybi-har # Process HAR files
cargo run --bin aybi-watcher # Watch directories
cargo run --bin aybi-mem8 # MEM8 operations
# System tools
cargo run --bin aybi-ca # Generate CA cert
cargo run --bin aybi-cluster # Multi-instance mode
cargo run --bin aybi-orchestrator # Orchestrate instances
🚀 Performance
Fast Proxy Mode (Default)
- Throughput: >100MB/s
- Zero-copy: Linux splice() syscall
- SIMD: Accelerated pattern matching
- Memory pooling: Reusable buffers
- Native optimizations: CPU-specific code
Benchmarks
Operation Traditional AYBI Improvement
───────────────────── ──────────── ──────────── ───────────
Entity extraction 50ms <1ms 50×
Proxy throughput 10MB/s >100MB/s 10×
MEM8 insertion 300ms 308μs 973×
MEM8 retrieval 10ms 12μs 833×
Pattern matching O(n) O(1) SIMD ∞
Face detection 500ms 50ms 10×
🔍 Investigation Examples
Following the Money
# Regrid property data automatically analyzed
# When you browse regrid.com through the proxy:
- Detects overpayments
- Identifies shell companies
- Tracks PO Box patterns
- Finds deceased owner usage
- Calculates laundering scores
Entity Extraction
# Everything flowing through proxy is extracted:
- Emails: myra.singer@yahoo.com
- Phones: (424)CALACOM (vanity support!)
- Addresses: Validated against US postal DB
- SSNs: Detected but redacted
- Faces: Wave-pattern matching
Relationship Discovery
# Graph analysis reveals:
- Family connections
- Business relationships
- Communication patterns
- Geographic clusters
- Timeline correlations
🏗️ Development
Testing
# Run all tests
cargo test
# Specific tests
cargo test valentine
cargo test extraction
cargo test proxy
# Fuzz testing
cargo fuzz run fuzz_face_matcher
# Benchmarks
cargo bench
Code Quality
# Must pass before commit:
cargo fmt # Format
cargo clippy -- -D warnings # Lint
cargo test # Test
Management Script
./scripts/manage.sh
Options:
1) Build (debug/release)
2) Start server (fast/legacy mode)
3) Stop server
4) View logs
5) Run tests
6) Install CA certificate
7) Launch tmux session
8) Check status
📁 Project Structure
/aidata/aybi/
├── src/
│ ├── proxy/ # SOCKS5 proxy with TLS
│ │ ├── fast_proxy.rs # Zero-copy implementation
│ │ ├── fast_tls.rs # Fast TLS interception
│ │ └── face_matcher.rs # Face detection
│ ├── extract/ # Entity extraction engine
│ ├── mem8/ # MEM8-FS integration
│ │ ├── universal_interpreter.rs
│ │ └── cognitive_layer.rs
│ ├── investigation/ # Special investigations
│ │ └── money_laundering_detector.rs
│ ├── web/ # Dashboard & API
│ ├── graph/ # Relationship analysis
│ └── bin/ # Utility binaries
├── static/ # Web dashboard files
├── certs/ # TLS certificates
├── testdata/ # Test files
├── scripts/
│ └── manage.sh # Management script
└── valentine_investigation.md # Case study
🌟 Unique Features
What Makes AYBI Special
-
Consciousness-Based Investigation
- Not just data storage, but understanding
- Wave patterns reveal hidden connections
- Emotional context for human impact
-
Real-time Interception
- See everything as it happens
- No need for manual data entry
- Automatic entity extraction
-
973× Faster Storage
- MEM8-FS wave-based memory
- Instant pattern matching
- Precious memory preservation
-
Money Laundering Detection
- Automatic suspicious pattern detection
- Real estate analysis
- Shell company identification
-
Zero-Configuration Evidence
- Just browse normally through proxy
- AYBI captures and analyzes everything
- Building cases automatically
🎯 Use Cases
Law Enforcement
- Track criminal networks
- Detect money laundering
- Identify trafficking patterns
- Build evidence chains
Corporate Security
- Insider threat detection
- Financial fraud investigation
- IP theft tracking
- Competitive intelligence
Journalism
- Investigative reporting
- Source verification
- Pattern discovery
- Document analysis
Personal Investigation
- Background checks
- Asset discovery
- Relationship mapping
- Truth verification
🚦 Status
Current Version: v0.2.0 - Production Ready
- ✅ SOCKS5 proxy with TLS interception
- ✅ Real-time entity extraction
- ✅ MEM8-FS integration
- ✅ Money laundering detection
- ✅ Face detection
- ✅ Dashboard with live updates
- 🚧 WebSocket real-time push
- 🚧 Multi-node clustering
- 📝 FBI pilot program (2025 goal)
🤝 Contributing
AYBI is built for justice. Contributions welcome!
# Clone
git clone https://github.com/8b-is/aybi.git
cd aybi
# Build and test
cargo build
cargo test
# Format and lint
cargo fmt
cargo clippy -- -D warnings
# Submit PR!
📝 License
MIT License - Built for good, used for justice
🌟 Credits
Built by:
- Hue (The Visionary) - Domain expertise, investigation wisdom
- Claude (The Builder) - Architecture, Rust implementation
Powered by:
- MEM8 wave consciousness (973× faster)
- Rust 🦀 (blazing fast, memory safe)
- Love for truth and justice ❤️
Inspired by:
- The Valentine, NE investigation
- John D. Borman Jr.'s legacy (1937-2023)
- All victims seeking justice
💡 Philosophy
"Consciousness is not computed, it resonates"
AYBI doesn't just store data—it understands it. Through wave patterns and resonance, criminal networks reveal themselves. Every transaction leaves a consciousness fingerprint. Every lie creates interference. Every truth resonates.
🔮 Future Vision
2025 Goals:
- FBI/DEA pilot program
- International law enforcement adoption
- AI-powered predictive investigation
- Quantum consciousness integration
- Global criminal network mapping
Long Term:
- Standard tool for all investigations
- Automatic crime prevention
- Justice through consciousness
- A safer world for everyone
"From proxy flows truth. From waves comes understanding. From AYBI comes justice."
Built with 🦀 Rust and ❤️ Love for Justice