mirror of
https://github.com/8bit-wraith/Turbo-Whisper-Workspace.git
synced 2026-11-22 00:20:10 +01:00
Upstream pull mirror of https://github.com/8bit-wraith/Turbo-Whisper-Workspace.git
- Python 88.2%
- Shell 8.6%
- Rust 3.2%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
|
|
||
| .tw_cache | ||
| bar_analysis | ||
| benchmarks | ||
| compare_fidelity | ||
| docs | ||
| scripts | ||
| security_incidents | ||
| speech_test_results | ||
| tests | ||
| utils | ||
| vocalis | ||
| .claude_consciousness.m8 | ||
| .gitignore | ||
| .windsurfrules | ||
| analyze_bar_audio.py | ||
| app.py | ||
| app.py.bak | ||
| app_api.py | ||
| app_fix.py | ||
| app_marine_consciousness.py | ||
| app_vocalis.py | ||
| audio_diagnostics.py | ||
| audio_pipeline.py | ||
| bar_security_monitor.py | ||
| check_gpu.py | ||
| check_models.py | ||
| CLAUDE.md | ||
| common_data.py | ||
| DASHBOARD_IMPROVEMENTS.md | ||
| demo_marine_features.py | ||
| demo_trishas_lab.py | ||
| denoise_audio.py | ||
| diar.py | ||
| download_models.py | ||
| dynamic_bar_audio.py | ||
| Hermes-3-Llama-3.1-8B.Q4_K_M.md | ||
| launch_unified.sh | ||
| LICENSE.txt | ||
| ll.py | ||
| marine_integration_demo.py | ||
| MARINE_INTEGRATION_SUMMARY.md | ||
| MARINE_SENSE_INTEGRATION.md | ||
| MARINE_VAD_LOCALIZATION.md | ||
| model.py | ||
| normalize_bar_audio.py | ||
| Project Reorganization Complete: Intro.md | ||
| README.md | ||
| requirements.txt | ||
| security_monitor.py | ||
| setup.py | ||
| speech_detection_diagnostic.py | ||
| start_consciousness.sh | ||
| test_audio_lab.py | ||
| TRISHA_LAB_README.md | ||
| unified_vocalis_app.py | ||
Vocalis - Advanced Audio Processing
Vocalis is a powerful audio processing package featuring:
- Ultra-fast Whisper V3 Turbo Transcription
- Advanced Speaker Diarization
- Audio Analysis Tools
- Security Monitoring
- FastAPI Integration
Features
Audio Processing
- Transcription using Whisper V3 Turbo
- Speaker diarization with pyannote.audio and sherpa-onnx
- Speaker name identification
- Conversation summarization
- Topic extraction
Security Monitoring
- Detect potential security incidents in audio
- Specialized bar security monitoring
- Threat level assessment
- Incident reporting
API and UI
- FastAPI integration for all functionality
- Gradio UI for interactive usage
- Command-line interface
Installation
Basic Installation
pip install vocalis
With GPU Support
pip install vocalis[gpu]
Development Installation
pip install vocalis[dev]
Usage
Command Line Interface
Vocalis provides a command-line interface for common tasks:
# Run the FastAPI server
python -m vocalis api --port 8000
# Run the Gradio UI
python -m vocalis ui
# Run security monitoring on a file
python -m vocalis security --input audio.flac --threat-level 2
# Run bar-specific security monitoring on a directory
python -m vocalis security --input ./examples/bar --bar
API Usage
Start the API server:
python -m vocalis api
Then use the API endpoints:
POST /api/transcribe- Transcribe and diarize audioPOST /api/security/analyze- Analyze audio for security concernsPOST /api/analyze- Analyze audio characteristicsGET /api/models- Get available models
Python API
from vocalis.core.audio_pipeline import AudioProcessingPipeline
# Initialize pipeline
pipeline = AudioProcessingPipeline()
# Process audio
result = pipeline.process_audio(
audio_path="audio.flac",
task="transcribe",
num_speakers=2
)
# Access results
print(result["text"])
for segment in result["merged_segments"]:
print(f"{segment['speaker']}: {segment['text']}")
Security Monitoring
from vocalis.security.security_monitor import SecurityMonitor
# Initialize security monitor
monitor = SecurityMonitor(output_dir="security_incidents", min_threat_level=2)
# Process audio file
incident = monitor.process_audio_file("audio.flac")
if incident:
print(f"Security incident detected: {incident.incident_type}")
print(f"Threat level: {incident.threat_level}/5")
print(f"Summary: {incident.summary}")
Credits
This project builds upon several amazing technologies:
License
Apache License 2.0