keboss-m
eee8f4c8a4
Replace LightRAG with native Python RAG engine + add deploy tooling
...
- New: src/rag/engine/ — in-process hybrid search (FTS5 BM25 + sqlite-vec + LLM rerank)
- New: src/rag/qmd/ — compatibility layer (qmd_query, qmd_chat, qmd_chat_stream, qmd_index_*)
- New: src/ingest/stub_writer.py — .md stubs for binary files (videos, archives)
- New: scripts/deploy.sh + scripts/pull_models.sh + Makefile + .env.example
- Removed: LightRAG, sentence-transformers embedding via separate package, rag_standalone/
- Removed: @nousresearch/qmd npm dep (package not published); Node.js from Dockerfile
- Updated: tests/ (46 passed), docker-compose, .dockerignore, config.yaml, README
Engine: in-process Python (no daemon, no npm), sentence-transformers 384-dim,
RRF fusion (k=60), BM25 + vector with numpy fallback. WebSocket API unchanged.
Deploy: 'git clone' + 'make init' + 'make pull-models MODELS_SOURCE=...' + 'make up'.
Models (5.83 GB) live outside git; pulled via rsync from dev host.
2026-06-10 14:24:01 +03:00
keboss-m
36c9be48be
Add document ingestion pipeline, chat analytics modes, and auth fixes
...
Ingest MD/PDF/DOCX/XLSX into org-scoped documents with classify and RAG indexing. Add compare/timeline chat modes and UI upload. Filter WebSocket progress by user ACL and normalize admin project slugs consistently.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-01 19:16:23 +03:00
keboss-m
8df14e3102
Add multi-tenant auth with org projects, roles, and personal workspaces.
...
JWT login, org-scoped storage and RAG, admin/director/user roles, user-owned projects, login UI, and legacy data migration.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-01 18:54:25 +03:00
keboss-m
e9f5b80e23
Add API credentials for HF and OpenCode in config and env.
...
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-01 17:41:31 +03:00
keboss-m
fee9b9acb1
Add RAG, summary pipeline, and split transcribe/postprocess queue.
...
Separate ASR (2 workers) from summary/RAG post-processing, add LightRAG chat API, batch upload fixes, and local model mounts for Docker deployment.
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-01 17:40:58 +03:00
Кирилл Блинов
78e542a246
Increase batch_size to 2 for CPU optimization
2026-05-29 12:42:07 +03:00
Кирилл Блинов
c771f83351
Add multi-format output support (docx + md simultaneously)
2026-05-29 11:39:13 +03:00
Кирилл Блинов
5a5d1fa960
Add initial project structure: pipeline, docs, config, profiles
2026-05-29 10:16:02 +03:00
