AnythingLLM
Active Permissive (MIT/Apache/BSD) CPU OK Desktop app Server / Docker
- License
- MIT
- Latest release
- v1.18.0
- Release date
- 2026-10-13
- Hardware
- Desktop or Docker; built-in engine runs CPU or GPU (NVIDIA CUDA, AMD/Intel Vulkan)
- Document types
- PDF, DOCX, TXT, CSV, web pages, audio
- OCR / tables / retrieval
- Basic text extraction; built-in reranker unverified
- Cloud calls
- None by default; optional cloud LLM/embedder providers
- Fully offline
- Yes
NVIDIA DGX Spark
DGX Spark: Reported working
Community Docker Compose stack (AnythingLLM + Qdrant + Ollama/vLLM) shared on the NVIDIA DGX Spark forum; official images are multi-arch amd64/arm64. Source: https://github.com/amasu/dgx-spark-rag
Comparisons
Last updated: 2026-10-24. License and release data from the GitHub API. Fields marked unverified have not yet been checked against official docs. Spot something wrong? Send a correction.
The RAGShelf weekly
New local RAG tools, releases, and tested setups. One email a week, no spam.