r/Kiwix • u/Oracle085 • 24d ago

Release Tensor: ZIM-based RAG proxy for OpenAI-compatible AI

I have recently released the beta version of Tensor, a service that turns your local ZIM files into vector databases that provides semantic understanding of the contents of your ZIM archive to OpenAI-compatible AI models.

Combining keyword search and semantic search, Tensor helps produce more accurate and adequate responses for the data you have included in a vector database. Tensor offers a full workflow that is built to enhance the local AI experience, however there is also optional features (offline-first by default) features such as web search for time-sensitive information, and configuring API keys to use (currently working on MCP Server).

This project is still under development, and in the process of optimization. tensor-serve is an open-source project, and everyone is is welcome to use and contribute to this project.

Github Repository: https://github.com/3M1RY33T/tensor-serve

2 Upvotes

62% Upvoted

5 comments sorted by

1

u/PrepperDisk 24d ago

For clarity, this is unrelated to https://www.tensorflow.org, correct? Sounds like an interesting project.

1

u/Oracle085 24d ago

Yes, it’s an unrelated and individual project, thank you for the compliments 🙏😁

2

u/kidddogbites 7d ago

This is interesting i recently got Codex to setup a similar system for using an MCP do to RAG on zim's through a local zimi server through LM Studio.

1

u/Oracle085 7d ago

That’s wonderful, MCP implementation is definitely on my todo list before release. Looks like you’re ahead of me 😁