Show HN: Digger Solo – Semantic Search and Maps for Local Files

solo.digger.lol

2 points

a year ago

Hey, I am Sean and I built Digger Solo - a privacy respecting file explorer from the "future". The core features are semantic file search and interactive data maps allowing to explore your files with ease. All processing happens locally - your files never leave your machine.

The file search works by combining full text search with semantic search allowing to search for content of text and image files by their meaning / content (even if the image has no descriptive file name). You can start a search query using a tag e.g. "#jpg cat" to search all your jpg files for cats.

Files are clustered by content similarity in interactive maps that reveal hidden connections and patterns across your collection (text, image, video & audio files supported).

Tags are inferred from imported file paths and file types.

Technicalities:

Digger Solo is quite a complex beast: I am using PyTauri (https://github.com/pytauri/pytauri - Python bindings for Tauri). Python is used to import files, run the dimensionality reduction algorithms (t-SNE, UMAP etc.) and for most database logic (using SQLite3). The CLIP model (JINA CLIP v1) runs as ONNX model using the Rust crate ORT (https://ort.pyke.io/) - inference supports right now only CPU.

The semantic search is powered by the SQLite3 extension https://github.com/asg017/sqlite-vec which just adds support for optimized brute-force based nearest neighbor vector search (no approximate vector index). So Digger Solo is not meant for millions of files, more like a few 100 thousands.

Happy to answer questions!