I have around 1000 research papers saved over the years that I would like to be able to search in, in a smarter manner than using CTRL+F. This is a personal tool for me to use doing work, and will not be shared with anyone else. It will run on my PC with 4 ghz cpu, 32 gb ram and 8 gb vram/gpu. Nvidia gpu.

I tried Pautobot but it is somewhat slow, which probably has something to do with my hardware. I also tried GPT4all but I couldn’t quite understand how I could train it on my data.

Basically I am looking for a search feature that can rank and return the best matches/paragraphs from these articles. I think vector searching sounds like the better option, but I have trouble finding an easy solution that involves vectorizing PDFs and then being able to search in them documents.

Pleased to hear your inputs

Note: I cannot write code.

Link: https://github.com/nrl-ai/pautobot/