3 Comments

User's avatar
Popular AI's avatar

Would you use a local Perplexity-style setup like Vane with Ollama and SearXNG for private research, or is the convenience of hosted AI search still worth the tradeoff?

Bianca Schulz's avatar

So glad I found you!

I have a MacBook Pro, 40-core GPU, 48 GB RAM, M3 Max chip, and I'm running qwen3.6-35b-a3b as MLX 4bit.

I have the Hermes Agent from Nous Research and I switch between the terminal and the Hermes desktop app.

Now I want to set up web search. My research suggested that SearXNG and Firecrawl would be a good idea.

My question for you: since I already have a UI with the Hermes desktop app, should I build the search myself with SearXNG and Firecrawl, or does that get too complicated and Vane is the better choice? I want to search 100% locally and anonymously, so I'm also thinking about a VPN. Security is an important aspect too.

I have time to try everything out. The stack is meant to be built up for the long term. What's your advice for me?

1 more comment...

No posts

Ready for more?