Subscribe
Sign in
Start new thread
Off-grid LLM over Radio
p/off-grid-llm-over-radio
The first disaster-proof LLM platform
Visit Product
Pham Binh
Radio LLM — Off-grid, disaster-proof LLM platform using Meshtastic
Featured
10
•
An off-grid LLM platform deployed and accessible through 868Mhz LoRa mesh network. Requires no internet or whatever. Super long range. Useful in disaster/emergency situations. Supports user sessions, chat context ,and even tools i.e calling emergency service.
Replies
Pham Binh
Maker
📌
I deployed a local LLM platform on Meshtastic. It is completely offline, requires no-internet, on both client and server side. So essentially disaster-proof apocalypse-grade ChatGPT. Users can connect to it with a LoRa module from 1km away (tested in Budapest suburban area) or 8-15km with line of sight. Theoretically, this can reach even more than 1000km, the record is 1336km on LoRa Wan. It can prove useful in disaster area, where mobile network and internet is not available. In addition to being a robust comm network, government can utilize the radio mesh to distribute helpful AI agents to people in need, get them updated on key info and survival guide. Github: https://github.com/pham-tuan-bin... Distance Testing Demo: https://youtu.be/Snfn_bGH_KE?si=... Emergency Service Demo: https://youtu.be/KbpxYTYvm5o?si=...
Chris Messina
Top Hunter
@binhpham the future of propaganda is just like the past. Who knew HAM radio was the prototype?!
Pham Binh
Maker
@chrismessina haha indeed, propaganda just takes on more advanced form today lol getting my license this spring, probably ham radio is the only place without propaganda now
Cuong Vu
This is such a cool and useful product. Great work—wishing you all the best with the launch.
Pelin Rüzgar
would be nice to have it available in Turkey, where is prone to natural disasters.
Max
💎 Pixel perfection
Sorry to tell you, but the problem is not the distance, not the 200 symbols per message, not even Meshtastic. The problem is LoRa routing architecture. You simply can't guarantee the recipient will get the answer from your laptop, not saying make a significant throughput via LoRa. Many users or messages will lay the network down, causing a DoS attack.
Pham Binh
Maker
@max5987 that’s true, i’m adding more features so that conversation are enabled by passwords, to mitigate spoofing and ddos. but at the end of the day, no network is perfect, you have to have tradeoffs. even the internet is not a perfect network. the purpose of this is not to scale to thousands of node, it is to build a robust aid system that can be deployed quickly and can be easily accessed, by both humans and machines. and in emergency situations, sometimes the only thing that matters is the connection between 2 nodes. Like hiking on a hill with no signal, connecting to a node with your car that has mobile service. Such node can ping emergency service for you when you’re in an accident at very low cost. You can check out the demo I put in the comment for emergency service calling.
Pham Binh
Maker
@max5987 exactly, which is why Meshtastic is perfect for this use case i was quite surprised when i see that no one did this before on meshtastic, there were only attempts at connecting to LLM but a full platform with chat retention, tools usage, and bot-like features this brings another dimension to meshtastic applications, ones that enhance the use of meshtastic much more than basic communication and sensors wouldn’t you say this is a nice expansion to meshtastic use cases?