Hermes Agent and LangGraph probably aren’t going to work for me either. On a highly resource constrained system like my no-GPU/no-VRAM Ubuntu box, Hermes quickly has a problem with long contexts. The benefits of Hermes is that it tries to iterate quickly using lots of calls, but with each call including a huge amount of context overhead about the user, the tools, and the current task, the context bloat means each of these calls takes forever. I like the UI and as long as I’m using an API based LLM through OpenRouter1 , it’s fine. While a small local model can move relatively “fast”, it gets bogged down with context and larger models which can handle the context are even slower. Again, there’s a lot of great things about Hermes with an API. It can be conversational, it’s fairly coherent across long conversations, it can review files, make changes, and does indeed to try to improve itself as advertised. It’s also got a lot of ways to quickly flip between models and sessions/conversations on different topics. Even with all these abilities, it’s still only a partial solution to what I want. I’d like to have something that can run custom scripts on a regular basis, interact via voice, and these features don’t seem well implemented quite yet. 2 If left alone to do a task, it will litter it’s home directory with a pile of different folders and files, despite explicit instructions otherwise. It’s very capable – but can get confused and messy. Perhaps this wouldn’t be a problem if it were powered by a frontier model, but I’m not going to do that.
I tried out LangGraph as a possible replacement, but it has it’s own problems. It’s far more “bare bones”, with all commands needing to be typed into the command line. Adding skills via specific scripts works very well, powering it via local LLM works very well, it’s able to accurately interpret language and make tool calls, properly set up CRUD lists and reminders, and even manages separate conversations in it’s own clunky way. However, it seems to really lack the iterative ability of Hermes to actually get things done. If it had a better UI, a more clear path to having it semi-autonomously work on a task, I think I could make a go of it.
Even though these two systems aren’t for me, I’ve learned a lot about what I like and what I could put to use in the future.
I keep circling back to … maybe I should just build my own thing. I’ve built the various parts several times before getting distracted by something shiny, so it’s really a matter of collecting those pieces, cleaning them up, and wiring most of them together with what I’ve learned from using other systems.
While I’m rambling, I just read this article on Hackaday about the LLM moats for frontier labs starting to shrink. 3 It kind of makes sense these damn frontier AI companies had to buy up all the RAM. If people could easily pick up 128GB of RAM for $2504 and given the performance of medium sized models in the 30-70B / 30-70GB range, no one would pay $20 per month for access to an AI. At the rate models are improving and being released, it certainly seems like the only thing keeping big AI companies afloat is high RAM prices. While I would not spend $3k-$5k to get a 128GB RAM beast today, since it would never pay for itself, if that price dropped to $500, the cost / benefit analysis starts to make sense.
It does make me wonder, though… what happens if RAM supply suddenly increases, home inference machines are suddenly feasible and every domain name / hosting provider has a $5 upsell for their own Qwen 3.8+ instance. What happens to these billion dollar companies? I would think there’s only so much “intelligence” people are going to be willing to pay for. If all people really want are digital receptionists, developers, lead generation, content generation, investment predictions, and the occasional therapist/pseudo-relationship, why would they pay for an astrophysics PhD level hyper intelligent machine?
On an unrelated note, while I’m busy pontificating… I feel like I’d recently seen something about how continued AI usage “quiets” a brain’s activity – and how taxi cab drivers in NY had very low incidence of brain deterioration as they grew older. All of which to suggest5 that more brain use means more brain and less brain use means less brain.6
In a move that might surprise no one – these last two points suggest a much darker path for frontier AI companies. Perhaps the game was always about about increasing surveillance and diminishing critical reasoning of the masses.
Project Jarvis- Building a Jarvis-inspired voice activated LLM powered virtual assistant
- Building a Home PC Lab
- Secret Agent Man
- Rambling again
- Poolside’s Laguna S 2.1 has been incredibly useful [↩]
- It can do cron jobs, but for some reason loses track of the correct date / time and time offset based on time zone really quickly [↩]
- The Hackaday article is largely summarizing this article by TerminalBytes, which is an excellent read in it’s own right [↩]
- Assuming pre-AI boom RAM prices and the gentle application of Moore’s law… [↩]
- Assuming my recollection and interpretation of these findings is accurate and the findings themselves were valid… [↩]
- Seems like a fairly reasonable assumption??? [↩]




















