https://discord.umbraco.com logo
I tried a Claude Code rival that's local...
# show-and-tell
m
coincidentally had this land whilst reading the all this talk of llm code automations.. https://www.zdnet.com/article/claude-code-alternative-free-local-open-source-goose/ any one already tried it?
s
> I have 128GB of RAM on my machine, so if I start to run out of context, I'll boost it. I can't afford that 😂
m
yeah... needs a little grunt... So definatley not for you Raspberry Pi @User > When my colleague Tiernan Ray tried Ollama on his 16GB M1 Mac, he found performance was unbearable. But I'm running this setup on an M4 Max Mac Studio with 128GB of RAM. I even had Chrome, Fusion, Final Cut, VS Code, Xcode, Wispr Flow, and Photoshop open at the same time.
s
I started reading this post last week and that sentence stopped me from getting excited enough to try it. I might set it up soon anyway, just to get a feel for it!
m
I guess it becomes more relevant say in a health care context where we can't be shipping data into the US LLM's... oh actually didn't we already sell it to them 🙁
The big beefy machines could heat the hospitals too..
s
Definitely think there will be non-US alternatives at some point, there is real demand for it so there's good money in setting that up.
m
I keep seeing this advertised to me on instagram which seems like an interesting approach to local agents https://tiiny.ai (not cheap though)
l
With the current RAM prices, having enough RAM for good local LLMs is almost more expensive that the subscriptions on cloud LLMs 😄
j
I have 128GB of RAM and boy howdy am I happy I bought that right before all this started.
But I use that RAM for my own non-AI stuff, so...
I suppose that I could in fact test it though
d
Me, spotting all the gamers with 128gb of ram 🙂
l
I dont have 128GB.... not even my work laptop has that 😫
My gaming PC and laptop both have 32GB
j
When I'm gaming & streaming a VTuber model I need all the help my PC can get
62 Views