Sidechat logo
Download TikTok Instagram X
Sidechat icon
Join communities on Sidechat Download
US Politics icon
US Politics 3w
FUCK SAM ALTMAN!!! FUCK GOOGLE!!! FUCK MICROSOFT!!! MAKE COMPUTE LOCAL AGAIN!!!!!!
comment

6
upvote 27 downvote
default user profile icon
Anonymous 3w

Can’t even buy a computer, with RAM prices these days

upvote 2 downvote
default user profile icon
Anonymous 3w

I tried running a local model on my work computer recently and for the amount of RAM it consumes I’m shocked it’s so slow 😭 it was devstral-small-2 and was using like over 10 GB of RAM

upvote 1 downvote
default user profile icon
Anonymous 3w

ELIMINATE THE WORD COMPUTE!!!

upvote -1 downvote
default user profile icon
Anonymous replying to -> #1 3w

and storage, and GPU, and CPU… If you want to get into building your own PC now is probably one of the worst times to do so sadly

upvote 4 downvote
default user profile icon
Anonymous replying to -> #1 3w

True, because even older generation platforms that have long been out of manufacture (like DDR3 even) are in some sort of demand so that people at least have *something* to use

upvote 1 downvote
default user profile icon
Anonymous replying to -> #3 3w

For code completion I started looking at IBM Granite 4 (Nano I think) but haven’t tried it too much

upvote 1 downvote