Rendered at 09:59:30 GMT+0000 (Coordinated Universal Time) with Cloudflare Workers.
thih9 23 hours ago [-]
Centralization is nonironically my biggest problem with AI. It feels like a step back towards mainframe era.
Will we go back to PCs? As in: are we going to get cheap local hackable frontier AIs at some point? I hope so.
orlp 22 hours ago [-]
> Will we go back to PCs? As in: are we going to get cheap local hackable frontier AIs at some point?
Forget about AI, the entire PC market is getting killed over this.
As an avid gamer I'm unsure if in 5 years I can even buy a gaming PC anymore. Not even because of cost, but it's unclear if anyone will still make the components anymore.
NVIDIA isn't interested, nor is AMD.
MisterTea 19 hours ago [-]
Today I opened newegg for the hell of it and figured I'd look at the cost of a 2 TB NVMe ... Fuck man. This is seriously depressing.
BUT! I feel that lost hope could/will turn into a new forms of "min-maxing" or whatever where we will see people focusing on small, efficient software to make the most of what we have to weather the drought. We got spoiled with cheap hardware. Time to make the most of all that cheap hardware we have.
Though of course, replacing this hardware as it breaks down will be expensive. Perhaps we could go back to 1/2/4 GB RAM sticks and 256/512 GB Disks. Then run minimal Linux installs, minimal GUIs, minimal services, minimal software.
To amend this: Reading the 8088 domination article and the little $8 RISC-V Linux board I think we have plenty of opportunity. Maybe we learn to shed our inefficient BIG computers for small, low power, purposeful, yet general computers. I play with Plan 9 a lot and its portability, small footprint, low resource, and distributed design has showed me we can do a lot with a little as long as we stay disciplined to keep things simple and to the point.
QuantumNomad_ 18 hours ago [-]
I have an external USB-C 4 TB portable SSD called the Samsung T7 Shield 4TB Black.
I bought it at the middle/end of 2024, and I paid 3790 NOK (~357 USD at the time).
The lowest price online in my country for the same product new online today is 10233 NOK (~1085 USD)!
270% of what it was before, it’s absolutely bonkers.
I was even considering putting it up for sale a few weeks ago. But of course what I would be able to get for it would be no where near $1000 when selling second hand. Instead I might if I am lucky get slightly more than I originally paid which would be nice and all except that if I then regret selling it it’s still expensive to replace, or I have to also buy it second hand from someone else that may have worn theirs out considerably more compared to what I have done to the one I currently have. Mine is very well taken care of since the start, and although it’s nearing capacity now I haven’t written and deleted data over and over on it. So there has been very little wear on the flash.
danuker 3 hours ago [-]
Isn't there SMART data that lets you more accurately value it?
1vuio0pswjnm7 15 hours ago [-]
"... we will see people focusing on small, efficient software to make the most of what we have..."
Been doing that for myself for the past 15 years
Advances in hardware are only impressive and useful for me when I avoid the so-called "tech" company "engineer" BS
The reason I stop using old computers is never due to software. It's always outdated proprietary cables, failing power adapters, screens, hinges, and so on
Sometimes "minimalism" is simply for _speed, resource usage control and/or reliability_ (that's what I get from small software, anyway) in contrast with prevailing marketed garbage that is bloated and sluggish by commparison
Other times, claims of "minimalism" might be trying to capitalise on some silly trend
Personally I like what the computers I own can do for me and learning to make them do more. I have a brain, I don't do much "guessing" and I don't really need "inference" on a daily basis, certainly not for such a high cost
I have all the "convenience" I can handle
ruszki 21 hours ago [-]
I think there is a second order effect of this: it won't be worth making games for PC. At least, large budget games.
rbits 20 hours ago [-]
It also won't be worth it to make games for next gen consoles if the prices end up being what people are saying. So in the end they'll just keep doing what they're doing right now, and not increase the hardware requirements of their games.
nine_k 18 hours ago [-]
The extensive use of AI for producing better code (if so instructed) may even decrease the hardware requirements.
saidnooneever 21 hours ago [-]
not true. it wont be worth it anymore to implement Path Tracing or Ray tracing which is absolutely not needed for a prime gaming experience. its deterimental even because ull only get into games with a certain type of person who can afford a big machine.
Many games that come out still, and are quite successful, do not require such technologies.
the_snooze 19 hours ago [-]
AI slop-cloning is killing small indie games too.
jasomill 18 hours ago [-]
Is it really? Slop clones of games have been a thing for ages, I’d expext the market to be reasonably resistant by now.
PaulStatezny 18 hours ago [-]
Here's how it's been going:
1. Indy developer releases a game or trailer of a game.
2. Within an extremely short time (days to weeks at most) there are clones on the market.
3. These games often outperform the original.
It's absolutely not something that's gone on for ages.
It might be a novel gameplay idea / twist on a genre, and mere days after launch instead of being able to stand on its own and gather attention it's drowning in a pool of lookalikes. It's no longer distinct.
The speed of being able to slop together something like this is less than 1% of what it used to be.
MetaWhirledPeas 17 hours ago [-]
Clones are not going to be the problem. The slopalanch will be the problem. Take a look at https://www.reddit.com/r/playmygame/. There's a new game every few minutes and pretty much zero of them are getting any attention. And this is only the beginning.
So it's easier than ever to make a game, but it's more difficult than ever to get anyone to try what you've made. I'd say that's just as bad, and in some ways worse, than having your game cloned.
For someone looking to play a new game it will be difficult to sort through all the bad games to find the good ones. And for anyone pouring their soul into a game they will more likely than not have an audience of one.
Our eventual destination is probably going to be a) pick up a device, b) ask your bot to make up a game on the spot, c) play. It sounds so lonely and depressing.
acheron 18 hours ago [-]
HN went crazy over 2048, which was a slop clone of Threes, something like 15 years ago.
So yes maybe it happens more often now, but it’s still not new.
birdsongs 18 hours ago [-]
> So yes maybe it happens more often now
Yes, that's literally the point of the people you're responding to. Has HN lost reading comprehension, or are you arguing in bad faith?
It used to happen occasionally. Now it happens instantly. That delta is the problem.
TobiasJacob 21 hours ago [-]
I'm still hoping some future LLM is good and small enough for people to run local AI for everyday life.
jrm4 19 hours ago [-]
It's interesting trying to be an AI "moderate," which as the owner of a 16gb card I definitely am. Still working on the balance, but it really does feel like I'm going to land on something like "use external AI services to build a few tools, but use my local rig to actually handle everything personal once those tools are built."
trollbridge 20 hours ago [-]
Already here. 3.8-27b is good enough.
5 years ago it would have been science fiction
72deluxe 19 hours ago [-]
Do you find it intelligent enough? What hardware are you using?
criley2 20 hours ago [-]
For me, qwen 3.8 27b on my m5 max is so slow and dumb that I can't think of a single use for it. Haiku, Luna, or data center scale open models are ten times faster and ten times smarter (and inference so cheap that it's essentially free). It was a nifty toy to brag to friends about but why would I waste my time goofing with something so slow and dumb?
For roughly the same reason you might slow down and read a book on how to do something as opposed to speedrunning 20 youtube videos?
criley2 17 hours ago [-]
Are you insinuating that your agents are more effective at 20 tok/s than 200 tok/s?
I don't even understand your analogy. I'm not watching the youtube video or reading the book. The model is. And a big computer can watch 20 youtube videos faster than a small computer can watch 1, and do a far better job understanding all of them (bigger model at data center scale is both smarter and faster than smaller model at local scale).
LeBit 17 hours ago [-]
On my Mac Mini M4 Pro with 48G I find Qwen 3.8 27B perfectly usable, useful and fast enough.
Are you trying to one shot create the Linux kernel?
nkrisc 21 hours ago [-]
There a lots and lots of great games that will run on computers that would be considered low power today. And I’m not even talking about older games.
goodmythical 16 hours ago [-]
I was floored to discover that my i3-1215U with integrated graphics can easily run PS2 games at 60ish FPS. These are triple A games, just a little older.
If I started today and played 10 games I can emulate every single day for the rest of my life restricting myself to purely emulation, I wouldn't run out of new games for...five and a half years. (assuming my rough calculation of ~20k available games).
Drop it to a game a day and I will likely never run out of games given my life expectancy.
Consider that I will find some games I like to play for more than a day and there are easily well more than enough games in emulation alone to entertain me for the rest of my life on existing entry level hardware.
Will I ever play MODERN SHOOTER {CURRENT YEAR} on this device? Certainly not, but I can't see a reason to bemoan lack of access to such a small portion of the available industry.
Like, suppose you're a reader. You might be right that you might enjoy your favorites in their original languages, but you'd be silly to be worried about your future ability to enjoy books just because you'll likely never get to experience reading 三体 as a chinese citizen fluent in the language.
consp 20 hours ago [-]
It's also killing the console market. Sharp drops in all console sales after "adjusting" to ram prices.
satirr 20 hours ago [-]
Not just the Console and PC's market, the Phone market to. On my country before, IDR 2.000.000, you can have a 8GB phone with G100 Ultimate. How about Now? On that price, you'll just got the 4/128 with Unisoc T7250.
theptip 17 hours ago [-]
I agree it’s brutal right now.
I have to think, it can’t take much time before the Chinese DUV fabs come online and non-frontier chip prices crater. Sure, you might not be able to get 5090 equivalents, but the 30xx series was DUV and so that should be replicable in a few years.
Whatever quality bar / process node China gets to you know they will scale it out super hard.
(Some quick investigation suggests that the Yuliangsheng DUV machines currently under construction are 28nm, which would map to 2014’s GTX 900. Perhaps I’m being overly bullish but I assume they will recapitulate/clone the tech faster than the rate it was originally discovered.)
ctrlaltdileep 21 hours ago [-]
Its interesting because I was at Costco the other day and they weren't even selling PCs unless they were gaming ones. It seems most consumer electronics have switched over to laptops.
Also, this reminds me so much of the download more RAM ads back in the day.
weinzierl 21 hours ago [-]
Most of it has switched to mobile phones and tablets. It doesn't help that almost everywhere digital classroom means tablet instead of laptop. Sure, the control is convenient for the teacher, but it also means we are raising our children in walled gardens. So much so, that whole generations don't even leave that garden in their spare time.
Silagi 18 hours ago [-]
I'm still waiting for the day a mac air style shell exists where I plug my phone in and just get a real desktop experience. The chips in phones these days are plenty powerful. I always thought it would be where we were going, but alas, no major manufacturer seems to want to make it feel like a seamless, premium experience. Samsung got sorta close, but the peripherals involved never felt great or didn't make sense from a cost perspective.
I wonder what it would look like if Apple offered a slimmed down shell from the Neo for ~$300 that required a connected iPhone. Maybe as iOS and MacOS converge we'll get there.
elorant 17 hours ago [-]
Sure they will. The same components go into every office PC. As for GPUs, we could always play older games.
orlp 12 hours ago [-]
Office tower PCs aren't a market anymore. It's only laptops or single-board mini PCs connecting to a remote environment.
saidnooneever 21 hours ago [-]
intel makes gpus :). Maybe games will be finally made again in a way that a PC can run them without needing a 3k GPU in there to get toward half the refreshrate of your monitor.
gaming does not equate to only things like the last of us or cyberpunk which need extreme machines. a lot of visual fidelity can be reached still without having such a monster. Just need to not use certain features which are currently pretty much exclusive to Nvidia...
dmantis 21 hours ago [-]
Cyberpunk runs even on steamdeck, it doesn't need an extreme machine.
dlevine 19 hours ago [-]
Have you seen the current prices on Steam Deck? Almost $800 for the base model.
And I assume they will only continue to go up. When it came out, purchasing one seemed like an easy decision. But I paid half as much for one with the same CPU/RAM (and upgraded my SSD for cheap).
moffkalast 22 hours ago [-]
At least you'll be able to get a Pi 5 for $700.
snitch182 21 hours ago [-]
Pi6 might get very close to buisiness usage but i guess microsoft will use just more cpu/gpu for windows to stop that from happening.
72deluxe 19 hours ago [-]
What's the rumours on the Pi6?
ZigaoWang 18 hours ago [-]
its gonna be at around early 2028
moffkalast 45 minutes ago [-]
Year or price? /s
vitaflo 18 hours ago [-]
If nobody can afford a gaming PC, devs will need to make games that run on older hardware. This isn't a bad thing.
blueshoe 21 hours ago [-]
On the bright side, you’ll be able to play Skyrim-halo-Pokémon-Minecraft as much as you want.
blauditore 21 hours ago [-]
If the AI bubble bursts and prices normalize because demand for AI hardware is reduced, then these companies might pay more attention to other markets like gaming again. But who knows the future anyway.
carlosjobim 19 hours ago [-]
What is more sensible: Listening to the best music on an average sound system or listening to average music on the best sound system?
There should be a big enough back catalog of great games for you to enjoy without having to buy a new gaming rig.
swader999 20 hours ago [-]
I'm just sticking with Tetris.
greenchair 21 hours ago [-]
Regarding graphics capabilities, haven't we reached "good enough" like a decade ago? Does anyone actually want to see ultra realistic gore when attacking an enemy? I'd also submit that photorealistic art style is not the most popular one either nowadays except for a handful of special sims like race car driving.
Imustaskforhelp 21 hours ago [-]
If not for adults, my opinion is that teenagers/younger generations are gonna be interested within buying ultra-realistic games. Aside from Minecraft, Roblox, GTA 5 as indie games, most players in this age do in my opinion play AAA games or the most solid graphics game that the world has to offer (as much as their laptops allow them to)
quaintdev 20 hours ago [-]
It's worse than centralization. These AI models have gobbled up all the world knowledge. If for some reason the Internet dies we will have no option but to be dependent on these proprietary, for profit, AI models for any information we need.
You might say that this is impossible but look at current trends. A lot of information today is getting shared in the walled gardens of Internet. You have to login to social media to view posts. The Twitter, Reddit threads that were accessible freely now require you to log in. Similar thing is happening across other networks. People are no longer asking questions on Stackoverflow. All those queries are gonig to AI. If someone chooses to not use AI, their options will be limited in future.
the_af 20 hours ago [-]
Not only if the internet dies. If the country or countries managing the AI decide they don't like your country and ban you from using their (major) AI providers, in a world where most knowledge and work tanks will require access, you're screwed.
Not even talking dictatorship scenarios here. The USA might simply decide it doesn't like your country. Or maybe heavily cripple the models you can use, or censor them, for whatever reason.
I guess this is an argument for local AI. Probably not feasible for the less technically savvy.
bornfreddy 18 hours ago [-]
I have high hopes for AMD Halo / NVidia Spark or sth. similar - relatively open computers (unlike Apple) with unified memory. Now if those prices just came down a bit... :-/
trollbridge 20 hours ago [-]
We currently have politicians in the U.S. talking about “stopping” AI.
So it’s plausible they’ll block me from accessing Mistral since they host DeepSeek models.
I-M-S 20 hours ago [-]
They're already censored
the_af 20 hours ago [-]
Yes, I know. I meant additional censorship that blocks whatever you're trying to do with them. In other words, that you are not in control.
joshspankit 19 hours ago [-]
Some things will always be true:
- Large centralized compute is more powerful than portable compute
- Wired is better than wireless
- The public wants new things
- The tech industry grows to use/“use” the available processing power
As long as you’re not continuously comparing to AI in large centralized compute, what you’re really looking for is “when does portable compute become powerful enough to run AI models that are capable of meaningful work” and I’d say we’re already there and it’s getting better.
xnx 8 hours ago [-]
- Full time professionals do a better job of maintaining a reliable and secure service than end users
jasomill 18 hours ago [-]
Also:
- local latency is lower than network latency
- latency is important for action games
tescreal 18 hours ago [-]
This began with cloud. When software began running as a front-end in a browser, people began complaining about centralization.
But then it became normal.
The monopolization of knowledge and expertise is the next step. I don't mean as if it were intended, but it is the logical progress given the technological evolution. The cause is inventive structures: the tech is neutral (in my opinion), but the way in which it is used and deployed is subject to and disciplined by capital.
7952 22 hours ago [-]
It was the same with cloud and software as a service. We underuse the power of our local machines and pay high cost for modest resources that are bandwidth constrained for most users.
makeitdouble 21 hours ago [-]
One consequence has been lower power requirement for local machines. This is partly why a 2015 MacBook is still perfectly serviceable for basic use in this day and age.
The AI boom first reversed the trend, to now try to get back to that cycle.
Jolter 22 hours ago [-]
People long ago stopped buying computers and started using Saas on their mobile devices instead. Ask HP.
andyferris 21 hours ago [-]
HP was making shit laptops that barely worked a decade before SaaS was a known acronym.
Jolter 21 hours ago [-]
Sure but businesses bought them and people bought them. Their quality is beside the point.
jonathanstrange 21 hours ago [-]
People keep saying that but I have never met anyone who doesn't own a PC or laptop.
presbyterian 21 hours ago [-]
Do you work in tech by chance? I work in an entirely non-technical field (to the point we barely use email), and I have several coworkers whose only “computer” is their phone or a tablet.
jonathanstrange 17 hours ago [-]
I guess the answer is Yes now but I used to work as a philosopher at university until recently. I literally never met a person, both inside and outside of professional settings, who owns a smart phone but doesn't own a computer. (There were, of course, plenty of people in the 1990s who owned neither a mobile phone nor a computer.) Most of the people I know use laptops, though, it has definitely shifted from PCs to laptops.
I guess it's because I used to work in a writing-based profession and mostly know academics.
KellyCriterion 18 hours ago [-]
I know youngsters who dont even have an email address. Though, this may change if they have to enter the workforce.
Lot of people using their office-notebooks at home, even if its not allowed. Most people out of tech do not have big hardware at home anymore.
teirce 21 hours ago [-]
A smartphone is the main / only 'computer' for a lot more people than you think.
This is complete conjecture on my part, but I bet if you're late 20s - early 40s, you probably have some form of pc/laptop laying around. But people 50+ (gen x / gen boomer), a phone is likely all you use or own. My mother, aunt, et. al operate totally through their phones. The same is true for my pre-teen, teenage cousins or cousins children (ipad generation).
alansaber 22 hours ago [-]
There has been a relatively strong local model community since the days of llama-3. IMO, the number of non-technical people interested in qlora, adapters, parameter fine tuning etc is remarkable.
htsh 21 hours ago [-]
that was when RAM and GPUs were cheap. Now that is dying, too.
cykros 20 hours ago [-]
Only people who have no concerns about privacy would give up on it entirely.
But yes, it has been a test of just how few tokens you can get by on.
c22 20 hours ago [-]
Don't think of it as a step back, it's just a point in a familiar cycle:
New application of computing requires a lot of compute -> compute centralizes -> compute improves, smaller, faster, cheaper -> compute decentralizes -> new application of compute is found -> (return to beginning of cycle)
kennywinker 18 hours ago [-]
Can you think of examples of this cycle? I know this is roughly what happened with mainframes, but I struggle to think of other times it went like that.
Maybe arcade games?
kllrnohj 17 hours ago [-]
CGI rendering. To do Pixar quality animations you used to need racks and racks of servers and it still took months. Now anyone can do it, and we saw tons of slick animations on YouTube from indie studios as a result (before the AI slop cloning started I mean)
c22 18 hours ago [-]
The first one was code breaking. The most recent was "cloud". If you look you will probably find others.
kennywinker 14 hours ago [-]
cloud? I feel like that's an example of things going the other way. It used to be every company would have either on on-prem or a colocated server at the nearest network hub - a fairly de-centralized system, and then everything went centralized with cloud platforms.
To be clear, I am not skeptical that it will work this way - I think it's pretty likely llm usage will be come a split of de-centralized and centralized. But I am not very convinced this is a natural law of technology.
atlasduo 21 hours ago [-]
Yes, we will. Eventually, specialized AI hardware (ASICs) will emerge that will be good for AI, but not much anything else. PCs are general purpose computers that are good at many things, but excel at few. There are quite a few startups working on it already.
I don’t see frontier AI ever happening in local machines. For the same reason that supercomputers don’t fit in your pocket/desktop.
But, the “good enough for most lay people” intelligence bar will for sure miniaturize, especially as inference ASICs get more specialized.
Junk_Collector 17 hours ago [-]
Supercomputer do fit in your desktop though. Most supercomputing challenges of the 80s or 90s fit comfortably on a modern home pc.
theptip 13 hours ago [-]
That’s not a supercomputer today.
But yes, we both agree that what was the frontier many years ago will fit on your desktop.
r0ckarong 22 hours ago [-]
You know what that era has in common with fossil fuel? It takes a very specialized infrastructure and supply chain that you can limit with lobbying efforts and gatekeeping so that all the money only flows to you and your cronies.
pmlnr 22 hours ago [-]
> It feels like a step back towards mainframe era.
:insert Will Smith presenting meme:
The Cloud
20 hours ago [-]
amelius 22 hours ago [-]
The only way this may happen is when the internet were to be somehow destroyed.
Which would not be all too bad. It would also mean the end of stupid SaaS subscription services, and mass surveillance, adtech. And shitty propaganda.
And your local AI could emulate the good parts of the internet.
cowlevel 4 hours ago [-]
Propaganda would still propagate through more closed networks. There's propaganda on TV. And at the bus stop.
palata 22 hours ago [-]
> And your local AI could emulate the good parts of the internet.
Like talking to people?
amelius 22 hours ago [-]
People did not live in social isolation before the internet existed.
In fact, it was closer to the opposite.
palata 21 hours ago [-]
Why are you here, instead of having your AI emulate HN locally?
eastbound 22 hours ago [-]
Trump and AI-power security research are both doing a good job of promoting installable software!
shevy-java 22 hours ago [-]
I never left the PC era, but the RAM prices kind of hurt me. I don't
know when I would want to buy a new PC - it seems to be 3x the cost
for barely any real benefits over the status quo.
palata 22 hours ago [-]
Which is not a bad thing per se: most of use could use our devices a little longer than we usually do.
saidnooneever 21 hours ago [-]
most games which require that big PC are poorly optimised and often times they arent even fun. these companies focus on visual fidelity and give all their engineers insane machines to build the games on. that has beenn destroying PC gaming way before AI/LLMs came into the picture.
I am using AI now to make a game engine that will run and make 'nice enough' graphics on simpler machines. things like laptops with iGPU and 4gb of ram.
U can still get quite ok graphics, and make very complex and rich gameplay systems using such a machine. It just needs to be the target machine while developing so the right tradeoffs are made.
Bengalilol 22 hours ago [-]
Yes we will and we all know it.
All those are raw materials.
ngomezdev 21 hours ago [-]
Yupppp. My current conspiracy theory, with all of the increasing hardware costs and how easy decompilation projects are, is that there is going to be a major push to eradicate consumer hardware and keep all software in the cloud.
Everybody will have a mini PC for the sole purpose of streaming content, with no storage to keep anything on it.
jasomill 15 hours ago [-]
Why would component vendors allow shortages to continue indefinitely for the benefit of hyperscalers and AI companies, especially given what may be years of pent-up demand in other markets?
And why would the game industry, considered as a whole, want to incur higher costs to exclusively deliver its product in a way that provides less value to the majority of its customers, many who won’t be willing to pay the higher prices required to maintain similar profits?
Recompilation at most threatens platform exclusivity as a business model. Otherwise, it’s just piracy with extra steps.
At most, I expect to see already existing trends towards more live service components and microtransactions continue, with digital delivery only and a required online component in many cases, but with most if not all of the actual game code and assets hosted and running locally.
As for non-gaming applications, content creation and a software development are two examples where "cloud native" workflows remain cost-ineffective in many market segments in spite of hardware price increases, and will remain so as long as cloud providers continue to nickel-and-dime customers for IOPS and compute.
teirce 21 hours ago [-]
I don't know how much of a conspiracy that is. If the current trend of hardware costs keep rising to the point of pricing people out of having any real compute locally, and chip makers actively de-prioritizing consumer-grade memory, GPUs, etc, companies will (more) heavily push thin clients and streaming for everything.
charlieyu1 20 hours ago [-]
I really don’t see it happening at all, not with current trends, you can barely run Win11 on 8GB ram anymore
teirce 19 hours ago [-]
This kind of makes my point. Consumers won't be able to run things locally, so you end up with Win11 in the cloud and your device is just a glorified browser because that's all you can afford.
notabotiswear 20 hours ago [-]
I would have laughed at the thought a few years ago, but now I am slowly starting to adopt some of the viewpoints of American second amendment hardliners.
It's just unfortunate that producing a half decent computing platform is significantly more difficult than a rifle (and that in the case of said hardliners, the capital is backing them, here it's working against us).
vrighter 19 hours ago [-]
back to the mainframe era came with the insane proliferation of cloud everything, not with ai
150g2 20 hours ago [-]
[dead]
trvz 21 hours ago [-]
There's a lot of hacking going on right now with small (qwen 3.x and gemma 4 based) and medium (deepseek flash and others) models alike.
Have an agentic enough setup and they'll do anything that the biggest closed models can. They'll also do more, making them the true frontier.
A sensible point of entry is a 2899$ Mac mini.
If you're not partaking that's only on you.
NBJack 21 hours ago [-]
> A sensible point of entry is a 2899$ Mac mini.
> If you're not partaking that's only on you.
There's honestly nothing sensible about that for a lot of developer budgets across the globe. Don't assume most folks have $3k to burn.
zahlman 21 hours ago [-]
Yes, but that's a lot of money if you don't already have the hardware, plus you'll still be paying for electricity costs. (No comment on relative capabilities.)
Paracompact 21 hours ago [-]
$3k being a point of entry for a pale imitation of the models being compared to is not very inspiring.
lgl 17 hours ago [-]
Surely this is a joke or sarcastic comment?
They absolutely can't do what, or more of what the biggest models can do. There's nothing frontier about small local Qwen or Gemma models.
2899$ gets you a machine that is just good enough to run some small models, slowly, with terrible context, requires a ton of tinkering and fine tuning, managing and constantly downloading a bunch of huge file blobs, etc.
Partaking those $2899 in most of the large cloud models would bring you much more productivity, much less boilerplate and time spent in setup, etc.
So.. just weird accusing people here of "not partaking" in AI when you're just essentially toying around if you're actually comparing local Qwen and Gemma's with frontier models.
moffkalast 20 hours ago [-]
Yes but then you'd have to give closed-ecosystem-ass Apple money, which is worse than giving it to Nvidia who at least support linux properly. And you still get prompt processing speeds of a leisurely sloth.
The quote assumes that all of humanity has the same goals as a corporation does: that every individual person desires maximum utilization of components for the sake of company shareholders. Individual people want a computer and just can't buy them because the entire world's memory chip supply, flash storage supply, and increasingly hard drive supply is being swallowed into the maws of corporations who would love nothing more than to sell you tiny bits of that compute through a monthly subscription in perpetuity.
Not everyone subscribes to the "cloud compute is more important than everything else" outlook, but everyone is affected by it nonetheless.
simoncion 17 hours ago [-]
In that statement, Altman also insinuated that most businesses switching from SAAS provided by OpenAI, Anthropic, or the VC-funded companies that build on top of them to locally-hosted software won't kill both OpenAI and Anthropic.
Given that he was in a fluffy interview at the time, he's not going to say that OpenAI and Anthropic would die, but we all know that -unless the "Pacing The Frontier" garbage succeeds in its goal of creating law and regulations that massively obstruct LLM manufacturers who aren't the four or five currently-largest ones in the US- that's how it'd turn out. Once OpenAI and Anthropic are dead, the VC money pouring into the LLM manufacturing and services industries evaporates, and all that demand for high-speed VRAM vanishes with it.
So, no, switching to locally-hosted software will reduce RAM prices... just not immediately.
fantyoon 20 hours ago [-]
It sort of is, no? To agree with it, you need to share the goal of maximum utilization. Sam Altman seems to take that as a given. But clearly people disagree and not just with RAM. Most kitchens and bathrooms are unused most of the time, but that doesn't mean every home having one is bad.
jcelerier 19 hours ago [-]
> Most kitchens and bathrooms are unused most of the time, but that doesn't mean every home having one is bad.
isn't communal living the most efficient thing resource-wise though?
flexagoon 19 hours ago [-]
I think that's exactly the point OC was making, it's the most efficient resource-wise but that doesn't make it the objectively best form of living
MattRix 20 hours ago [-]
No, he was not saying that was his goal! That's what everyone seems to misunderstand about this quote.
It's like a highrise developer saying "people think our buildings take up a lot of land, but actually houses are much worse from a land use perspective". Which is objectively true, and yet does not mean the developer thinks the entire world should be turned into houses, or even that they dislike houses!
kasabali 19 hours ago [-]
Except he was the developer who signed a deal with land owners to buy 40% of the land with the intention of building houses to rent and caused condo prices to 5x.
MattRix 4 hours ago [-]
No, it's more like he was just clearing up the misconception that "cities would be better places to live without all the highrises in them".
LeBit 17 hours ago [-]
Not sure it is "weird".
But saying people shouldn’t want something that was abundant and you made scarce is an asshole thing to say.
the_af 20 hours ago [-]
Sam Altman's argument is very conveniently self-serving.
The difference is Codex couldn't shake its preference for making flashy, loud, obnoxious marketing websites that look like they're trying to sell you a SaaS. This website looks like it wants my money. Meanwhile the website from op is simple, focused, and far more comedic than codex's slew of AI-generated "jokes".
zipzad 18 hours ago [-]
I agree, and it's on purpose. I deliberately made it stink of vibe coding. It's also hosted as a ChatGPT site.
geekgod382 21 hours ago [-]
Why do people pay $15 just to buy domains for these meme websites?
ijustlovemath 21 hours ago [-]
We pay $15 for frivolous things all the time
KZerda 18 hours ago [-]
$15 is cheaper than a movie ticket and the creator probably got more enjoyment out of it. Also, sometimes getting a few giggles out of people is return enough out of an investment.
crest 20 hours ago [-]
Because it’s cheap and fun?
geekgod382 20 hours ago [-]
$15 can be spent on other stuff too, something useful
pwython 19 hours ago [-]
Just imagine the author had loads of fun making it.
The thing about fun and hobbies is that they are rarely useful. People spend money to have fun.
Justin_K 16 hours ago [-]
You're sucking the spirit out of this board
tkdb 21 hours ago [-]
Social commentary.
Rexxar 20 hours ago [-]
It's the proof that people have too much money and should instead give it to Sam Altman that will make a more efficient use of it for our collective wellbeing®.
The quote wasn't weird and made total sense in Altman's POV. It was just egoistic and myopic regarding how people feel about ownership and independence.
MattRix 20 hours ago [-]
It has nothing to do with his POV or even ego. It was an objectively true fact. GPUs in data centers do get more utilization than those used locally. That's all he was saying.
ravetcofx 17 hours ago [-]
And engines in busses objectively get more utilization than the combustion engine in your vehicle.
ipsento606 19 hours ago [-]
Something can be a true fact and still be an ill-advised or tone deaf thing to say.
stalfie 19 hours ago [-]
Especially when you take into account that people are largely unconcerned about true facts, and will gladly misquote or misinterpret you just in order to be outraged.
MattRix 4 hours ago [-]
It wasn't ill advised or tone deaf, it was taken by the media out of context. You can't take stuff completely out of context and then complain that it's tone deaf.
stackbutterflow 17 hours ago [-]
This is techno utilitarianism.
Also, a lot of things are true but what truths you choose to broadcast can tell us what you care about. E.g it's also true that we'd all be richer if sam altman shared is wealth with us, lets take a few seconds to think why he's not saying this truth, after all it's an objectively true fact.
MattRix 4 hours ago [-]
You can think whatever you want about the guy, but when you willfully misinterpret his words because it fits with your view of what he secretly believes anyway, I think that's still a bad thing for you to do.
kasabali 19 hours ago [-]
Is it really "all he was saying" when he's single handedly responsible for creating a worldwide RAM and NAND shortage?
petu 18 hours ago [-]
He said/implied that we would have shortage either way (without data center buildout, but everyone who wants access to LLM does private/local inference), which doesn't sound far fetched.
jorl17 18 hours ago [-]
Single handedly? I'd say the the people using (or forcing others to use) the models, therefore justifying the need for them, play a part in it.
Sure, he wasn't implying anything. He just recited this fact completely out of context and wasted airtime.
esalman 19 hours ago [-]
The whole context of Sam Altman and other tech billionaires is weird. The modern tech advancements are deeply rooted in exploitation, racism and eugenics, concentrating military, political and economic power, and stealing agency and power of resistance from the common people.
excannuk 19 hours ago [-]
[flagged]
bajard 22 hours ago [-]
I suspect that this actually downloads something instead of uploading. I have no proof, but I believe it.
zyx321 21 hours ago [-]
It's a reference to the old "download more RAM" meme.
I would be shocked if it did anything at all.
Semaphor 20 hours ago [-]
No, it does. I donated 16 GB, and my FF usage slowly went up to 24 GB
bajard 21 hours ago [-]
I tried to upload 16 GB to help Zuckerberg, but the GUI is suspicious.
adityashankar 21 hours ago [-]
[dead]
zahlman 21 hours ago [-]
From a quick skim of the page source (including a dynamically created iframe) it just does a little animation and locally allocates some useless arrays in JavaScript to waste your "uploaded" RAM.
klas_segeljakt 21 hours ago [-]
[flagged]
alexpadula 18 hours ago [-]
Error code: 5
georgestones 23 hours ago [-]
[dead]
dekdrop 20 hours ago [-]
[dead]
stingraycharles 23 hours ago [-]
This is silly, and I know Sam Altman said that consumers having RAM is not an efficient usage, but the real villains here are the memory manufacturers that have time and again have been proven to collude on price fixing and whatnot, and are now not scaling up production according to demand.
I don’t think it’s very productive to go on a witch hunt on someone who said something stupid and is being taken out of context (albeit he should have known not to say that).
cowlevel 22 hours ago [-]
As far as I can see, there's no evidence they're colluding here. They're just capturing the money that otherwise would have gone to scalpers.
Apparently the last three times this cycle happened, the manufacturers that built out capacity went bankrupt when it popped, and the ones that didn't didn't, so they're actually being wise.
Lerc 21 hours ago [-]
Well there was no evidence they were colluding until they got caught the previous two (three?) times.
akoboldfrying 21 hours ago [-]
Following this logic, I now suspect everyone of price collusion -- including myself
Lerc 21 hours ago [-]
Ok, to put it simply.
Absence of evidence is not evidence of absence.
If an event happens, and multiple previous times that event happened a cause was identified. It is reasonable to suspect the same cause was responsible this time.
It does not give proof, but it does give reasonable suspicion.
akoboldfrying 21 hours ago [-]
Fair, I misread the GP's post, sorry. (For some reason I thought they were claiming that the companies that colluded in the past went bust, leaving only the non-colluding ones.)
grosswait 22 hours ago [-]
The RAM industry is littered with corpses. It’s a boom and bust business and fabs are extraordinarily expensive.
sznio 23 hours ago [-]
>and are now not scaling up production according to demand.
hopefully china does it and hynix burns in hell
high_na_euv 22 hours ago [-]
>have been proven to collude on price fixing and whatnot
where is the proof?
>and are now not scaling up production according to demand.
fabs are being built by maaany companies, but it takes years
To date, five manufacturers have pleaded guilty to their involvement in an international price-fixing conspiracy between July 1, 1998, and June 15, 2002, including Hynix, Infineon, Micron Technology, Samsung, and Elpida.[3]
re "what proof means": Im not your house boy. Go get it
yourself.
proof ... the thing a narcissist demands from you, but will never acknowledge having received.
its a good lever when it works.
HFguy 22 hours ago [-]
If someone asserts something without proof, then it can be dismissed.
Simple as that.
If I said all donuts are spaceships, readers are not obligated to go and google it.
MadameMinty 21 hours ago [-]
Treating the 4th time the same conspiracy would be happening—after 3 previous times proven to be true—as a nutty conspiracy theory is itself nutty. Detached from reality.
You're free to doubt it, it's not absolutely certain, but pretending the chance is near zero is just not even remotely as rational as you seem to think.
Kevin_Flynn 21 hours ago [-]
Its an equivocation fallacy.
Theres never any "proof."
Theres no "proof" on the internet.
All we ever have is "evidence," and varying degrees of trust or mistrust in it.
Reality ... always good for downvotes.
Lerc 21 hours ago [-]
If I said water was wet you are not obliged to Google it either. If someone continues to assert that water cannot make you wet even after being informed that water makes things wet because they hadn't been provided proof, and they didn't bother to check, that might be on them.
altmanaltman 21 hours ago [-]
Hynix is charged with carrying out the conspiracy by:
* Participating in meetings, conversations, and communications in the United States and elsewhere to discuss the prices of DRAM to be sold to certain customers;
* Agreeing, during those meetings, conversations, and communications, to charge prices of DRAM at certain levels to be sold to certain customers;
* Issuing price quotations in accordance with the agreements reached; and
* Exchanging information on sales of DRAM to certain customers, for the purpose of monitoring and enforcing adherence to the agreed-upon prices.
* Under the plea agreement which must be approved by the court, Hynix has agreed to cooperate with the government in its ongoing investigation of other DRAM producers.
KOREAN COMPANY--HYNIX--AGREES TO PLEAD GUILTY TO PRICE FIXING
AND AGREES TO PAY $185 MILLION FINE FOR ROLE IN DRAM CONSPIRACY
This is remarkably different than someone claiming donuts are spaceships when the company itself was charged and pleaded guilty, and it's a matter of public record.
high_na_euv 20 hours ago [-]
the fuck you talking about?
just asked about some kind of proof when world is full of conspiracy theories, nothing wrong with that, so stop being aggressive and snarky
and i knew about stuff from 2000, but thought there was something recent
dist-epoch 22 hours ago [-]
I don't think you understand what the word proof means
conorcleary 21 hours ago [-]
Hi there, what is a blockchain?
AlecSchueler 23 hours ago [-]
> are now not scaling up production according to demand.
Would you though? If/when the AI bubble pops and the buildout of data centres either stops or plateaus then they'd suddenly be sitting in a vastly oversaturated market and struggle to make it to the end of the year.
stingraycharles 23 hours ago [-]
If there was healthy competition, yes, because it’s not as if this hasn’t been going on for years at this point.
Moosdijk 23 hours ago [-]
All the healthy competition is operational now.
New fabs will be operational in a while, which is too big of a risk to take in these times.
adrianN 23 hours ago [-]
It takes a while to build those fabs.
iagiagiag 22 hours ago [-]
> struggle to make it to the end of the year.
Considering the profits they've made this year, on average they still wouldn't do too bad. SK Hynix employees got almost $500k for example, I can live on that for a few years. Companies are often also legally required to compete with each other.
But they are scaling up the production, they just conveniently did it a bit late. I also fear if/when the bubble pops, they'll quickly reduce the production to ensure prices stay high. I fear Nvidia could do the same. I think it'll be hard for all of them to go back to a world where they're paid way less per component, so instead of accepting that, they can reduce the supply and keep the prices high. Only antitrust regulators could intervene to stop that.
Many people expect prices to go down after the bubble pops, but it may not happen as much as we would want to.
OroPla 22 hours ago [-]
Remember when the dot com bubble burst and after that the Internet became a billion times more important than before? Wikipedia didn't even exist when the dot com bubble collapsed!
All that bubble popping will do is wipe out some investor's money. Everything else will stay and become more and more important.
But of course, it is more profitable to sell one item for $1000 than it is to sell ten items for $100 each. And even if a competitor shows up, you can just price dump with all the extra money you already made until that competitor goes away.
59percentmore 21 hours ago [-]
This is what I say about any financial collapse/bubble pop/credit crunch. Resources don't blow up, people don't drop dead in the streets. A few rich folk who thought they were getting paid, aren't. Everything that happens after is second-order effects of them getting huffy about it. They don't have to cut wages and fire people and disrupt the supply chain; they could sacrifice their own largesse to keep things stable. (And the job of government in those circumstances is to force them to.)
matkoniecz 23 hours ago [-]
> and are now not scaling up production according to demand
1) boom and bust cycle in memory industry is a repeated problem
2) companies are not obligated to scale up
> and is being taken out of context
no it is not - Altman is lying by omission[0] by implicating that various important costs are not real
Witch hunt?! Sam said something goofy, a goofy little website was made to poke fun at what he said.
Good god the internet is so sensitive nowadays
exitb 23 hours ago [-]
Nothing silly was said really. The remark was specifically about local inference and RAM supply issues and it’s entirely true - if all current AI users tried to switch to local models, it would make the RAM availability situation much worse. I userstand that regular Twitter folk doesn’t grasp that, but this isn’t Twitter.
Hamuko 23 hours ago [-]
Would it? First of all, all current AI users still need memory in their devices. You can't use ChatGPT with pen and paper. There would always be a consumer demand for memory, even without local inference. Secondly, it'd drastically decrease the demand for HBM, which has shit yields when compared to conventional memory. It's also questionable as to how much of the produced HBM is actually in use and not sitting in a warehouse.
matkoniecz 22 hours ago [-]
Altman is still lying by omission[0] by implicating that various important costs are not real
And "if all current AI users" is a strawman, people using free chatgpt once or twice a day are not going to buy RAM to run own LLMs.
MattRix 20 hours ago [-]
You are misunderstanding the quote.
matkoniecz 19 hours ago [-]
In which way?
MattRix 4 hours ago [-]
It was not about any of the things you stated. It was about the simple fact that DRAM in data centers get used more than personal/local DRAM.
Moosdijk 23 hours ago [-]
It’s almost like it’s a calculated move to distract from other things.
quikoa 23 hours ago [-]
> but the real villains here are the memory manufacturers
Ah yes Sam Altman is not a real villain despite OpenAI locking up 40% of global DRAM supply.
kreco 23 hours ago [-]
They are both villains.
If a customer ask me to get all my butchery stock for a year, it will make thousands of client unhappy and will make one client happy, so I'll simply refuse.
This is not how business is supposed to be, the world is not supposed to be a B2B chaos.
I know how the business is done "supply demand" bla bla. That does not make it ethical one bit.
OroPla 22 hours ago [-]
It wouldn't matter if they made enough of it to meet demand.
Culonavirus 22 hours ago [-]
It really seems like the majority audience of this site (lukewarm left wing nerds, let's be honest) is trying to square a circle with the unwavering AI support (I mean the ecosystem and the people, not the technology, which is indeed great).
If you look outside the tech bro / stock bro / tech worker circles and into the mass left wing populace everyone HATES ai and ai data centers... the Altmans, the Amodeis, the Huangs, they are not the devil himself levels just yet (cough, Musk, cough), but they are climbing up there.
People's jobs being taken (and especially entry/junior jobs, you know, the ones young people, who voted massively blue, need to get started in life), data centers increasing their electric bills or polluting the air with gigawatt level gas turbines (or both), consumer electronics prices rocketing up (~400% increases YoY in RAM and SSD prices) just so the corporate capitalist class can hoard millions of gpus in warehouses.
I mean, if the democrat politicians getting into power keep their promises and step on AI buildout's neck, it could be lights out for the AI bros.
sunaookami 22 hours ago [-]
>everyone hates AI
ChatGPT is one of the most used websites in the world. Compared to e.g. Facebook you are not "forced" to use it (because of friends or whatnot) so it's all voluntary usage. There is real demand for AI usage, that's why RAM and GPU prices are skyrocketing, not because of some evil conspiracy.
the_af 20 hours ago [-]
> It really seems like the majority audience of this site (lukewarm left wing nerds, let's be honest)
I don't see this, no. I think HN serves as a sort of Rorschach test for the reader. I get a center-libertarian vibe from HN, definitely not left wing. That's probably my own biased perception, of course.
I also think while there's a ton of AI articles, there are also very vocal people against it. The sentiment is not universally "AI booster" here, it's a mix.
brainwad 22 hours ago [-]
American exceptionalism again. If American politicians ban data centre builds in the US, that won't stop 'AI bros'. It will just run elsewhere, and at best Americans will just have a bit more latency on their AI services.
Grimburger 22 hours ago [-]
It was taken out of context for sure but still find this site amusing. Perhaps even prophetic, can we build enough ram and vram for future requirements when theres only a few holding the keys.
Obligatory: "we're curing cancer r-right?" No Nat we're making slop videos with it.
22 hours ago [-]
shevy-java 22 hours ago [-]
All are responsible - the AI greedy companies and
the suppliers.
If the USA were a real democracy they would do something about
it. After all this even violates capitalism, e. g. free market
leading to reduced prices. But the USA is run by a criminal
gang, pocketing away money - the TechBros and their cronies. They
just make any legislation they want to, with a bit sugar coating
on top to not appear too overly evil or greedy. But they are.
mrlonglong 21 hours ago [-]
+1
7Chinguun7 23 hours ago [-]
Its because of the companies too i mean they are not making too much ram on purpose to make supply low and demand high.
greggsy 23 hours ago [-]
No, the foundries are just redirecting production to HBM, which is in much higher demand.
gambiting 23 hours ago [-]
Except that's nonsense, any company that could make more ram absolutely would because the damand is insane. There is no universe or economy where it would be profitable to artificially lower your production to keep prices high when you can just make more ram.
Taek 23 hours ago [-]
It depends on how much inelastic demand there is. For example:
Let's say there are 10 companies that need 1 GB of RAM each in a life-or-death scenario. They would be willing to pay $100,000,000 per GB to get 1 GB of RAM.
At the same time, there are 90 more companies that need 1 GB of RAM each to make certain quarterly targets. They are willing to pay $10,000 per GB to get 1 GB of RAM.
If you make 9 GB of RAM, you can sell it for $900,000,000. If you make 99 GB of RAM, you can only sell it for $990,000, because the 10 life-or-death companies only need to bid high enough to push out a quarterly-target company.
It's a bit of a contrived example, but it shows you how restricting supply can boost total revenue if there is a segment of the market that has inelastic demand. (this is why medicine pricing has to be regulated - in the medical industry, there are lots of inelastic demand scenarios that can lead to predatory pricing)
matkoniecz 22 hours ago [-]
We are not getting this level of scarcity yet, so that mechanism (life of death desperation of rich players) is not entering picture yet.
Also, it is not likely to happen any time soon.
We have less rich gamers deciding to not upgrade their PCs at most.
galbar 20 hours ago [-]
We have less rich gamers deciding not to buy a new PC in favour of streaming games from NVIDIA GeForce NOW.
Evidence: a friend of mine this month decided that he can't justify dropping $1.6k on a gaming computer.
As a PC gamer since I have memory, this whole situation makes me sad.
IshKebab 22 hours ago [-]
Yeah except price differentiation exists. There's a reason Nvidia doesn't allow consumer GPUs in data centres.
brainwad 22 hours ago [-]
Until making more means huge capex building extra factories. Semiconductors is famously a boom and bust industry, building too much in the boom will kill your company.
gambiting 22 hours ago [-]
Obviously, but I understood OP meant that they have capacity right now they are just choosing not to make more RAM right now.
raincole 23 hours ago [-]
Really? You never heard about how OPEC?
matkoniecz 22 hours ago [-]
OPEC that in an equivalent situation was desperately trying to increase oil production, to discourage looking for alternatives to oil? This OPEC?
greggsy 23 hours ago [-]
So… the major manufacturers, which operate across different continents with notoriously uneasy geopolitical tensions, are secretly operating a silicon cartel?
chmod775 22 hours ago [-]
You mean the exact thing that happened before involving a dozen companies and that ended with prison time and fines?
Truly an unimaginable and ludicrous suggestion in a time where regulators are less likely than ever to pursue it.
There is probably no way that I can word this without my comment getting massively [flagged] and [dead] and me getting mass reported to the moderator. Considering the current state of things.
But isn't mister Altman correct in a sense? Why the hell would people need 16 gigabytes of RAM or more to make spreadsheets and type documents? Receive and send e-mail, make travel bookings, listen to music and read the news. Maybe make posts on social media, or publish on your own website.
Have we forgotten that all of this functioned very well when RAM wasn't even in the gigabytes? And that most of this functioned very well when RAM wasn't even in the megabytes? I remember this time, and certainly must many of you. Of course it is more comfortable today with more powerful machines
There must come a moment when we judge a machine or a system by the results they produce, by the fruits of the tree so to say. And those fruits haven't changed or improved noticeably in decades. There is one big improvement that undeniably requires more memory from the computer that I can think of, which is the much higher resolution of displays of today. Probably there are some more.
Specialized use is of course different, whether that's compiling code, rendering photogrammetry scenes, or playing graphics intensive games.
makeitdouble 17 hours ago [-]
> Have we forgotten that all of this functioned very well when RAM wasn't even in the gigabytes?
Everything you listed worked for decades with a lot less RAM, but was also more limited and potentially different in substance in critical ways. It's the "Mom I want X ! -> We already have X at home" meme, where the "X at home" is some poor version of what was requested.
I understand some people could still enjoy a retro style experience, but I wouldn't give up on my HDPI displays for instance. Or touch support. Or keeping 40 tabs open instead of hand managing my tabs or rely on some dumb auto-close algo.
Spreadsheets can now have dozens of thousands of line and still be snappy to manipulate, we can play high def videos while doing actual work without freezing the whole system. Photoshop and Lightroom used to be crash junkies for even basic operations and people would baby the settings to aleviate that; with the RAM we have now it has become a somewhat decent situation (still crashes, just way less)
I still have 10~20 years old machines around and boot them occasionally, there's just no way I'd get back to them full time and try to do the same volume of work as I'm doing now.
PS: there's also the "people only do email and browsing, perhaps some Word or Excel" fallacy. Nowadays phones will be enough for most of that, and people will mostly avoid doing them if it requires opening a computer. That's where we have so many budget management apps for instance.
So, computer are a lot more niche than before, and the requirement also go higher. People on computer are either power users or doing somewhat intensive things.
carlosjobim 16 hours ago [-]
I agree with you on HDPI, which is why I mentioned it. That's a tangible benefit for all users, which would be impossible without the increase in RAM.
40 tabs open at once? That doesn't need a lot of RAM if websites were programmed to do what they actually do: Display text and images.
I don't think touch needs any special amount of RAM, would it differ for the operating system than a mouse?
Photoshop and Lightroom <- These I think fall into the category of special use cases for professionals, which absolutely need more RAM than a home user. For somebody who only occasionally wants or needs to do a bit of advanced photo editing, it's okay to wait a bit longer for operations.
> I still have 10~20 years old machines around and boot them occasionally, there's just no way I'd get back to them full time and try to do the same volume of work as I'm doing now.
Are you sure about that? If you actually sat down to only work, without having YouTube videos open or other things going on in the background? If you close your Amazon Black Friday tab you already liberate 500 megabytes of RAM.
> PS: there's also the "people only do email and browsing, perhaps some Word or Excel" fallacy.
No, in this case it is you who didn't understand or didn't want to understand. Nowhere did I say only. But the things I listed are what normal people do mostly. And nobody would want to type a long report or do spreadsheets on their phone.
> So, computer are a lot more niche than before, and the requirement also go higher. People on computer are either power users or doing somewhat intensive things.
Not at all. Most computers are used by office workers at their job, and I'd bet that most home computers are also used for non-intensive purposes. But I think you're right in what direction things are moving.
makeitdouble 15 hours ago [-]
> websites were programmed to do what they actually do: Display text and images.
Technology should be allowed to evolve as needed. Smartphones were also supposed to be phones, and I'm sure I'm not the only to basically ignore the phone app unless forced to.
I'm totally fine with progressive web apps for instance, or how Figma is pushing the boundaries to bypass the whole native Store requirements.
> Lightroom
Photography is a mildly popular hobby. Even as phones are king, around 10 million dedicated cameras were sold last year [0], so having Lightroom as a home user isn't as exotic as you make it sound like.
The issue is not really the wait time, it's the instability and crashes, which are aliviated by less back and forth between the disc and the RAM. It's totally Adobe's fault, but I also think it wasn't a simple problem to begin with.
> only work, without having YouTube videos
I need YouTube and I suspect many do. Currently all of last year's WWDC sessions are on Youtube, as do most video tutorials, business presentations etc. Also work BGMs, podcasts, live streams etc. are resources people also use to keep focus or stay awake through their working day.
People used to listen to their own sound on dedicated devices, IMHO it mostly moved to their computers, especially as bluetooth gives more flexibility to move around.
> office workers at their job
I'd wager most of these workers job involves more than what you're giving them credit for. I've followed CS agents dealing with user requests for instance, one of the lowest job level in our org, and that involved a lot of multitasking, juggling with the ticketing system, and keeping stuff at hand. In particular the agent I was shadowing had a discord call going on about a third of the time, with me in a Meet session. Sure, 20 years ago we would have done it a different way. But nowadays that's just how they're doing it.
Traditional data entry jobs might be different, but how many of them still exist as of now ?
> And those fruits haven't changed or improved noticeably in decades.
Strongly recommend you get Gemma 4 12B QAT on a computer that can run it, and then disconnect the internet and see what it can still do. Even the smaller E4B will show you.
Local AI is the first thing in decades (since editing video, perhaps) that meaningfully changes what a disconnected machine is capable of.
carlosjobim 18 hours ago [-]
Yes, but system requirements bloated to this extreme point long before there was any AI at all.
LeBit 17 hours ago [-]
What are you supposed to do if you want to run a homelab without paying rent to a billionaire?
Altman made things I could buy at a reasonable price unaffordable.
ramon156 20 hours ago [-]
If only everyone lived more optimised!!
being correct doesn't mean your reasoning isn't crooked. His implication is "You don't need it, but I do!"
It's a monopoly saying they do not have enough resources. It's the big man saying he needs more food.
topaz0 18 hours ago [-]
The same logic goes the other way -- things functioned well before you could spend hundreds of dollars a month multiplying matrices to spew bloat into your code (or, for that matter, your spreadsheets and slide decks).
excannuk 19 hours ago [-]
[dead]
allallx 23 hours ago [-]
This is stupid.
doginasuit 22 hours ago [-]
I feel like you had to live through the download more RAM scam/meme of the early internet to fully appreciate the joke. I remember installing it.
cyclopeanutopia 22 hours ago [-]
[dead]
EliRivers 23 hours ago [-]
If you want the personal thanks from Altman without having to actually give up your RAM, you can download some here first https://downloadmoreram.com and then upload that to Altman.
rbinv 23 hours ago [-]
Someone should just FXP it over
serf 23 hours ago [-]
I figured it was a cute tongue-in-cheek thing, and crashed my browser tab with a 16gb ask.
that could've been crummy for someone; you should warn that your cute little complaint actually eats ram; half is clearly fiction but the OOM isn't.
pmlnr 22 hours ago [-]
What did you expect to happen instead?
Do you also click on the links of the Nigerian princes?
Den_VR 23 hours ago [-]
While I’m not sure what this does, I’ve made sure to have chatgpt do it for me, safely from the cloud.
f4 22 hours ago [-]
Leave Sam alone! Your wit and guile is not appreciated. We would prefer you punch down or across in future engagements.
On a less sarcastic note, I wonder if a community based compute donation could actually help offset knowledge and compute centralisation.
Incentive is difficult but anti-AI sentiment is still as strong as ever. Maybe an A-v-A (in the spirit of H-v-H) campaign might pull in some.
thinkingemote 20 hours ago [-]
> community based compute donation
also, spare LLM credits from donations for use by community groups
solyin 23 hours ago [-]
We don't have to talk about paperclips anymore, it's RAM. Anyone want to play a game of ram chip maximizer?
meteyor 22 hours ago [-]
I tried donating 16GB of RAM and it crashed my browser :D
mrlonglong 21 hours ago [-]
Same. Hope it was a zipbomb right into his mailbox.
zetanor 21 hours ago [-]
The real solution is even simpler than having everyone upload their RAM to him: Sam can ask Claude (or ChatGPT, if OpenAI takes diversity hires) to build him a DRAM fab, using ultrathinking, making no mistakes.
stephbook 17 hours ago [-]
I bet that guy has more unused RAM at home than I do.
prophesi 18 hours ago [-]
I enjoyed this alternate phrasing of the Sam Altman quote:
"From a global allocation perspective, actually, it's quite terrible to [let billionaires] have a bunch of the world's limited supply of [money] sitting in their own [stocks] and being used 5% of the time. You want maximum [taxes] if you're trying to deal with this very supply-constrained environment. And somehow many people's intuition is the opposite of that."
cellardweller 20 hours ago [-]
I've donated 25 GB, but the ungrateful brat is still frowning.
whoanoway 20 hours ago [-]
[dead]
DerDerDaIst 21 hours ago [-]
i agree with sam.
Plus it's far more efficient to buy tons of gpu's for the shelves rather than actually use them.
layer8 21 hours ago [-]
Why isn’t Sam Altman just using SoftRAM?
cloudengineer94 21 hours ago [-]
Tweet this at him everyone
tiotempestade 21 hours ago [-]
This is his stupidest argument ever! I can't believe no one replies back properly:
Just give us back our RAM prices so that everyone can afford 256GB DDR5 and run their models locally!
This solves the datacenter problem and it's impacts, RAMageddon, SSDgeddon, etc..
and they can just sell us the improved models without the hassle of doing the compute themselves..
What's the problem? With the proper ToC's they would still get our data..
¯\_(ツ)_/¯
mattstir 20 hours ago [-]
Sam Altman's argument was that people tend to not run their consumer electronics at 100% 24/7, and so views the time that's not happening as wasted potential for RAM that could be sitting in a data center. I sincerely reject that notion, but from that... utilitarian perspective it's hard to argue that spreading out the world's limited RAM supply across thousands of personal machines would fix any issues
orangecat 16 hours ago [-]
Just give us back our RAM prices so that everyone can afford 256GB DDR5 and run their models locally!
And Sam's (correct) point is that that doesn't work. If everyone tried to run the same amount of inference locally with the same size models that they're currently doing, the shortage would be even worse.
jmclnx 21 hours ago [-]
>so consumers are left to feel the guilt of having unused RAM in their computers
Funny WEB Site!
Not me, I have 2 8G DDR4 sticks sitting in a draw that I purchased a few of years ago when they were cheap. I was going to use them to upgrade my W541 to 32G, but I have one of the first models that the max is 16G. So saving them in case I have RAM issues.
If Sam wants them, he can pay me 5000 USD each for them, otherwise I will proudly hang on to them. If I knew his email I would send him a pic of them saying "hahaha" :)
Of course, because no human can be sloppy with commits on a stupid one-off joke repo...
You people are obnoxious.
ModernTimes 23 hours ago [-]
Found the person who consumed the fake propaganda about the Sam Altman quote.
rfgplk 21 hours ago [-]
Yep. Not only that but the quote (even if taken out of context) is factual. >99% of people load up their computers with comical amounts of ram when they really, really don't need it. This excess then only fuels the creation of memory inefficient apps. People are in shock when I tell them they could take the whole OS state when running any AAA game, reduce memory usage by an order of magnitude (if optimized correctly) and they couldn't spot a single difference. Most of those >200GB game installs could literally be reduced to a few hundred MB (no, you don't need massive textures + you can generate most on the fly).
954380863 23 hours ago [-]
This is tremendously fake news. Everbody knows it. The best people say it's fake.
mattstir 20 hours ago [-]
I get that I'm falling for low quality bait here, but what about him saying that it's terrible for people to have RAM is "fake propaganda"? The entire exact quote is:
> From a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used 5% of the time. You want maximum utilization in the cloud if you’re trying to deal with this very supply-constrained environment.
That's a ghoulish point of view that puts real living humans on a lower hung than the poor poor corporations who just want RAM to be so expensive that everyone needs to buy compute from them. Convenient for the corporations!
ModernTimes 17 hours ago [-]
That quote is accurate, but becomes fake when the context is missed out. He was talking about people using local AI models versus cloud. Nothing to do with "you shouldn't have your own PC".
He's an easy target because of who he is, so I understand why the entire Internet ran with the fake story (even LTT!). But on Hacker News you'll definitely get pushback if you post misleading stuff.
Will we go back to PCs? As in: are we going to get cheap local hackable frontier AIs at some point? I hope so.
Forget about AI, the entire PC market is getting killed over this.
As an avid gamer I'm unsure if in 5 years I can even buy a gaming PC anymore. Not even because of cost, but it's unclear if anyone will still make the components anymore.
NVIDIA isn't interested, nor is AMD.
BUT! I feel that lost hope could/will turn into a new forms of "min-maxing" or whatever where we will see people focusing on small, efficient software to make the most of what we have to weather the drought. We got spoiled with cheap hardware. Time to make the most of all that cheap hardware we have.
Though of course, replacing this hardware as it breaks down will be expensive. Perhaps we could go back to 1/2/4 GB RAM sticks and 256/512 GB Disks. Then run minimal Linux installs, minimal GUIs, minimal services, minimal software.
To amend this: Reading the 8088 domination article and the little $8 RISC-V Linux board I think we have plenty of opportunity. Maybe we learn to shed our inefficient BIG computers for small, low power, purposeful, yet general computers. I play with Plan 9 a lot and its portability, small footprint, low resource, and distributed design has showed me we can do a lot with a little as long as we stay disciplined to keep things simple and to the point.
I bought it at the middle/end of 2024, and I paid 3790 NOK (~357 USD at the time).
The lowest price online in my country for the same product new online today is 10233 NOK (~1085 USD)!
270% of what it was before, it’s absolutely bonkers.
I was even considering putting it up for sale a few weeks ago. But of course what I would be able to get for it would be no where near $1000 when selling second hand. Instead I might if I am lucky get slightly more than I originally paid which would be nice and all except that if I then regret selling it it’s still expensive to replace, or I have to also buy it second hand from someone else that may have worn theirs out considerably more compared to what I have done to the one I currently have. Mine is very well taken care of since the start, and although it’s nearing capacity now I haven’t written and deleted data over and over on it. So there has been very little wear on the flash.
Been doing that for myself for the past 15 years
Advances in hardware are only impressive and useful for me when I avoid the so-called "tech" company "engineer" BS
The reason I stop using old computers is never due to software. It's always outdated proprietary cables, failing power adapters, screens, hinges, and so on
Sometimes "minimalism" is simply for _speed, resource usage control and/or reliability_ (that's what I get from small software, anyway) in contrast with prevailing marketed garbage that is bloated and sluggish by commparison
Other times, claims of "minimalism" might be trying to capitalise on some silly trend
Personally I like what the computers I own can do for me and learning to make them do more. I have a brain, I don't do much "guessing" and I don't really need "inference" on a daily basis, certainly not for such a high cost
I have all the "convenience" I can handle
Many games that come out still, and are quite successful, do not require such technologies.
1. Indy developer releases a game or trailer of a game. 2. Within an extremely short time (days to weeks at most) there are clones on the market. 3. These games often outperform the original.
It's absolutely not something that's gone on for ages.
It might be a novel gameplay idea / twist on a genre, and mere days after launch instead of being able to stand on its own and gather attention it's drowning in a pool of lookalikes. It's no longer distinct.
The speed of being able to slop together something like this is less than 1% of what it used to be.
So it's easier than ever to make a game, but it's more difficult than ever to get anyone to try what you've made. I'd say that's just as bad, and in some ways worse, than having your game cloned.
For someone looking to play a new game it will be difficult to sort through all the bad games to find the good ones. And for anyone pouring their soul into a game they will more likely than not have an audience of one.
Our eventual destination is probably going to be a) pick up a device, b) ask your bot to make up a game on the spot, c) play. It sounds so lonely and depressing.
So yes maybe it happens more often now, but it’s still not new.
Yes, that's literally the point of the people you're responding to. Has HN lost reading comprehension, or are you arguing in bad faith?
It used to happen occasionally. Now it happens instantly. That delta is the problem.
5 years ago it would have been science fiction
I don't even understand your analogy. I'm not watching the youtube video or reading the book. The model is. And a big computer can watch 20 youtube videos faster than a small computer can watch 1, and do a far better job understanding all of them (bigger model at data center scale is both smarter and faster than smaller model at local scale).
Are you trying to one shot create the Linux kernel?
If I started today and played 10 games I can emulate every single day for the rest of my life restricting myself to purely emulation, I wouldn't run out of new games for...five and a half years. (assuming my rough calculation of ~20k available games).
Drop it to a game a day and I will likely never run out of games given my life expectancy.
Consider that I will find some games I like to play for more than a day and there are easily well more than enough games in emulation alone to entertain me for the rest of my life on existing entry level hardware.
Will I ever play MODERN SHOOTER {CURRENT YEAR} on this device? Certainly not, but I can't see a reason to bemoan lack of access to such a small portion of the available industry.
Like, suppose you're a reader. You might be right that you might enjoy your favorites in their original languages, but you'd be silly to be worried about your future ability to enjoy books just because you'll likely never get to experience reading 三体 as a chinese citizen fluent in the language.
I have to think, it can’t take much time before the Chinese DUV fabs come online and non-frontier chip prices crater. Sure, you might not be able to get 5090 equivalents, but the 30xx series was DUV and so that should be replicable in a few years.
Whatever quality bar / process node China gets to you know they will scale it out super hard.
(Some quick investigation suggests that the Yuliangsheng DUV machines currently under construction are 28nm, which would map to 2014’s GTX 900. Perhaps I’m being overly bullish but I assume they will recapitulate/clone the tech faster than the rate it was originally discovered.)
Also, this reminds me so much of the download more RAM ads back in the day.
I wonder what it would look like if Apple offered a slimmed down shell from the Neo for ~$300 that required a connected iPhone. Maybe as iOS and MacOS converge we'll get there.
gaming does not equate to only things like the last of us or cyberpunk which need extreme machines. a lot of visual fidelity can be reached still without having such a monster. Just need to not use certain features which are currently pretty much exclusive to Nvidia...
And I assume they will only continue to go up. When it came out, purchasing one seemed like an easy decision. But I paid half as much for one with the same CPU/RAM (and upgraded my SSD for cheap).
There should be a big enough back catalog of great games for you to enjoy without having to buy a new gaming rig.
You might say that this is impossible but look at current trends. A lot of information today is getting shared in the walled gardens of Internet. You have to login to social media to view posts. The Twitter, Reddit threads that were accessible freely now require you to log in. Similar thing is happening across other networks. People are no longer asking questions on Stackoverflow. All those queries are gonig to AI. If someone chooses to not use AI, their options will be limited in future.
Not even talking dictatorship scenarios here. The USA might simply decide it doesn't like your country. Or maybe heavily cripple the models you can use, or censor them, for whatever reason.
I guess this is an argument for local AI. Probably not feasible for the less technically savvy.
So it’s plausible they’ll block me from accessing Mistral since they host DeepSeek models.
- Large centralized compute is more powerful than portable compute
- Wired is better than wireless
- The public wants new things
- The tech industry grows to use/“use” the available processing power
As long as you’re not continuously comparing to AI in large centralized compute, what you’re really looking for is “when does portable compute become powerful enough to run AI models that are capable of meaningful work” and I’d say we’re already there and it’s getting better.
- local latency is lower than network latency
- latency is important for action games
But then it became normal.
The monopolization of knowledge and expertise is the next step. I don't mean as if it were intended, but it is the logical progress given the technological evolution. The cause is inventive structures: the tech is neutral (in my opinion), but the way in which it is used and deployed is subject to and disciplined by capital.
The AI boom first reversed the trend, to now try to get back to that cycle.
I guess it's because I used to work in a writing-based profession and mostly know academics.
Lot of people using their office-notebooks at home, even if its not allowed. Most people out of tech do not have big hardware at home anymore.
This is complete conjecture on my part, but I bet if you're late 20s - early 40s, you probably have some form of pc/laptop laying around. But people 50+ (gen x / gen boomer), a phone is likely all you use or own. My mother, aunt, et. al operate totally through their phones. The same is true for my pre-teen, teenage cousins or cousins children (ipad generation).
But yes, it has been a test of just how few tokens you can get by on.
New application of computing requires a lot of compute -> compute centralizes -> compute improves, smaller, faster, cheaper -> compute decentralizes -> new application of compute is found -> (return to beginning of cycle)
Maybe arcade games?
To be clear, I am not skeptical that it will work this way - I think it's pretty likely llm usage will be come a split of de-centralized and centralized. But I am not very convinced this is a natural law of technology.
But, the “good enough for most lay people” intelligence bar will for sure miniaturize, especially as inference ASICs get more specialized.
But yes, we both agree that what was the frontier many years ago will fit on your desktop.
:insert Will Smith presenting meme:
The Cloud
Which would not be all too bad. It would also mean the end of stupid SaaS subscription services, and mass surveillance, adtech. And shitty propaganda.
And your local AI could emulate the good parts of the internet.
Like talking to people?
In fact, it was closer to the opposite.
I am using AI now to make a game engine that will run and make 'nice enough' graphics on simpler machines. things like laptops with iGPU and 4gb of ram.
U can still get quite ok graphics, and make very complex and rich gameplay systems using such a machine. It just needs to be the target machine while developing so the right tradeoffs are made.
Everybody will have a mini PC for the sole purpose of streaming content, with no storage to keep anything on it.
And why would the game industry, considered as a whole, want to incur higher costs to exclusively deliver its product in a way that provides less value to the majority of its customers, many who won’t be willing to pay the higher prices required to maintain similar profits?
Recompilation at most threatens platform exclusivity as a business model. Otherwise, it’s just piracy with extra steps.
At most, I expect to see already existing trends towards more live service components and microtransactions continue, with digital delivery only and a required online component in many cases, but with most if not all of the actual game code and assets hosted and running locally.
As for non-gaming applications, content creation and a software development are two examples where "cloud native" workflows remain cost-ineffective in many market segments in spite of hardware price increases, and will remain so as long as cloud providers continue to nickel-and-dime customers for IOPS and compute.
It's just unfortunate that producing a half decent computing platform is significantly more difficult than a rifle (and that in the case of said hardliners, the capital is backing them, here it's working against us).
Have an agentic enough setup and they'll do anything that the biggest closed models can. They'll also do more, making them the true frontier.
A sensible point of entry is a 2899$ Mac mini.
If you're not partaking that's only on you.
> If you're not partaking that's only on you.
There's honestly nothing sensible about that for a lot of developer budgets across the globe. Don't assume most folks have $3k to burn.
They absolutely can't do what, or more of what the biggest models can do. There's nothing frontier about small local Qwen or Gemma models.
2899$ gets you a machine that is just good enough to run some small models, slowly, with terrible context, requires a ton of tinkering and fine tuning, managing and constantly downloading a bunch of huge file blobs, etc.
Partaking those $2899 in most of the large cloud models would bring you much more productivity, much less boilerplate and time spent in setup, etc.
So.. just weird accusing people here of "not partaking" in AI when you're just essentially toying around if you're actually comparing local Qwen and Gemma's with frontier models.
Not everyone subscribes to the "cloud compute is more important than everything else" outlook, but everyone is affected by it nonetheless.
Given that he was in a fluffy interview at the time, he's not going to say that OpenAI and Anthropic would die, but we all know that -unless the "Pacing The Frontier" garbage succeeds in its goal of creating law and regulations that massively obstruct LLM manufacturers who aren't the four or five currently-largest ones in the US- that's how it'd turn out. Once OpenAI and Anthropic are dead, the VC money pouring into the LLM manufacturing and services industries evaporates, and all that demand for high-speed VRAM vanishes with it.
So, no, switching to locally-hosted software will reduce RAM prices... just not immediately.
isn't communal living the most efficient thing resource-wise though?
It's like a highrise developer saying "people think our buildings take up a lot of land, but actually houses are much worse from a land use perspective". Which is objectively true, and yet does not mean the developer thinks the entire world should be turned into houses, or even that they dislike houses!
But saying people shouldn’t want something that was abundant and you made scarce is an asshole thing to say.
$15 of serotonin is better than this stuff: https://www.amazon.com/stuff-under-15-dollars/s?k=stuff+unde...
Ok.
Also, a lot of things are true but what truths you choose to broadcast can tell us what you care about. E.g it's also true that we'd all be richer if sam altman shared is wealth with us, lets take a few seconds to think why he's not saying this truth, after all it's an objectively true fact.
I would be shocked if it did anything at all.
I don’t think it’s very productive to go on a witch hunt on someone who said something stupid and is being taken out of context (albeit he should have known not to say that).
Apparently the last three times this cycle happened, the manufacturers that built out capacity went bankrupt when it popped, and the ones that didn't didn't, so they're actually being wise.
Absence of evidence is not evidence of absence.
If an event happens, and multiple previous times that event happened a cause was identified. It is reasonable to suspect the same cause was responsible this time.
It does not give proof, but it does give reasonable suspicion.
hopefully china does it and hynix burns in hell
where is the proof?
>and are now not scaling up production according to demand.
fabs are being built by maaany companies, but it takes years
https://en.wikipedia.org/wiki/DRAM_industry_price_fixing
To date, five manufacturers have pleaded guilty to their involvement in an international price-fixing conspiracy between July 1, 1998, and June 15, 2002, including Hynix, Infineon, Micron Technology, Samsung, and Elpida.[3]
re "what proof means": Im not your house boy. Go get it yourself.
proof ... the thing a narcissist demands from you, but will never acknowledge having received.
its a good lever when it works.
Simple as that.
If I said all donuts are spaceships, readers are not obligated to go and google it.
You're free to doubt it, it's not absolutely certain, but pretending the chance is near zero is just not even remotely as rational as you seem to think.
Theres never any "proof."
Theres no "proof" on the internet.
All we ever have is "evidence," and varying degrees of trust or mistrust in it.
Reality ... always good for downvotes.
US DOJ link: https://www.justice.gov/archive/opa/pr/2005/April/05_at_207....
This is remarkably different than someone claiming donuts are spaceships when the company itself was charged and pleaded guilty, and it's a matter of public record.
just asked about some kind of proof when world is full of conspiracy theories, nothing wrong with that, so stop being aggressive and snarky
and i knew about stuff from 2000, but thought there was something recent
Would you though? If/when the AI bubble pops and the buildout of data centres either stops or plateaus then they'd suddenly be sitting in a vastly oversaturated market and struggle to make it to the end of the year.
New fabs will be operational in a while, which is too big of a risk to take in these times.
Considering the profits they've made this year, on average they still wouldn't do too bad. SK Hynix employees got almost $500k for example, I can live on that for a few years. Companies are often also legally required to compete with each other.
But they are scaling up the production, they just conveniently did it a bit late. I also fear if/when the bubble pops, they'll quickly reduce the production to ensure prices stay high. I fear Nvidia could do the same. I think it'll be hard for all of them to go back to a world where they're paid way less per component, so instead of accepting that, they can reduce the supply and keep the prices high. Only antitrust regulators could intervene to stop that.
Many people expect prices to go down after the bubble pops, but it may not happen as much as we would want to.
All that bubble popping will do is wipe out some investor's money. Everything else will stay and become more and more important.
But of course, it is more profitable to sell one item for $1000 than it is to sell ten items for $100 each. And even if a competitor shows up, you can just price dump with all the extra money you already made until that competitor goes away.
1) boom and bust cycle in memory industry is a repeated problem
2) companies are not obligated to scale up
> and is being taken out of context
no it is not - Altman is lying by omission[0] by implicating that various important costs are not real
[0] https://news.ycombinator.com/item?id=50400515 for longer comment on that
Good god the internet is so sensitive nowadays
[0] https://news.ycombinator.com/item?id=50400515 for longer comment on that
And "if all current AI users" is a strawman, people using free chatgpt once or twice a day are not going to buy RAM to run own LLMs.
Ah yes Sam Altman is not a real villain despite OpenAI locking up 40% of global DRAM supply.
If a customer ask me to get all my butchery stock for a year, it will make thousands of client unhappy and will make one client happy, so I'll simply refuse.
This is not how business is supposed to be, the world is not supposed to be a B2B chaos.
I know how the business is done "supply demand" bla bla. That does not make it ethical one bit.
If you look outside the tech bro / stock bro / tech worker circles and into the mass left wing populace everyone HATES ai and ai data centers... the Altmans, the Amodeis, the Huangs, they are not the devil himself levels just yet (cough, Musk, cough), but they are climbing up there.
People's jobs being taken (and especially entry/junior jobs, you know, the ones young people, who voted massively blue, need to get started in life), data centers increasing their electric bills or polluting the air with gigawatt level gas turbines (or both), consumer electronics prices rocketing up (~400% increases YoY in RAM and SSD prices) just so the corporate capitalist class can hoard millions of gpus in warehouses.
I mean, if the democrat politicians getting into power keep their promises and step on AI buildout's neck, it could be lights out for the AI bros.
ChatGPT is one of the most used websites in the world. Compared to e.g. Facebook you are not "forced" to use it (because of friends or whatnot) so it's all voluntary usage. There is real demand for AI usage, that's why RAM and GPU prices are skyrocketing, not because of some evil conspiracy.
I don't see this, no. I think HN serves as a sort of Rorschach test for the reader. I get a center-libertarian vibe from HN, definitely not left wing. That's probably my own biased perception, of course.
I also think while there's a ton of AI articles, there are also very vocal people against it. The sentiment is not universally "AI booster" here, it's a mix.
Obligatory: "we're curing cancer r-right?" No Nat we're making slop videos with it.
If the USA were a real democracy they would do something about it. After all this even violates capitalism, e. g. free market leading to reduced prices. But the USA is run by a criminal gang, pocketing away money - the TechBros and their cronies. They just make any legislation they want to, with a bit sugar coating on top to not appear too overly evil or greedy. But they are.
Let's say there are 10 companies that need 1 GB of RAM each in a life-or-death scenario. They would be willing to pay $100,000,000 per GB to get 1 GB of RAM.
At the same time, there are 90 more companies that need 1 GB of RAM each to make certain quarterly targets. They are willing to pay $10,000 per GB to get 1 GB of RAM.
If you make 9 GB of RAM, you can sell it for $900,000,000. If you make 99 GB of RAM, you can only sell it for $990,000, because the 10 life-or-death companies only need to bid high enough to push out a quarterly-target company.
It's a bit of a contrived example, but it shows you how restricting supply can boost total revenue if there is a segment of the market that has inelastic demand. (this is why medicine pricing has to be regulated - in the medical industry, there are lots of inelastic demand scenarios that can lead to predatory pricing)
Also, it is not likely to happen any time soon.
We have less rich gamers deciding to not upgrade their PCs at most.
Evidence: a friend of mine this month decided that he can't justify dropping $1.6k on a gaming computer.
As a PC gamer since I have memory, this whole situation makes me sad.
Truly an unimaginable and ludicrous suggestion in a time where regulators are less likely than ever to pursue it.
https://en.wikipedia.org/wiki/DRAM_industry_price_fixing#200...
But isn't mister Altman correct in a sense? Why the hell would people need 16 gigabytes of RAM or more to make spreadsheets and type documents? Receive and send e-mail, make travel bookings, listen to music and read the news. Maybe make posts on social media, or publish on your own website.
Have we forgotten that all of this functioned very well when RAM wasn't even in the gigabytes? And that most of this functioned very well when RAM wasn't even in the megabytes? I remember this time, and certainly must many of you. Of course it is more comfortable today with more powerful machines
There must come a moment when we judge a machine or a system by the results they produce, by the fruits of the tree so to say. And those fruits haven't changed or improved noticeably in decades. There is one big improvement that undeniably requires more memory from the computer that I can think of, which is the much higher resolution of displays of today. Probably there are some more.
Specialized use is of course different, whether that's compiling code, rendering photogrammetry scenes, or playing graphics intensive games.
Everything you listed worked for decades with a lot less RAM, but was also more limited and potentially different in substance in critical ways. It's the "Mom I want X ! -> We already have X at home" meme, where the "X at home" is some poor version of what was requested.
I understand some people could still enjoy a retro style experience, but I wouldn't give up on my HDPI displays for instance. Or touch support. Or keeping 40 tabs open instead of hand managing my tabs or rely on some dumb auto-close algo.
Spreadsheets can now have dozens of thousands of line and still be snappy to manipulate, we can play high def videos while doing actual work without freezing the whole system. Photoshop and Lightroom used to be crash junkies for even basic operations and people would baby the settings to aleviate that; with the RAM we have now it has become a somewhat decent situation (still crashes, just way less)
I still have 10~20 years old machines around and boot them occasionally, there's just no way I'd get back to them full time and try to do the same volume of work as I'm doing now.
PS: there's also the "people only do email and browsing, perhaps some Word or Excel" fallacy. Nowadays phones will be enough for most of that, and people will mostly avoid doing them if it requires opening a computer. That's where we have so many budget management apps for instance.
So, computer are a lot more niche than before, and the requirement also go higher. People on computer are either power users or doing somewhat intensive things.
40 tabs open at once? That doesn't need a lot of RAM if websites were programmed to do what they actually do: Display text and images.
I don't think touch needs any special amount of RAM, would it differ for the operating system than a mouse?
Photoshop and Lightroom <- These I think fall into the category of special use cases for professionals, which absolutely need more RAM than a home user. For somebody who only occasionally wants or needs to do a bit of advanced photo editing, it's okay to wait a bit longer for operations.
> I still have 10~20 years old machines around and boot them occasionally, there's just no way I'd get back to them full time and try to do the same volume of work as I'm doing now.
Are you sure about that? If you actually sat down to only work, without having YouTube videos open or other things going on in the background? If you close your Amazon Black Friday tab you already liberate 500 megabytes of RAM.
> PS: there's also the "people only do email and browsing, perhaps some Word or Excel" fallacy.
No, in this case it is you who didn't understand or didn't want to understand. Nowhere did I say only. But the things I listed are what normal people do mostly. And nobody would want to type a long report or do spreadsheets on their phone.
> So, computer are a lot more niche than before, and the requirement also go higher. People on computer are either power users or doing somewhat intensive things.
Not at all. Most computers are used by office workers at their job, and I'd bet that most home computers are also used for non-intensive purposes. But I think you're right in what direction things are moving.
Technology should be allowed to evolve as needed. Smartphones were also supposed to be phones, and I'm sure I'm not the only to basically ignore the phone app unless forced to.
I'm totally fine with progressive web apps for instance, or how Figma is pushing the boundaries to bypass the whole native Store requirements.
> Lightroom
Photography is a mildly popular hobby. Even as phones are king, around 10 million dedicated cameras were sold last year [0], so having Lightroom as a home user isn't as exotic as you make it sound like.
The issue is not really the wait time, it's the instability and crashes, which are aliviated by less back and forth between the disc and the RAM. It's totally Adobe's fault, but I also think it wasn't a simple problem to begin with.
> only work, without having YouTube videos
I need YouTube and I suspect many do. Currently all of last year's WWDC sessions are on Youtube, as do most video tutorials, business presentations etc. Also work BGMs, podcasts, live streams etc. are resources people also use to keep focus or stay awake through their working day.
People used to listen to their own sound on dedicated devices, IMHO it mostly moved to their computers, especially as bluetooth gives more flexibility to move around.
> office workers at their job
I'd wager most of these workers job involves more than what you're giving them credit for. I've followed CS agents dealing with user requests for instance, one of the lowest job level in our org, and that involved a lot of multitasking, juggling with the ticketing system, and keeping stuff at hand. In particular the agent I was shadowing had a discord call going on about a third of the time, with me in a Meet session. Sure, 20 years ago we would have done it a different way. But nowadays that's just how they're doing it.
Traditional data entry jobs might be different, but how many of them still exist as of now ?
[0] https://www.dpreview.com/articles/2386206926/cipa-data-2025-...
Strongly recommend you get Gemma 4 12B QAT on a computer that can run it, and then disconnect the internet and see what it can still do. Even the smaller E4B will show you.
Local AI is the first thing in decades (since editing video, perhaps) that meaningfully changes what a disconnected machine is capable of.
Altman made things I could buy at a reasonable price unaffordable.
being correct doesn't mean your reasoning isn't crooked. His implication is "You don't need it, but I do!"
It's a monopoly saying they do not have enough resources. It's the big man saying he needs more food.
that could've been crummy for someone; you should warn that your cute little complaint actually eats ram; half is clearly fiction but the OOM isn't.
Do you also click on the links of the Nigerian princes?
On a less sarcastic note, I wonder if a community based compute donation could actually help offset knowledge and compute centralisation.
Incentive is difficult but anti-AI sentiment is still as strong as ever. Maybe an A-v-A (in the spirit of H-v-H) campaign might pull in some.
also, spare LLM credits from donations for use by community groups
"From a global allocation perspective, actually, it's quite terrible to [let billionaires] have a bunch of the world's limited supply of [money] sitting in their own [stocks] and being used 5% of the time. You want maximum [taxes] if you're trying to deal with this very supply-constrained environment. And somehow many people's intuition is the opposite of that."
Plus it's far more efficient to buy tons of gpu's for the shelves rather than actually use them.
Just give us back our RAM prices so that everyone can afford 256GB DDR5 and run their models locally!
This solves the datacenter problem and it's impacts, RAMageddon, SSDgeddon, etc..
and they can just sell us the improved models without the hassle of doing the compute themselves..
What's the problem? With the proper ToC's they would still get our data.. ¯\_(ツ)_/¯
And Sam's (correct) point is that that doesn't work. If everyone tried to run the same amount of inference locally with the same size models that they're currently doing, the shortage would be even worse.
Funny WEB Site!
Not me, I have 2 8G DDR4 sticks sitting in a draw that I purchased a few of years ago when they were cheap. I was going to use them to upgrade my W541 to 32G, but I have one of the first models that the max is 16G. So saving them in case I have RAM issues.
If Sam wants them, he can pay me 5000 USD each for them, otherwise I will proudly hang on to them. If I knew his email I would send him a pic of them saying "hahaha" :)
"Iniital commit"
Lol, little cringe "Look guys, how human I am!!"
You people are obnoxious.
> From a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used 5% of the time. You want maximum utilization in the cloud if you’re trying to deal with this very supply-constrained environment.
That's a ghoulish point of view that puts real living humans on a lower hung than the poor poor corporations who just want RAM to be so expensive that everyone needs to buy compute from them. Convenient for the corporations!
He's an easy target because of who he is, so I understand why the entire Internet ran with the fake story (even LTT!). But on Hacker News you'll definitely get pushback if you post misleading stuff.