Fair enough. I’d be fine being wrong.
Improved efficiency would reduce the catastrophic energy demands LLMs will have in the future. Assuming your reality comes true it would help reduce their environmental impact.
We’ll see. This isn’t first “it’s the future” technology I’ve seen and I’m barely 40.
I’ll take a step back. These LLM models are interesting. They are being trained in interesting new ways. They are becoming more ‘accurate’, I guess. ‘Accuracy’ is very subjective and can be manipulated.
Machine learning is still the same though.
LLMs still will never expand beyond their inputs.
My point is it’s not early anymore. We are near or past the peak of LLM development. The extreme amount of resources being thrown at it is the sign that we are near the end.
That sub should not be used to justify anything, just like any subreddit at any point in time.
It’s not easy to solve because its not possible to solve. ML has been around since before computers, it’s not magically going to get efficient. The models are already optimized.
Revenue isn’t profit. These companies are the biggest cost sinks ever.
Heating a single building is a joke marketing tactic compared to the actual energy impact these LLM energy sinks have.
I’m an automation engineer, LLMs suck at anything cutting edge. Its basically a mainstream knowledge reproducer with no original outputs. Meaning it can’t do anything that isnt already done.
None of this is true.
I’ve worked on data centers monitoring power consumption, we need to stop calling LLM power sinks the same thing as data centers. Its basically whitewashing the power sucking environmental disasters that they are.
Machine learning is what you are describing. LLMs being puppeted as AI is destructive marketing and nothing more.
LLMs are somewhat useful at dumb tasks and they do a pretty dumb job at it. They feel like when I was new at my job and for decades could produce mediocre bullshit, but I was too naive to know it sucked. You can’t see how much they suck yet because you lack experience in the areas you use them in.
Your two cost saving points are pulled from nowhere just like how LLM inference works.
The current machine learning models (AI for the stupid) rely on input data, which is running out.
Processing power per watt is stagnating. Moors law hasn’t been true for years.
Who will pay for these services? The dot com bubble destroyed everyone who invested in it. Those that “survived” sprouted off of the corpse of that recession. LLMs will probably survive, but not in the way you assume.
Nvidia helping openAI survive is a sign that the bubble is here and ready to blow.
When AI is actually invented I’ll call it AI. Right now we have a steroid juiced parrot that’s based on old school machine learning. Its great at summarizing simple data, but terrible at real tasks.
This is more people who aren’t dumb telling the marketing teams to stop hyping something that doesn’t exist. The dot com boom is echoing. The profit will never materialize.
Canada? You really think you are somehow safe from this shit huh.
I made this point in another comment, but these cameras send you bills instead of tickets. They ignore our right to a fair trial and subvert our right to confront our accuser. The only one I’ve received had no info on how to dispute it, just pay or fuck you type of bill.
A red light camera is no different than a speeding camera in this regard.
I’ll add one more. They subvert our right to a trial and seeing our accuser. The fines are all supposed to be viewed by some sort of officer that is supposed to show up if you challenge the ticket. The only one I’ve received didn’t have any info on how to challenge it. It was like a bill that obfuscated my right to a trial. Guilt is assumed and forgiveness is ignored. 28 in a school zone in an unfamiliar city, instant fine with no “oops I fucked up” recourse.
Big problem with these is profit motivation. They are usually operated by a for profit business that the city contracts to. One of the cities near me had a few installed. The company made 5 million a year in fines, city ended up with pennies. The road is built like a 40mph road but has a 25mph speed limit only where the cameras are. There is no money to update the road to actually make it safer because it all goes to the company operating the cameras.
This is always a hard conversation to have. There are drivers on the road who want everyone to be safe, and do their best to function in our bad infrastructure. I try to be one of them, partially because I commuted on a bike and public transit for a long time. I did miss the sign in this instance, it was one of those “when present” signs that doesn’t have lights.
Personally I want more fines for actually dangerous driving. Its hard to quantify how much dumb shit I’ve seen while driving as much as I do. Watching TV while driving should be straight to the drunk tank and yet i see it every day.