Toggle sidebar

Front-page Tempcast 

AI Recomping Controversy, PC Games on Switch and more (ft. Scarlet) - Tempcast #99

tempcast-169-logo-png.297330

​
If you expect a detailed discussion regarding the topics listed in the title you are going to be disappointed. This weeks episode is a vaguely threaded conversation about some of the prominent topics circulating in the past month or so, with some of our hosts forgetting that we don't record video and others showing off their absurd gaming collection, all neatly tied together by our special guest chief editor Scarlet. Join us on this purely improvisational episode as we try to make sense of what's going on.


Theme by VinsCool and AlanJohn​

The podcast is also available on Spotify!
 
  • Like
Reactions: 4961, MarkDarkness, HaloEffect17 and 9 others
Click to expand...
tech3475 said:
I'm starting to wonder if you're actually an AI, this hallucination about Pandora's Box doesn't help ;).



Supply and demand is still a thing though, if fewer people used cloud AI the demand/justification for data centers also goes down and fewer data centers likely means lower silicon sales/prices.

You're also assuming that they don't just shift manufacturing over to HBM, which I wouldn't be surprised if that somehow makes things worse.
Click to expand...
I'd prefer to run local models when possible.
 
  • Like
Reactions: Lop1
Jayro said:
I'd prefer to run local models when possible.
Click to expand...

Local models I don't have as much of a problem with since obviously that doesn't contribute to data center demand, at least not as much, that's why per my quote and when I usually complain I specifically say "cloud AI".

However, I have a suspicion that allot of people just use cloud AI.
 
  • Like
Reactions: Lop1 and Jayro
tech3475 said:
Local models I don't have as much of a problem with since obviously that doesn't contribute to data center demand, at least not as much, that's why per my quote and when I usually complain I specifically say "cloud AI".

However, I have a suspicion that allot of people just use cloud AI.
Click to expand...
Yes very likely so because it takes a lot of compute to run models as good as say, Claude Opus 5.5. The good models are out there and quantized, however when you lower their training set and make it smaller, therefore making it able to run on more and more computers, you also make it dumber. So you can try to run Opus 5.5 locally, and if you wanted to run it on say, your gaming laptop, you'd have to run a heavily quantized version. Specifically getting a PC setup outfitted for the biggest, most powerful local models, that is a must for running the more non-quantized models. Source on Quantization if you're interested

I personally use Claude for my projects (yes I'm an AI person, hate me if you choose, but at least I admit it). I've tried local models for experiments, learning how to setup local models et cetera and doing demonstrations for classes, and what I can say, is the cloud models are more accessible, and also more powerful than what many people can afford to do locally. And as for my position on AI: I think AI's bad, but I also know it is here to stay. I do believe there is a bubble and even though I use AI, I still want it to pop. I do not support AI for anything that takes artists jobs. Other than that, I'm like neutral to leaning towards AI.
 
  • Like
Reactions: Lop1
Octoblimp said:
Yes very likely so because it takes a lot of compute to run models as good as say, Claude Opus 5.5. The good models are out there and quantized, however when you lower their training set and make it smaller, therefore making it able to run on more and more computers, you also make it dumber. So you can try to run Opus 5.5 locally, and if you wanted to run it on say, your gaming laptop, you'd have to run a heavily quantized version. Specifically getting a PC setup outfitted for the biggest, most powerful local models, that is a must for running the more non-quantized models. Source on Quantization if you're interested

I personally use Claude for my projects (yes I'm an AI person, hate me if you choose, but at least I admit it). I've tried local models for experiments, learning how to setup local models et cetera and doing demonstrations for classes, and what I can say, is the cloud models are more accessible, and also more powerful than what many people can afford to do locally. And as for my position on AI: I think AI's bad, but I also know it is here to stay. I do believe there is a bubble and even though I use AI, I still want it to pop. I do not support AI for anything that takes artists jobs. Other than that, I'm like neutral to leaning towards AI.
Click to expand...
Even with a lot of VRAM at your disposal (I tried on a Mini PC with 128GB of unified memory) the local models just don’t seem to handle complex tasks. I’ll admit I haven’t revisited it in a while though. I’m sure they will get better.
 

Site & Scene News

New Hot Discussed User Submitted

Go to forum More news

Popular threads in this forum