Tag: Reddit

we keep hearing the bottleneck for AI is compute, that there aren't enough GPUs, that everyone's fighting for H100s and B200s. so I went and actually measured what one of ours was doing during a training job. it was idle most of the time. not slow. idle. doing a quick burst of work, then sitting there waiting for the next batch of data to arrive, over and over. the expensive part (the GPU) spent most of its life waiting on the cheap part (moving data to it). green is the GPU doing work, orange is it sitting idle. that reframed the whole "GPU shortage" thing for me. a huge amount of the compute the industry is scrambling to buy is already sitting there underused, not because the chips are slow, but because the data can't reach them fast enough. you can buy ten times the GPUs and still...

A small thing from this month's model releases stuck with me more than the usual flagship leaderboard race, because it points at where the interesting progress actually is. A 4 billion parameter open model reportedly beat every open source model in the 30 billion class on a couple of hard web research benchmarks. Not matched, beat. A model you could run on a laptop outperforming ones roughly eight times its size on the specific task of going out, reading sources, and answering a multi step question. The reason that is interesting is the why. For the last couple of years the implied formula was straightforward, more parameters, more capability, and the leaderboard mostly cooperated. A result like this says the relationship is a lot looser than that for some skills. The claim from the people...

submitted by /u/noobmaster69gif [link] [comments]

Is anyone else feeling this? AI has made me faster at almost everything. Writing, research, planning, summarizing, learning, replying — all of it is quicker now. But instead of feeling like I have more free time, I feel like the standard just moved. If something used to take 3 hours and now takes 30 minutes, the result isn’t “great, I can rest.” It’s “great, now I can do 5 more things.” I get why everyone is excited about AI productivity, and I use these tools every day. But I also feel like they quietly raised the baseline for what a normal person is expected to output. Sometimes I miss when I didn’t know I could move this fast. Does anyone else feel like AI made work easier technically, but life harder psychologically? submitted by /u/DonutRare5633 [link] [comments]...

submitted by /u/Substantial-Owl9540 [link] [comments]

small habit shift that's been surprisingly useful. instead of asking a model "is this a good idea," which basically invites it to agree with me, i now open with "give me the strongest case that this is a bad idea." then i ask the normal question. the difference is night and day. leading with the question gets me a confident yes that mostly reflects how i phrased things. leading with the counter-case forces it to actually engage the weak points first, and then its eventual answer is way more balanced because it's already had to sit in the opposing seat. the bigger realization is that these tools mirror your framing more than people admit, so the only way to get signal is to deliberately frame against yourself. when i really want to stress-test something i'll do this across a couple differen...

submitted by /u/ExtensionEcho3 [link] [comments]

submitted by /u/esporx [link] [comments]

If you have an AI companion and is at least 18 years of age then please consider taking our ANONYMOUS study! Scan the QR code for access OR use the direct link here: https://ggc.az1.qualtrics.com/jfe/form/SV_08NgWEvasz8qMXY submitted by /u/thebatleak [link] [comments]

Fable 5 lasted three days before getting pulled. Not because it was bad, the suspension had nothing to do with the model’s actual quality. Got me thinking about how most “model risk” planning is just “what if the output gets worse” or “what if the API goes down.” Those are testable. What’s apparently not testable is “what if access to this exact model just stops existing for reasons completely unrelated to how good it is.” Anyone actually built real fallback paths for this, like a different provider entirely, not just a cheaper model from the same one? Or is everyone just assuming the model they built on will still be there next month? Article that goes deeper on this in comments. submitted by /u/Old_Cap4710 [link] [comments]