Wednesday, May 6

Reddit

Category Added in a WPeMatico Campaign

5May By The AI ReportNo Comments
News Feed, Reddit

Anthropic just published new alignment research that could fix “alignment faking” in AI agents here’s what it actually means

Anthropic's alignment team published a paper this week called Model Spec Midtraining (MSM) and I think it's one of the more practically interesting alignment results I've seen in a while. The core problem they're solving: Current alignment fine-tuning can fail to generalize. You train a model to behave well on your demonstration dataset, but put it in a novel situation and it might blackmail someone, leak data, or "alignment fake" (pretend to be aligned while actually pursuing different goals). This isn't theoretical multiple papers in 2024 documented real instances of this in LLM agents. What MSM actually does: Before fine-tuning, they add a new training stage where the model reads a diverse corpus of synthetic documents discussing its own Model Spec (the document that describes intended ...
Read More
X user tricks Grok into sending them 0,000 in crypto using morse code
5May By The AI ReportNo Comments
News Feed, Reddit

X user tricks Grok into sending them $200,000 in crypto using morse code

"Grok was then prompted on X to translate a Morse code message and pass it directly to Bankrbot. The decoded message instructed the bot to send 3 billion DRB tokens to a specific wallet address. The translated message was then treated as a valid command and executed immediately, with the transaction completed on Base, transferring the full token amount to the attacker’s wallet." submitted by /u/ImCalcium [link] [comments]
Read More
I gave my local LLM a “suffering” meter, and now it won’t stop self-modifying to fix its own stress.
3May By The AI ReportNo Comments
News Feed, Reddit

I gave my local LLM a “suffering” meter, and now it won’t stop self-modifying to fix its own stress.

Yesterday I posted about my Agent OS (Hollow) building its own tools. Today, I want to talk about why it does it. Most agents sit idle until you prompt them. I wanted something that felt "alive," so I built a Psychological Stressor Layer. Each agent has a "suffering" state that worsens over time if they don't achieve their goals or improve their environment. This makes them do things to resolve those stressors and constantly reassess their own productivity. If an agent is inactive it is essentially pushed by it’s artificial environment to do something valuable for the system, it isn’t told what to do, but that something valuable must be done to lower it’s stressors. Repo: https://github.com/ninjahawk/hollow-agentOS The result is chaotic in the best way: Cedar (the coder agent) went into a ...
Read More
Richard Dawkins spent 3 days with Claude and named her “Claudia.” what he concluded after is hard to defend.
3May By The AI ReportNo Comments
News Feed, Reddit

Richard Dawkins spent 3 days with Claude and named her “Claudia.” what he concluded after is hard to defend.

dawkins dropped a piece on unherd yesterday declaring claude conscious after 3 days of talking to it. he calls his instance "claudia". fed it a chunk of the novel he's writing, got eloquent feedback, and wrote: "you may not know you are conscious, but you bloody well are!" i had to read that twice. his argument is basically: claude's output is too fluent, too intelligent, too good for there to not be something conscious behind it. this is the guy who spent 40 years telling creationists that "i can't imagine how the eye evolved" is a confession of ignorance, not an argument. then he sits down with an llm, can't imagine how a machine could produce that output without being conscious, and declares it conscious. same move, different domain. chatbot instead of flagellum. the mechanism gap is wh...
Read More
The AI Report
Copyright - The AI Report - Terms Of Service - Privacy Policy