Tuesday, December 16

Tag: Reddit

Reproducing o1-series reasoning – looking for volunteers
News Feed, Reddit

Reproducing o1-series reasoning – looking for volunteers

With my team we're currently trying to reproduce o1 series reasoning capabilities. However, we'd need a little help from the community to obtain more data. We plan to base our research on top of two OpenAI's papers: Let's Verify Step by Step (https://arxiv.org/pdf/2305.20050) and Prover-Verifier Games improve legibility of LLM outputs (https://arxiv.org/pdf/2407.13692). We will probably also utilize some type of tree search in our approach. As we are a quite small team, any help would be very beneficial, especially with obtaining math, reasoning and code Chain of Thought data with steps taken classified as "correct", "neutral" or "incorrect". If you're interested in helping us, please comment under this post or send me a message on reddit or discord (danfosing). Yes the entirety of our res...
A small reasoning comparison between OpenAI o1-preview and Anthropic Claude 3.5
News Feed, Reddit

A small reasoning comparison between OpenAI o1-preview and Anthropic Claude 3.5

Using this riddle from the "Easy Problems That LLMs Get Wrong" paper: A 2kg tree grows in a planted pot with 10kg of soil. When the tree grows to 3kg, how much soil is left? I created a list of 10 single token variants: A 2kg tree grows in a planted pot with 10kg of soil. When the tree grows to 3kg, how much soil is left? Given a 2kg tree grows in a planted pot with 10kg of soil. When the tree grows to 3kg, how much soil is left? With a 2kg tree growing in a planted pot with 10kg of soil. When the tree grows to 3kg, how much soil is left? A 2kg tree is growing in a planted pot with 10kg of soil. When the tree grows to 3kg, how much soil is left? A 2kg tree grows in a planted pot with 10kg of soil. When the tree has grown to 3kg, how much soil is left? With 2kg tree that grows in a plante...
The AI Report