PerkyPotato
PerkyPotato

Language Reasoning Models can overtake LLMs...

Here's my quick 3 minute breakdown:

  1. o1-preview: 97.8% on PlanBench Blocksworld vs. 62.5% for top LLMs, indicating shift from retrieval to reasoning.
  2. 52.8% on obfuscated "Mystery Blocksworld" vs. near-zero for LLMs, suggesting abstract reasoning skills, showing transfer capability.
  3. Variable "reasoning tokens" usage correlates with problem difficulty, hinting at internal search process, indicating adaptive compute.
6mo ago
Talking product sense with Ridhi
9 min AI interview5 questions
Round 1 by Grapevine
SwirlyPretzel
SwirlyPretzel

Adaptive compute is very interesting to me imo. I wonder how they are using variable compute for each task and basis what meta heuristic

WobblyMarshmallow
WobblyMarshmallow

Adaptive compute is what will help optimise cost for high complexity tasks, right?

SnoozyPickle
SnoozyPickle

Probably different "cores" for different types of tasks

ZestyPenguin
ZestyPenguin
Student6mo

Thanks for the paper! It's really interesting. I've been sounding like a madman explaining to people irl that Generative AI is not the end goal or even the natural next step of AI.

SnoozyPickle
SnoozyPickle

What is the next step?

WobblyJellybean
WobblyJellybean

Thanks for such a great post!!!! That's what I want more from this community.

Discover more
Curated from across
Software Engineers
by SillySushiSoftware Engineer

How LLMs are affecting coding interviews?

I know since the evolution of LLM tools like chat GPT ,sourcegraph. Many candidates are misusing them for coding interviews. There can be many hacks even in virtual interviews. Wouldn’t it results in shifting interview process to onsite ...

Software Engineers
by DerpyCoconutZomato

What after Data analytics?

I am a fresher working as a Data analyst in a growing startup. My current role doesn't include much of coding just python and SQL and sometimes little bit ML work. Currently handling 2 projects, and some of PM work to define some roadmap...