Archive - AI: A Guide for Thinking Humans

The LLM Reasoning Debate Heats Up

Three recent papers examine the robustness of reasoning and problem-solving in large language models

Oct 21 •

Melanie Mitchell

September 2024

Podcast on "The Nature of Intelligence"

I never thought I would be a podcast host, but…Abha Eli Phoboo, the director of communications at the Santa Fe Institute, recently relaunched SFI’s…

Sep 21 •

Melanie Mitchell

August 2024

May 2024

Stress-Testing Large Language Models’ Analogical Reasoning Abilities

May 21 •

Melanie Mitchell

Evaluating Large Language Models Using “Counterfactual Tasks”

“[O]ne thing is clear: LLMs are not human.

May 13 •

Melanie Mitchell

"AI now beats humans at basic tasks": Really?

Two weeks ago, Nature, one of the world’s most prestigious journals, had this jarring headline:

May 2 •

Melanie Mitchell

January 2024

An “AI Breakthrough” on Systematic Generalization in Language?

A Fun Puzzle Here’s a fun puzzle for you. I’ll give you six words in an alien language: saa, guu, ree, fii, hoo, and muo. Figure 1 gives a diagram…

Jan 7 •

Melanie Mitchell

September 2023

Can Large Language Models Reason?

What should we believe about the reasoning abilities of today’s large language models? As the headlines above illustrate, there’s a debate raging over…

Sep 10, 2023 •

Melanie Mitchell

June 2023

Did GPT-4 Hire And Then Lie To a Task Rabbit Worker to Solve a CAPTCHA?

A Little Fact Checking Is In Order

Jun 12, 2023 •

Melanie Mitchell

May 2023

On Evaluating Understanding and Generalization in the ARC Domain

In a previous post I wrote about the Abstraction and Reasoning Corpus (ARC), an idealized domain created by François Chollet for evaluating abstraction…

May 15, 2023 •

Melanie Mitchell

April 2023

Do half of AI researchers believe that there's a 10% chance AI will kill us all?

Fact-checking a widespread claim

Apr 23, 2023 •

Melanie Mitchell

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts