简体中文
EnglishWhat Topics Are Covered in Import AI Issue 476?
Updated
Import AI issue 476, dated October 12, 2026 and written by Jack Clark, leads with a new benchmark on intuitive visual reasoning and also touches on creativity and recursive self-improvement (RSI), open weight models, and AI in space. The issue is aimed at readers who follow AI research and want a concise digest of recent papers and results; the newsletter describes itself as running "on arXiv, cappuccinos, and feedback from readers" and invites readers to subscribe.
The main item: Humanity's Sixth Sense benchmark
The centerpiece is Humanity's Sixth Sense (HSS), a benchmark built by AI startups Elorian and Scale AI. It "measures how a model interprets and reasons through information a visual scene implies but doesn't explicitly show" — that is, intuitive visual reasoning rather than explicit recognition.
What's in it: 522 questions covering 288 images and 234 short video clips (17.6 hours of video total). Questions fall into four categories:
| Category | What it probes |
|---|---|
| Temporal & causal dynamics | "What happened before the scene, and what happens next." |
| Physical & spatial logic | "What fits, what's in reach, and what someone else can see from where they are standing." |
| Social understanding | "Intent, attention, belonging." |
| Abstract & contextual inference | "The patterns and rules a scene implies." |
Example tasks include looking at a bookcase and judging whether it can fit more books, or a photo of horses pulling a plough and judging whether the chains bear the plough's drag weight.
How humans and models score
The human baseline is high but not perfect: people score an aggregate pass@1 of 93.1, broken down as image 94.1, video 91.9, time 97, and space 94.9.
The best AI system, GPT 6 Astra, reaches pass@1 of 53.6 (image 55.6, video 51.1, time 58.2, space 53.6). Chinese open weight models do notably worse: GLM-5.3-flash at 26.8 and Kimi K3 at 25.5.
The two most common single mistakes, per the benchmark authors, were missing a detail that decides the answer (21% of failures) and misidentifying an object, person, or role (20%).
Why the issue says it matters
Clark frames HSS less as a list of deficiencies and more as evidence of how adept frontier LLMs already are at tasks many assumed would need different, specialized AI systems. The open question the benchmark speaks to: whether world models are emergent in today's frontier models, given that true visual reasoning was long expected to require spatially aware 2D systems.
Other items in the issue
The issue's title also flags creativity and RSI, worse-than-China open weight models, and AI goes to space. The available excerpt details only the HSS benchmark, so treat the remaining items as listed topics rather than summarized findings.
Who should read it
Issue 476 suits readers tracking benchmark design, multimodal reasoning, and the open weight model landscape. If you want the full text and future issues, the newsletter points to its Substack subscription page; the excerpt does not state pricing or access terms, so check the subscribe page for those details.