跳到正文
Lenny Rachitsky· Claire Vo·· 9 小时前AI 评分54

Claire Vo 用九项真实任务横评 Grok Bot、Dot、Muse 与 Claude Duet

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

正文 · 原文

I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbnail, inbox triage, a family newspaper, physics homework for a fourth grader, shoe shopping, and a ChatPRD launch video. I used computer use to operate them: Claude ran Dot, Codex ran the rest and scored the results live. Here’s the scoreboard—and which agent I’d actually trust for work vs. life.

Listen or watch on YouTube, Spotify, or Apple Podcasts

Brought to you by:

WorkOS—Make your app enterprise-ready, with SSO, SCIM, RBAC, and more

Firecrawl—Give your AI agents web data and beyond

In this episode, we cover:

(00:00) Introduction

(02:13) The personal-agent benchmark setup

(05:00) The nine tasks and the prompts I used

(07:20) Scoreboard overview

(10:06) Task 1: Draft a Slack reply as me

(11:39) Task 2: Cut a short-form video from raw Dropbox footage

(14:56) Task 3: Fix a bug from Sentry

(17:30) Task 4: Build a How I AI thumbnail in Figma

(19:25) Task 5: Triage my inbox for to-dos

(21:06) Task 6: Build a family newspaper

(23:30) Task 7: Explain a physics homework question to a fourth grader

(24:54) Task 8: Shop for shoes

(26:46) Task 9: Make a ChatPRD Product Intelligence launch video

(30:01) Final scores

(32:38) My takeaways

Tools referenced:

• Grok Bot: https://x.ai/bot

• Dot: https://chatgpt.com/features/dots/

• Meta Muse: https://ai.meta.com/muse/

• Claude Duet: https://claude.com/product/claude-duet

• Codex: https://openai.com/codex

• ElevenLabs: https://elevenlabs.io/

• Figma: https://www.figma.com/

• Sentry: https://sentry.io/

• Linear: https://linear.app/

• Dropbox: https://www.dropbox.com/

Where to find Claire Vo:

ChatPRD: https://www.chatprd.ai/

Website: https://clairevo.com/

LinkedIn: https://www.linkedin.com/in/clairevo/

X: https://x.com/clairevo

Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email jordan@penname.co.

AI 导读 · 站内摘要,非正文

Claire Vo 在 How I AI 首次个人智能体基准测试中,让 Grok Bot、Dot、Meta Muse、Claude Duet 完成九项真实任务,涵盖代写 Slack 回复、修复 Sentry bug、Figma 缩略图、收件箱整理、家庭报纸、四年级物理作业讲解、买鞋和 ChatPRD 发布视频。

来源:Lenny Rachitsky · lennysnewsletter.com

原文链接:https://www.lennysnewsletter.com/p/grok-vs-dot-vs-muse-vs-claude-duet