How I AI podcast artwork How I AI

Grok vs. Dot vs. Muse vs. Claude Duet: which one crushes the competition?

35 min

Play episode Listen on the show's site

Sponsors in this episode

Found in the episode's show notes.

  • WorkOS

    "WorkOS—Make your app enterprise-ready, with SSO, SCIM, RBAC, and more"
  • Firecrawl

    "Firecrawl—Give your AI agents web data and beyond"

Show notes

I have personal-agent fatigue, so I ran the first How I AI personal-agent benchmark: Grok Bot, Dot, Muse, and Claude Duet across nine real tasks, from a Slack reply and a Sentry bug to a Figma thumbnail, inbox triage, a family newspaper, physics homework for a fourth grader, shoe shopping, and a ChatPRD launch video. I used computer use to operate them: Claude ran Dot, Codex ran the rest and scored the results live. Here’s the scoreboard—and which agent I’d actually trust for work vs. life.
—
Brought to you by:
WorkOS—Make your app enterprise-ready, with SSO, SCIM, RBAC, and more
Firecrawl—Give your AI agents web data and beyond
—
In this episode, we cover:
(00:00) Introduction
(02:13) The personal-agent benchmark setup
(05:00) The nine tasks and the prompts I used
(07:20) Scoreboard overview
(10:06) Task 1: Draft a Slack reply as me
(11:39) Task 2: Cut a short-form video from raw Dropbox footage
(14:56) Task 3: Fix a bug from Sentry
(17:30) Task 4: Build a How I AI thumbnail in Figma
(19:25) Task 5: Triage my inbox for to-dos
(21:06) Task 6: Build a family newspaper
(23:30) Task 7: Explain a physics homework question to a fourth grader
(24:54) Task 8: Shop for shoes
(26:46) Task 9: Make a ChatPRD Product Intelligence launch video
(30:01) Final scores
(32:38) My takeaways
—
Tools referenced:
• Grok Bot: https://x.ai/bot
• Dot: https://chatgpt.com/features/dots/
• Meta Muse: https://ai.meta.com/muse/
• Claude Duet: https://claude.com/product/claude-duet
• Codex: https://openai.com/codex
• ElevenLabs: https://elevenlabs.io/
• Figma: https://www.figma.com/
• Sentry: https://sentry.io/
• Linear: https://linear.app/
• Dropbox: https://www.dropbox.com/
—
Where to find Claire Vo:
ChatPRD: https://www.chatprd.ai/
Website: https://clairevo.com/
LinkedIn: https://www.linkedin.com/in/clairevo/
X: https://x.com/clairevo
—
Production and marketing by https://penname.co/. For inquiries about sponsoring the podcast, email [email protected].

From the show's RSS feed.