Particle.news
Download on the App Store

Anthropic’s Claude Can Now Learn Tasks From Live Screen Walkthroughs

Promising faster desktop automation for paid users, the feature raises enterprise questions about verification and job risk.

Overview

  • Anthropic rolled out a “Record a Skill” tool in the Claude desktop app that records a live walkthrough of screen actions, mouse movements, keystrokes, and spoken commentary and then converts that demonstration into a reusable skill.
  • The capability is available only to paid Claude plans (Pro, Max, and Team) and runs in the desktop/Cowork environment where Claude must be active and granted screen permissions to capture a session.
  • Anthropic announced the feature on Tuesday, July 21, and the system demonstrably converts live demonstrations into automatable tasks that Claude can run on demand.
  • Claims that Claude can learn from offline or pre-recorded video have not been independently verified, and early users report practical limits such as high resource/token use and cooldowns that restrict how often skills can be created or run.
  • The update places Anthropic in direct competition with recent record-and-replay tools from rivals and prompts wider questions for businesses about auditability, verifiable logs of agent actions, and potential job displacement from automated desktop workflows.