Self-operating computer

Self-operating computer

🔓 Open SourceProductivityResearch

Overview

Enables multimodal models to operate computers using same inputs/outputs as human operators. Model views screen and decides series of mouse and keyboard actions to reach objectives. Autonomous computer control through visual understanding and action planning.

Details

Built by OthersideAI (HyperWrite). Human-like computer operation. Screen viewing and action decision. Mouse and keyboard control. Goal-oriented automation.

Resources