
Self-operating computer
🔓 Open SourceProductivityResearch
Overview
Enables multimodal models to operate computers using same inputs/outputs as human operators. Model views screen and decides series of mouse and keyboard actions to reach objectives. Autonomous computer control through visual understanding and action planning.
Details
Built by OthersideAI (HyperWrite). Human-like computer operation. Screen viewing and action decision. Mouse and keyboard control. Goal-oriented automation.