SmoothOperatorAgentTools

Smooth Operator Agent Tools MCP Server

Smooth Operator Agent Tools provide robust capabilities for Windows automation, browser control, and AI-driven computer interaction. They are designed to empower AI agents to understand and utilize computer functionalities.

What it does:

This MCP server allows AI agents (like Claude) to interact with your Windows environment, control web browsers (specifically Chrome), perform UI automation, and execute keyboard/mouse actions. It also includes AI Vision capabilities for mouse control based on UI element descriptions.

How to use:

1. Download the Windows App: Obtain the Smooth Operator Agent Tools Windows application.
2. Installation: Follow the setup instructions provided by the app.
3. MCP Client Configuration: Configure your MCP client with the following mcpServers entry to connect via stdio:

   {
     "mcpServers": {
       "SmoothOperatorAgentTools": {
         "command": "C:\\Users\\[USERNAME]\\AppData\\Roaming\\SmoothOperator\\AgentToolsServer\\smooth-operator-server.exe",
         "args": [
           "/silent",
           "/close-with-parent-process"
         ]
       }
     }
   }
   

4. HTTP Server (Optional): The tools also expose functionality via an HTTP server at http://localhost:54321, which can be used as a streamable endpoint.
5. Authentication: All API requests require an API key as a Bearer token in the Authorization header. This key is shared with Screengrasp and can be obtained from https://screengrasp.com/api.html.

Key Features:

• Screenshot and Analysis: Capture screenshots and analyze system state, UI elements, and application details.
• Mouse Control: Precise coordinate-based and AI Vision-powered mouse operations.
• Keyboard Input: Typing text, hotkeys, and key combinations.
• Chrome Browser Control: Navigation, DOM manipulation, and JavaScript execution.
• Windows Automation: Advanced UI Automation and code execution.
• API Documentation: Endpoints for accessing API documentation directly.

Implementation Details:

The server is provided as a Windows executable (.exe). Client libraries are available for Python, TypeScript, and C#/.NET, indicating a multi-language support for integration.