What is Mcp Windows Desktop Automation

mcp-windows-desktop-automation is a Model Context Protocol (MCP) server designed for automating Windows desktop tasks using AutoIt. It provides a TypeScript interface that allows LLM applications to interact with desktop functionalities through the MCP protocol.

Use cases

Use cases include automating repetitive tasks like form filling, managing windows and processes, capturing screenshots for documentation, and performing system operations like shutdown or sleep.

How to use

To use mcp-windows-desktop-automation, clone the repository, install the dependencies with npm, and start the server using npm start. You can choose between stdio and WebSocket transport protocols, and enable verbose logging if needed.

Key features

Key features include full wrapping of AutoIt functions as MCP tools, support for stdio and WebSocket transports, file access and screenshot capabilities, prompt templates for common tasks, and strict TypeScript typing.

Where to use

mcp-windows-desktop-automation can be used in various fields such as software testing, automated data entry, UI testing, and any scenario requiring automation of Windows desktop applications.

MCP Windows Desktop Automation

A Model Context Protocol (MCP) server for Windows desktop automation using AutoIt.

Overview

This project provides a TypeScript MCP server that wraps the node-autoit-koffi package, allowing LLM applications to automate Windows desktop tasks through the MCP protocol.

The server exposes:

• Tools: All AutoIt functions as MCP tools
• Resources: File access and screenshot capabilities
• Prompts: Templates for common automation tasks

Features

• Full wrapping of all AutoIt functions as MCP tools
• Support for both stdio and WebSocket transports
• File access resources for reading files and directories
• Screenshot resources for capturing the screen or specific windows
• Prompt templates for common automation tasks
• Strict TypeScript typing throughout

Installation

# Clone the repository
git clone https://github.com/yourusername/mcp-windows-desktop-automation.git
cd mcp-windows-desktop-automation

# Install dependencies
npm install

# Build the project
npm run build

Usage

Starting the Server

# Start with stdio transport (default)
npm start

# Start with WebSocket transport
npm start -- --transport=websocket --port=3000

# Enable verbose logging
npm start -- --verbose

Command Line Options

• --transport=stdio|websocket: Specify the transport protocol (default: stdio)
• --port=<number>: Specify the port for WebSocket transport (default: 3000)
• --verbose: Enable verbose logging

Tools

The server provides tools for:

• Mouse operations: Move, click, drag, etc.
• Keyboard operations: Send keystrokes, clipboard operations, etc.
• Window management: Find, activate, close, resize windows, etc.
• Control manipulation: Interact with UI controls, buttons, text fields, etc.
• Process management: Start, stop, and monitor processes
• System operations: Shutdown, sleep, etc.

Resources

The server provides resources for:

• File access: Read files and list directories
• Screenshots: Capture the screen or specific windows

Prompts

The server provides prompt templates for:

• Window interaction: Find and interact with windows
• Form filling: Automate form filling tasks
• Automation tasks: Create scripts for repetitive tasks
• Monitoring: Wait for specific conditions

Development

# Run in development mode
npm run dev

# Lint the code
npm run lint

# Run tests
npm run test

License

MIT