NEXUS is a next-generation, voice-controlled, and web-powered desktop management assistant for Windows. It provides full control over your applications, file system, system diagnostics, and clipboard using either local voice inputs or a futuristic web dashboard.
NEXUS integrates local machine learning capabilities via Ollama for conversational AI, Tesseract for screen OCR, and standard system libraries for deep OS integration.
- App Launching: Open native apps (e.g. Chrome, Notepad, Calc) or search-launch start menu items.
- Web Navigation: Open websites, trigger Google searches, or query YouTube videos.
- Window Snapping: Snap windows left/right, maximize, minimize, or toggle virtual desktops.
- System Controls: Control system volume, toggle mute, and change screen brightness.
- Utility Actions: Empty the recycle bin, trigger disk cleanup, take screenshots, lock the workstation, or issue shutdown/restarts with cancellations.
- Local Conversational AI: Integrates with Ollama to reply using local LLM models (e.g., Llama 3).
- Screen OCR: Captures active screen contents and processes text search/read actions via Tesseract OCR.
- Persistent Context: Uses persistent context storage (
nexus_memory.json) to remember chat logs and preferences.
- System Health Monitor: Live-polling dashboard tracking CPU utilization, core configurations, and RAM usage.
- Automation Flows library: Trigger sequential system sequences (e.g., "Morning Routine", "Project Setup") with single web clicks or vocal voice triggers.
- Interactive Command History: Searchable audit log of past user inputs and NEXUS output status. Allows one-click command replays.
- System Settings Configuration: Change voice synthesizer profiles (Analytical vs. Conversational), adjust microphone sensitivity, configure app permission scopes, and save OpenAI/Anthropic credentials.
NEXUS is designed for Windows environments. To run it, ensure the following are installed:
- Python 3.8+ (Recommend Python 3.10+)
- Tesseract OCR (For screen OCR search features):
- Download the Windows installer from GitHub (UB Mannheim).
- Install to default directory:
C:\Program Files\Tesseract-OCR\tesseract.exe.
- Ollama (For local conversational AI):
- Install from Ollama.com.
- Start the service and pull your preferred model:
ollama pull llama3
- Clone or download this repository to your workspace.
- Create and activate a Python virtual environment:
python -m venv .venv .venv\Scripts\activate - Install the dependencies listed in
requirements.txt:pip install -r requirements.txt
(Note: Pywin32 may occasionally run into DLL registration errors on Windows. NEXUS includes automatic runtime path adjustments to handle pywin32 DLL lookups in virtual environments).
Ensure your virtual environment is active, then execute:
python nexus.py- Desktop GUI Window: By default, NEXUS launches directly inside a standalone Windows Desktop App window wrapping the web dashboard using native Edge/WebView2 runtime.
- Console text mode: Type commands directly in the CLI prompt (
YOU:) concurrently while the GUI is running. - Voice mode: Type
voiceor say"voice"to active voice recognition. Speak commands directly into your mic. - CLI Fallback: If the desktop GUI window is unable to start or the
pywebviewlibrary is missing, NEXUS automatically falls back to launching the web dashboard in your default browser.
Here are some examples of commands you can type, say, or execute through the dashboard command bar:
| Feature | Example Commands |
|---|---|
| Opening Apps | "open chrome", "open documents", "open download folder" |
| System Info | "system status", "wifi status", "network info", "what time is it" |
| System Control | "set volume to 50", "mute volume", "increase brightness" |
| File Operations | "create folder project_folder", "list desktop", "delete temp.txt" |
| Screen & Clip | "take screenshot", "read clipboard", "type Hello World" |
| Window actions | "snap left", "maximize window", "next window" |
| AI Agent | "how do I format a hard drive in Windows?" |
Automation Flows allow you to stack multiple sequential commands. By default, NEXUS supports:
- Morning Routine (
"start my day"/"morning routine"): Check time, show system status, open youtube. - Project Setup (
"dev mode"/"project setup"): Open documents directory, list desktop. - Server Maintenance (
"clean servers"/"run diagnostics"): Run disk cleanup, empty recycle bin. - Security Audit (
"audit network"/"security audit"): Check network details, print wifi status.
Create your own customized flows directly inside the Flows tab on the Web Dashboard!