Vibecode with the gear you already own.
Your MIDI keyboard or game controller becomes the control surface for your AI coding agents.
You talk to your AI agent now. Speech-to-text writes the prompt, and the agent writes the code. What's left for your hands is a handful of moves: talk, send, approve, switch agent, stop. You don't need 104 keys for that.
OpenAI and Work Louder made the Codex Micro for this: a $230, limited-edition keypad for driving AI agents. It inspired VibeConsole. You probably already own something with buttons, knobs and sticks: a MIDI keyboard on your desk, a game controller in a drawer. VibeConsole turns it into your own Codex Micro, for free and in the open.
- 🎙️ Hold a pad to talk. Push-to-talk for Wispr Flow, so you dictate instead of typing.
- 🤖 Drive your agents. Send saved prompts to Claude Code or Codex, step through a prompt sequence one tap at a time, and run commands. Risky actions fire only after a one-second hold.
- 🚦 See what your agents are doing. Controller lights show when an agent is thinking, needs you, or has finished.
- ⌨️ Shortcuts and apps. Any key combo, app launcher, volume or mic mute on any pad, button, knob or stick.
- 🗂️ Profiles per app. Your controls change with the focused app, like Logitech G HUB does for games.
| Device | Status |
|---|---|
| 🎹 Akai MPK Mini MK3 | ✅ Supported, with pad lights, octave and tempo as status lights |
| 🎹 Any MIDI controller | ✅ Supported |
| 🎮 Xbox controllers (USB) | ✅ Supported, with rumble, Xbox button light and headset |
| ⌨️ Your keyboard's Caps, Num and Scroll lights | ✅ As status lights |
| 🎮 PlayStation 5 DualSense | 🔜 Next version |
| 🕹️ Steam Deck | 🔜 Next version |
| 🎮 Xbox controllers over Bluetooth | 🔜 Planned |
Use a MIDI controller and an Xbox controller at the same time if you like.
VibeConsole runs on Linux and needs Rust. It's tested on Fedora with GNOME on Wayland.
sudo dnf install alsa-lib-devel systemd-devel alsa-utils usbutils acl tmux wl-clipboard
git clone https://github.com/7kim/VibeConsole.git && cd VibeConsole
scripts/install.sh # builds and installs to ~/.local/bin
vibeconsole doctor # checks your setup
vibeconsole # plug in your controller and goOpen Configure, press a pad or button, and choose what it does.
- A desktop app with a tray icon and a hints window that shows your controller in 3D, with what each button does.
- PlayStation 5 DualSense and Steam Deck support.
- Packages for Linux (AppImage, rpm, deb) and Windows.
VibeConsole is open source under the MIT license, and contributions are welcome. The third-party 3D models in assets/devices/split/ keep their own licences, listed in CREDITS.md. Commands, configuration, architecture and testing are in README-DEVELOPER.md.