AIRunner

Overview

Open source AI inference engine for local AI models.

AI Runner is a powerful, offline inference engine designed for creative applications and conversational AI, ideal for makers, hackers, and builders seeking local, offline AI capabilities.This tool allows users to build voice-based chatbots with real-time voice conversations, generate stunning images using Stable Diffusion and ControlNet, and manipulate existing images through inpainting and outpainting.

Key features include customizable AI personalities, retrieval-augmented generation for enhanced LLM responses, and support for LoRA models and embeddings.Built with Wayland support, Python 3.13, and the latest stable torch libraries, AI Runner offers a robust and performant experience.

It’s open-sourced under the Apache-2.0 license and supports models like Whisper, SpeechT5, and OpenVoice, enabling users to create a diverse range of projects, from interactive chatbots to sophisticated image editing workflows.

Use Cases

• Developing interactive voice-based chatbots for personalized customer service or creative storytelling..
• Creating custom image generation workflows for unique artistic projects or product visualizations..
• Building automated image editing systems for tasks like content modification or creative experimentation..

Who Is It For

• Content creators
• Ai artists
• Software developers
• Privacy-focused users
• Digital marketers