FLASH CLI

FLASH (Fast Local Agent SHell) CLI is an AI-powered command-line interface that allows you to interact with local (or remote) Ollama models while having the ability to execute shell commands directly or through the AI.

Watch the video on YouTube

Features

• Interactive AI Chat: Chat with local or self-hosted models served by Ollama, directly from your terminal.
• Switchable Backend: Point Flash at localhost or any remote Ollama server via a single config option.
• Shell Command Execution:
  • AI can use a shell tool to execute commands and see their output.
  • Manually execute shell commands using the ! prefix.
• Context Management: Automatic history trimming to stay within token limits.
• Markdown Support: Rich formatting for AI responses in the terminal.

Installation

1. Clone the repository:

   git clone https://github.com/Natuworkguy/Flash
   cd Flash

2. Install dependencies:

   pip install -r requirements.txt

3. Install and start Ollama:

   Flash talks to an Ollama server. Install Ollama, start it, and pull a model that supports tool calling:

   ollama pull llama3.1

   By default, Flash connects to a local server at http://localhost:11434. To use a remote server, set OLLAMA_HOST (see Configuration).

Run

python3 run.py

Configuration

FLASH CLI is configured through environment variables. You can create a .flash.env file in your home directory:

MODEL=llama3.1
OLLAMA_HOST=http://localhost:11434

Environment Variables

See docs/CONFIGURATION.md.

Switching servers

• Local (default): leave OLLAMA_HOST unset, or set it to http://localhost:11434.
• Remote server: set OLLAMA_HOST to the other machine, e.g. OLLAMA_HOST=http://192.168.1.50:11434 or OLLAMA_HOST=https://ollama.example.com.

Make sure the target server is reachable and that MODEL has been pulled on it.

Usage

Start the CLI by running:

python run.py

Internal Commands

• /help or /?: Display the help message.
• /model: Show the currently active model and Ollama host.
• /clear: Clear the conversation history.
• /bye: Exit the application.

Direct Shell Execution

You can run shell commands directly without AI intervention:

• !ls -la
• !git status
• !echo "Hello"

AI Interaction

Simply type your request. If the AI needs to see the contents of a file or run a command to answer your question, it can invoke the shell tool automatically. It can also search the web via Duck Duck Go and show it's reasoning.