Skip to content

Add a local llama.cpp control panel - #9

Open
Quixyl-eng wants to merge 1 commit into
mainfrom
feature/exvram-control
Open

Quixyl-eng wants to merge 1 commit into
mainfrom
feature/exvram-control

Conversation

@Quixyl-eng

Copy link
Copy Markdown
Contributor

Summary

  • Adds ExVRAM Control, a Tauri window and tray that starts and stops an existing llama-server on 127.0.0.1.
  • Memory, context, and KV choices come from the published occupied-8k IQ2_XXS recipe. Unmeasured speed is shown as «Нет данных».
  • Protect My PC is on by default: 4 threads, a VRAM leftover, and no killing of other programs. Context compression methods that are not implemented stay off.

Test plan

  • cargo test --workspace in control/ (27 core tests)
  • existing Python unittest (89 tests, 1 GPU smoke skipped)
  • debug panel stayed open with no model loaded and did not spawn llama-server
  • click the tray icon and start the published GGUF on a machine with the model and llama-server present

Made with Cursor

The panel reads the published 8k recipe, starts llama-server on loopback, and refuses a launch it cannot size.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant