Skip to content

koboldcpp: fix runtime failure - #548986

Closed
fullmetalsheep wants to merge 1 commit into
NixOS:masterfrom
fullmetalsheep:fix-koboldcpp
Closed

fullmetalsheep wants to merge 1 commit into
NixOS:masterfrom
fullmetalsheep:fix-koboldcpp

Conversation

@fullmetalsheep

@fullmetalsheep fullmetalsheep commented Aug 4, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Hello,

Current installPhase logic moves .embd files from bin/embd_res to bin/. However, koboldcpp still looks up bin/embd_res for .embd files. This disparity causes a runtime error (see below). This PR fixes it by preserving bin/embd_res folder structure.

I've built and tested this after with Steps to reproduce below, and koboldcpp embd lookup works.

Hope this helps,
Cheers!

Steps to reproduce (how I came across the issue)

  1. Download starter pack config - originally mentioned in the koboldcpp wiki
  2. Run koboldcpp --config ~/Downloads/starter-pack-v2.kcppt
  3. Following error should occur
libc++abi: terminating due to uncaught exception of type std::runtime_error: 
Failed to open file: /nix/store/...-koboldcpp-1.110/bin/embd_res/qwen2_merges_utf8_c_str.embd

Things done

@nixpkgs-ci
nixpkgs-ci Bot requested review from 4evy and maxstrid August 4, 2026 00:45
@nixpkgs-ci nixpkgs-ci Bot added 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-darwin: 1 This PR causes 1 package to rebuild on Darwin. 10.rebuild-linux: 1 This PR causes 1 package to rebuild on Linux. labels Aug 4, 2026
@4evy

4evy commented Aug 4, 2026

Copy link
Copy Markdown
Member

There's #537338 already that does basically the same and more, but I don't mind this PR getting merged and rebasing on top of it either way

@fullmetalsheep

Copy link
Copy Markdown
Contributor Author

There's #537338 already that does basically the same and more, but I don't mind this PR getting merged and rebasing on top of it either way

I would prefer the rebase option since it takes away the pressure from your PRs' other changes?

(on a purely selfish note, It'll also allow me to remove the local nix overlay I'm using to fix the issue - a bit faster 😆)

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-darwin: 1 This PR causes 1 package to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. 10.rebuild-linux: 1 This PR causes 1 package to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants