Repository navigation

Feature/quantisation - #2

Merged

Lothnic merged 6 commits into

mainfrom

feature/quantisation

Apr 27, 2026

Merged

Feature/quantisation#2
Lothnic merged 6 commits into
mainfrom
feature/quantisation

Commits on Apr 27, 2026
- feat: implement 4-bit NF4 quantization via bitsandbytes
  Lothnic
  committed
  a628898
- fixed quantisation and ready to merge
  Lothnic
  committed
  01a79f3
- fix: corrected weight validation logic to prevent silent initialization of missing weights with random memory
  Lothnic
  committed
  6b39989
- removed temporary decoding files
  Lothnic
  committed
  8b97690
- improved logging in weight_loader
  Lothnic
  committed
  47eee60
- fix: removed lm_head exception so as to raise ValueError on missing lm_head
  Lothnic
  committed
  5560688