training-from-scratch

Here is 1 public repository matching this topic...

igna-s / AI-Training-from-Scratch

Some investigations I made with AMD cloud credits: training language models from scratch, exploring low-bit and byte-level architectures, and running ablation studies.

deep-learning amd pytorch artificial-intelligence language-models quantization knowledge-distillation rocm byte-level low-bit ablation-study training-from-scratch ternary-networks

Updated Oct 10, 2026
Python

Add this topic to your repo

To associate your repository with the training-from-scratch topic, visit your repo's landing page and select "manage topics."

Learn more