Skip to content

[Gemma4] Fix the bug of use_qk_norm accidently set to False in Gemma 4 configs - #4938

Open
Dr-Left wants to merge 1 commit into
mainfrom
chris/fix-gemma4-canonical-attention
Open

[Gemma4] Fix the bug of use_qk_norm accidently set to False in Gemma 4 configs #4938
Dr-Left wants to merge 1 commit into
mainfrom
chris/fix-gemma4-canonical-attention

[Gemma4] Enable use_qk_norm in Gemma 4 configs and fix attention weig…

f85570d
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Aug 19, 2026 in 7s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

✅ f85570d Author: @Dr-Left <j**o​@google.com>

(Only the first commit for a unique contributor is listed.)

View more details on Google CLA