in https://huggingface.co/google/gemma-2-9b/blob/main/config.json
"query_pre_attn_scalar": 256,
· Sign up or log in to comment
