bartowski

/

google_gemma-3-27b-it-GGUF

like 36

I had strange behaviour in Ollama. Setting Modelfile params to below is fixing it (based on ollama model page):

FROM google_gemma-3-27b-it-IQ4_XS.gguf
PARAMETER stop ""
PARAMETER temperature 0.1
TEMPLATE """{{- range $i, $_ := .Messages }}
{{- $last := eq (len (slice $.Messages $i)) 1 }}
{{- if or (eq .Role "user") (eq .Role "system") }}user
{{ .Content }}
{{ if $last }}model
{{ end }}
{{- else if eq .Role "assistant" }}model
{{ .Content }}{{ if not $last }}
{{ end }}
{{- end }}
{{- end }}"""