Qwen
/

Text Generation
GGUF
English
chat
Inference Endpoints
conversational
jklj077 commited on
Commit
6363f1e
·
verified ·
1 Parent(s): bd97555

Create params

Browse files

for ollama users: ollama run hf.co/Qwen/QwQ-32B-GGUF:Q4_K_M etc

Files changed (1) hide show
  1. params +14 -0
params ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "stop": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|endoftext|>"
6
+ ],
7
+ "temperature": 0.6,
8
+ "min_p" : 0.00,
9
+ "repeat_penalty" : 1.0,
10
+ "top_k" : 40,
11
+ "top_p" : 0.95,
12
+ "num_ctx": 32768,
13
+ "num_predict" : 32768
14
+ }