Hugging Face's logo

Spaces:
ua-l
/
question-and-answer
No application file

App Files Community
Yehor commited on
Commit
a86fbe8
·
verified ·
1 Parent(s): 12015a7

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +2 -0
app.py CHANGED
@@ -6,6 +6,8 @@ import gradio as gr
6
 
7
  from transformers import AutoTokenizer, AutoModelForCausalLM
8
 
 
 
9
  max_seq_length = 2048
10
 
11
  tokenizer = AutoTokenizer.from_pretrained("ua-l/gemma-2-9b-legal-steps200-merged-16bit-uk")
 
6
 
7
  from transformers import AutoTokenizer, AutoModelForCausalLM
8
 
9
+ torch.set_float32_matmul_precision('high')
10
+
11
  max_seq_length = 2048
12
 
13
  tokenizer = AutoTokenizer.from_pretrained("ua-l/gemma-2-9b-legal-steps200-merged-16bit-uk")