Added llama.cpp and reworked the code

This commit is contained in:
Samuele Lorefice
2024-12-26 00:35:00 +01:00
parent c6302112b2
commit 2357c7570c
6 changed files with 118 additions and 25 deletions

2
.env Normal file
View File

@@ -0,0 +1,2 @@
MODEL_PATH=./model
MODEL_NAME=Qwen2.5-7B-Instruct-Q8_0