54691774e2Renamed tg bot container to telegrambot, moved prompt file to bot subproject
Samuele Lorefice
2024-12-26 16:31:06 +01:00
454dbb7e2aAdded GetEnv shorthand, moved Prompt loading to external file
Samuele Lorefice
2024-12-26 16:22:56 +01:00
65950e3642Solves context out of bound due to history
Samuele Lorefice
2024-12-26 04:32:11 +01:00
4167c75279Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)
Samuele Lorefice
2024-12-26 03:24:56 +01:00
296d150282Ignores model folder when building the bot
Samuele Lorefice
2024-12-26 03:22:14 +01:00
b74e5d75e1Fixed code, enabled to also always answer in a private chat
Samuele Lorefice
2024-12-26 01:34:10 +01:00
2357c7570cAdded llama.cpp and reworked the code
Samuele Lorefice
2024-12-26 00:35:00 +01:00
c6302112b2Implemented also OpenAI
Samuele Lorefice
2024-12-25 21:38:26 +01:00