Samuele Lorefice 4167c75279 Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

.idea/.idea.NemesisAI

Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

model

Added llama.cpp and reworked the code

2024-12-26 00:35:45 +01:00

TelegramBot

Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

.dockerignore

Ignores model folder when building the bot

2024-12-26 03:22:14 +01:00

.env

Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

.gitignore

Added llama.cpp and reworked the code

2024-12-26 00:35:45 +01:00

compose.yaml

Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

global.json

Added LMStudio client, upgraded to .net 9.0

2024-12-25 19:37:14 +01:00

lmstudio.env

Implemented also OpenAI

2024-12-25 21:38:26 +01:00

NemesisAI.sln

Base commit

2024-12-24 23:08:08 +01:00

Description

No description provided

66 KiB

Languages

C# 94.5%

Dockerfile 5.5%