Samuele Lorefice e90e0200e1 Removes ratelimit, refactors everything in more sections, adds tokenization calculation

2024-12-26 19:47:07 +01:00

.idea/.idea.NemesisAI

Solves context out of bound due to history

2024-12-26 04:32:11 +01:00

model

Added llama.cpp and reworked the code

2024-12-26 00:35:45 +01:00

TelegramBot

Removes ratelimit, refactors everything in more sections, adds tokenization calculation

2024-12-26 19:47:07 +01:00

.dockerignore

Ignores model folder when building the bot

2024-12-26 03:22:14 +01:00

.env

Added rop of pending updates on bot start, reset command, AnswerChat method, GPU offload, limit to response lenght, context reduced to 2048, flash attention, 4 parallel decode queues, --keep of the original 810 tokens (which is the starting prompt)

2024-12-26 03:24:56 +01:00

.gitignore

Solves context out of bound due to history

2024-12-26 04:32:11 +01:00

compose.yaml

Renamed tg bot container to telegrambot, moved prompt file to bot subproject

2024-12-26 16:31:06 +01:00

global.json

Added LMStudio client, upgraded to .net 9.0

2024-12-25 19:37:14 +01:00

lmstudio.env

Implemented also OpenAI

2024-12-25 21:38:26 +01:00

NemesisAI.sln

Renamed tg bot container to telegrambot, moved prompt file to bot subproject

2024-12-26 16:31:06 +01:00

Description

No description provided

66 KiB

Languages

C# 94.5%

Dockerfile 5.5%