How we can make it "multi" thread?

[ch3shere]

I mean it can handle only 1 request? or simultaneously it's answering each user independently?

[innightwolfsleep]

At the moment, telegram_bot handles only one request simultaneously .
In my practice, parallel works overflows VRAM, so i refused multithreading during answer generating.

If multithreading generator is requested by users, further i can add it.

[ch3shere]

At the moment, telegram_bot handles only one request simultaneously . In my practice, parallel works overflows VRAM, so i refused multithreading during answer generating.

If multithreading generator is requested by users, further i can add it.

Yeah, i agree that multi threading overflows VRAM. But let's assume if TG bot will be used by 10 members, won't it confuse "prompts"?

[ch3shere]

And also is it possible to support siletto?
"<audio src="file/extensions/silero_tts/outputs/Alpaca_1685347368.wav" controls autoplay></audio>"

[innightwolfsleep]

Each user have own history. No prompts shuffling betwen them.

[ch3shere]

Thanks bruh! And what's about silero tts answers being forwarded as voice message (and also maybe receiving voice messages also), what do you think about that?

[innightwolfsleep]

siletto wasnt in my plans... but there is too much requests of thist integration. I will think about this.

[ch3shere]

That would be awesome. I tried to play it out with api cals, but not getting results

…

On Mon, May 29, 2023, 12:28 PM innightwolfsleep ***@***.***> wrote: siletto wasnt in my plans... but there is too much requests of thist integration. I will think about this. — Reply to this email directly, view it on GitHub <#49 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BAFHXSOBP666NQP6GZQUP43XIRM2PANCNFSM6AAAAAAYSJJP2I> . You are receiving this because you authored the thread.Message ID: <innightwolfsleep/text-generation-webui-telegram_bot/repo-discussions/49/comments/6027570 @github.com>

[ch3shere]

Just a hint:

Siletto generated answers stored at: <audio src="file/extensions/silero_tts/outputs/None_1685360029.wav" controls autoplay></audio>

so we just need the bot to attach this file as answer message

[innightwolfsleep]

SileroTTS added.
Cant reuse silero stright from ooba, so it is not need to acticvate silero extension.