Skip to content

Port TTS#1185

Draft
DEATHB4DEFEAT wants to merge 17 commits intoSimple-Station:masterfrom
DEATHB4DEFEAT:tts
Draft

Port TTS#1185
DEATHB4DEFEAT wants to merge 17 commits intoSimple-Station:masterfrom
DEATHB4DEFEAT:tts

Conversation

@DEATHB4DEFEAT
Copy link
Member

@DEATHB4DEFEAT DEATHB4DEFEAT commented Nov 8, 2024

Description

SpaceStationUA/station#7 SpaceStationUA/station#8
I need some help finding a bunch of English voices we can link as defaults.

This uses Piper to generate the audio.
Windows support is untested, but exists.
There is very little setup required; install Piper, find some models and make their prototypes (or download the "defaults" to bin/Content.Server/data/tts/models and rename them accordingly), set tts.enabled to true, maybe change tts.model_path (starting the path with data/ will put it in the server's datadir), and you're good to go.


TODO

  • IC language support
  • Fix volume
  • Improve sanitization
  • Cache messages
  • Automatically delete messages
  • Queue audio
  • Review the code
  • Figure out what SSML is

Media

2024-11-07_20-21-39.mp4


Changelog

🆑

  • add: Added TTS

SpaceCowboyServer and others added 3 commits November 7, 2024 17:23
Speech test

(cherry picked from commit f55c150b4cc0532551c34f755b25e367ee0da2bb)
Speech test 2

(cherry picked from commit b3a2ecd95f61a15d92946545d21cf3d783ee7710)
@DEATHB4DEFEAT DEATHB4DEFEAT added Priority: 3-Medium Needs to be resolved at some point Size: 2-Large For large issues/PRs Type: Feature Creation of or significant changes to a feature Type: Port Brings something to here from another codebase labels Nov 8, 2024
@github-actions github-actions bot added Changes: C# Changes any cs files Changes: Localization Changes any ftl files Changes: UI Changes any XAML files Changes: YML Changes any yml files labels Nov 8, 2024
@DEATHB4DEFEAT DEATHB4DEFEAT marked this pull request as ready for review November 8, 2024 08:41
@DEATHB4DEFEAT DEATHB4DEFEAT marked this pull request as draft November 8, 2024 10:50
@Evgencheg
Copy link
Contributor

@DEATHB4DEFEAT i think better to cherry-pick is - corvax tts that works with GPU but needs an external hosting

@bruhmogus

This comment was marked as resolved.

@Rxup
Copy link

Rxup commented Nov 10, 2024

@DEATHB4DEFEAT https://github.com/Rxup/ss14-tts-api it's support random voice generator via tts_test.ipynb and can use https://models.silero.ai/models/tts/en/v3_en.pt change in https://github.com/Rxup/ss14-tts-api/blob/main/ss14tts.py#L31

@ShadesMars ShadesMars requested review from a team, Aidenkrz, OldDanceJacket, Peptide90, Pspritechologist, Remuchi, ShadesMars and VMSolidus and removed request for a team November 14, 2024 18:19
@github-actions github-actions bot added Status: Needs Review Someone please review this Status: Merge Conflict FIX YOUR PR AAAGH labels Nov 14, 2024
@github-actions
Copy link
Contributor

This pull request has conflicts, please resolve those before we can evaluate the pull request.

@Crono209ggg
Copy link

Bro this is so cool!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Changes: C# Changes any cs files Changes: Localization Changes any ftl files Changes: UI Changes any XAML files Changes: YML Changes any yml files Priority: 3-Medium Needs to be resolved at some point Size: 2-Large For large issues/PRs Status: Merge Conflict FIX YOUR PR AAAGH Status: Needs Review Someone please review this Type: Feature Creation of or significant changes to a feature Type: Port Brings something to here from another codebase

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants