Repositories list

• SLAM-LLM

  Public
  Speech, Language, Audio, Music Processing with Large Language Model

  speech-processingaudio-processingpeft+ 3music-processinglarge-language-modelmultimodal-large-language-models

  Python

  •

  MIT License

  •68•723•18•0•Updated Feb 9, 2025Feb 9, 2025

• Xmart

  Public
  Xmart青年论坛仓库，存放历史学生论坛和前沿讲座的视频回放和讲义，获取最新Xmart预告欢迎关注公众号【XLANCE Lab】

  Apache License 2.0

  •0•4•0•0•Updated Jan 20, 2025Jan 20, 2025

• Elearning-paper-reading

  Public
  0•0•0•0•Updated Dec 23, 2024Dec 23, 2024

• x-lance.github.io

  Public template
  【🛠️🛠️🛠️This Page is Under Construction!!!】Welcome to X-LANCE! Cross Media Language Intelligence Lab in Shanghai Jiao Tong University.

  HTML

  •

  MIT License

  •12k•0•0•0•Updated Dec 23, 2024Dec 23, 2024

• kaiyu

  Public
  Kaiyu, Shanghai Jiao Tong University

  HTML

  •0•0•0•0•Updated Dec 21, 2024Dec 21, 2024

• Mobile-Env

  Public
  A Universal Platform for Training and Evaluation of Mobile Interaction

  nlpdecision-makingrl-environments+ 4interaction-platformrl-platforminfouiinformation-ui

  Python

  •

  Apache License 2.0

  •4•41•0•0•Updated Dec 18, 2024Dec 18, 2024

• VQTalker

  Public
  [AAAI 2025] VQTalker: Towards Multilingual Talking Avatars through Facial Motion Tokenization

  Apache License 2.0

  •0•42•3•0•Updated Dec 16, 2024Dec 16, 2024

• UniCATS-CTX-txt2vec

  Public
  [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS

  text-to-speechttsspeech-synthesis+ 4acoustic-modelunicatsvq-diffusionctx-txt2vec

  Python

  •8•63•5•0•Updated Nov 18, 2024Nov 18, 2024

• LinguaFranca

  Public
  Codes for paper "Converging to a Lingua Franca: Evolution of Linguistic Regions and Semantics Alignment in Multilingual Large Language Models"

  Python

  •0•2•0•0•Updated Oct 29, 2024Oct 29, 2024

• MBS

  Public
  [COLING 2024] Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind

  Python

  •1•3•0•0•Updated Oct 12, 2024Oct 12, 2024

• VoiceFlow-TTS

  Public
  [ICASSP 2024] This is the official code for "VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matching"

  text-to-speechttsspeech-synthesis+ 4probabilistic-modelsgenerative-modelsconditional-flow-matchingrectified-flow-matching

  Python

  •21•328•8•0•Updated Sep 3, 2024Sep 3, 2024

• AniTalker

  Public
  [ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"

  Jupyter Notebook

  •

  Apache License 2.0

  •141•1.5k•8•0•Updated Aug 15, 2024Aug 15, 2024

• META-GUI-Leaderboard

  Public
  [EMNLP 2022] Leaderboard of META-GUI

  CSS

  •0•0•0•0•Updated Jul 9, 2024Jul 9, 2024

• META-GUI-baseline

  Public
  [EMNLP 2022] The baseline code for META-GUI dataset

  Python

  •

  MIT License

  •3•12•3•0•Updated Jul 9, 2024Jul 9, 2024

• AttrEnhZsAc

  Public
  Python

  •

  Apache License 2.0

  •0•5•0•0•Updated Jun 21, 2024Jun 21, 2024

• UniCATS-CTX-vec2wav

  Public
  [AAAI 2024] Code for CTX-vec2wav in UniCATS

  speech-synthesisvocodersemantic-token+ 3unicatsvocodingself-supervised-speech

  Python

  •16•128•6•0•Updated Jun 11, 2024Jun 11, 2024

• text2sql-multiturn-GPT

  Public
  [NAACL 2024] CoE-SQL: In-Context Learning for Multi-Turn Text-to-SQL with Chain-of-Editions

  Python

  •0•11•1•0•Updated May 7, 2024May 7, 2024

• StoryTTS

  Public
  [ICASSP 2024] StoryTTS: A Highly Expressive Text-to-Speech Dataset with Rich Textual Expressiveness Annotations

  HTML

  •

  Other

  •4•138•2•0•Updated Apr 27, 2024Apr 27, 2024

• weblm

  Public
  [WSDM 2024] Hierarchical Multimodal Pre-training for Visually Rich Webpage Understanding

  0•14•2•0•Updated Mar 6, 2024Mar 6, 2024

• WebSRC

  Public
  [EMNLP 2021] WebSRC: A dataset for web based structural machine reading comprehension.

  CSS

  •0•4•0•0•Updated Feb 13, 2024Feb 13, 2024

• MSDWILD

  Public
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.

  HTML

  •

  Other

  •1•47•1•0•Updated Jan 24, 2024Jan 24, 2024

• text2sql-GPT

  Public
  [EMNLP 2023 Findings] ACT-SQL: In-Context Learning for Text-to-SQL with Automatically-Generated Chain-of-Thought

  Python

  •5•19•3•1•Updated Jan 11, 2024Jan 11, 2024

• PsyAgents

  Public
  An Open-Source Psychotherapy Simulation Platform with Interactive Agents

  0•0•0•0•Updated Jan 4, 2024Jan 4, 2024

• PaperReading

  Public
  整理各研究方向经典论文

  0•10•0•0•Updated Dec 4, 2023Dec 4, 2023

• MIVS_BIRGAT

  Public
  [ICASSP 2024] A BiRGAT Model for Multi-intent Spoken Language Understanding with Hierarchical Semantic Frames

  Python

  •

  MIT License

  •0•5•1•0•Updated Nov 27, 2023Nov 27, 2023

• medical-dataset

  Public
  [ACL 2023 Findings] CSS: A Large-scale Cross-schema Chinese Text-to-SQL Medical Dataset

  Python

  •

  Apache License 2.0

  •0•6•1•0•Updated May 26, 2023May 26, 2023

• D4

  Public
  [EMNLP 2022] D4: a Chinese Dialogue Dataset for Depression-Diagnosis-Oriented Chat

  CSS

  •0•1•0•0•Updated Mar 13, 2023Mar 13, 2023

• BER

  Public
  Balanced Error Rate for Speaker Diarization

  Python

  •3•29•0•0•Updated Feb 28, 2023Feb 28, 2023

• public_talks

  Public
  Materials of public talks given By SJTU X-LANCE members

  0•14•0•0•Updated Dec 3, 2022Dec 3, 2022

• WebSRC-Baseline

  Public
  [EMNLP 2021] The baseline code for WebSRC dataset.

  HTML

  •

  MIT License

  •9•49•2•0•Updated Aug 27, 2022Aug 27, 2022