DAIR Lab

All

41 repositories

Hetu
Public
A high-performance distributed deep learning system targeting large-scale and automated distributed training.
python distributed-systems data-science machine-learning deep-neural-networks deep-learning gpu autograd embeddings artificial-intelligence
Python
•
Apache License 2.0
•53•316•0•0•Updated Jul 28, 2025Jul 28, 2025
Hetu-Galvatron
Public
Galvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs).
Python
•
Apache License 2.0
•13•162•1•0•Updated Jul 20, 2025Jul 20, 2025
DataFlow
Public
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Python
•
Apache License 2.0
•69•5•0•0•Updated Jun 29, 2025Jun 29, 2025
DAIR_Portal_FE
Public
Vue
•0•1•1•0•Updated Jun 19, 2025Jun 19, 2025
SAS-Bench
Public
Benchmarking large language models for short answer grading in a fine-grained, multi-subject, and human-aligned setting.
automatic-grading education-nlp short-answer-scoring benchmark-evaluation-llms human-aligned-assessment
Python
•
Apache License 2.0
•3•68•0•0•Updated May 15, 2025May 15, 2025
Starter-Guide
Public
A comprehensive guide for beginners in the field of data management and artificial intelligence.
15•387•1•0•Updated Apr 8, 2025Apr 8, 2025
A-Tune-Online
Public
[ICDE 2025] A-Tune-Online: Efficient and QoS-aware Online Configuration Tuning for Dynamic Workloads.
Python
•1•1•0•0•Updated Mar 28, 2025Mar 28, 2025
CAFE
Public
[SIGMOD 2024] CAFE: Towards Compact, Adaptive, and Fast Embedding for Large-scale Recommendation Models
Python
•
MIT License
•7•3•0•0•Updated Mar 19, 2025Mar 19, 2025
FreeHGC
Public
Python
•1•3•0•0•Updated Dec 6, 2024Dec 6, 2024
Noisy-LLM-Oracle
Public
Python
•1•0•0•0•Updated Nov 30, 2024Nov 30, 2024
LoRA_Inlaid
Public
1•1•0•0•Updated Oct 23, 2024Oct 23, 2024
open-box
Public
Towards Generalized and Efficient Blackbox Optimization System/Package (KDD 2021 & JMLR 2024)
distributed-systems saas constrained-optimization multi-objective-optimization bayesian-optimization hyper-parameter-optimization blackbox-optimization automatic-machine-learning
Python
•
Other
•85•419•13•1•Updated Oct 17, 2024Oct 17, 2024
RAG-Survey
Public
Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".
120•301•0•0•Updated Jun 21, 2024Jun 21, 2024
SGL
Public
A scalable graph learning toolkit for extremely large graph datasets. (WWW'22, 🏆 Best Student Paper Award)
deep-learning geometric-deep-learning scalable-graph-learning pytorch network-embedding neural-architecture-search graph-neural-networks
Python
•
MIT License
•22•155•0•2•Updated May 10, 2024May 10, 2024
OUTRE
Public
OUTRE: An OUT-of-core De-REdundancy GNN Training Framework for Massive Graphs within A Single Machine
C++
•1•2•0•0•Updated Oct 21, 2023Oct 21, 2023
MEVI
Public
[NeurIPS 2023] Model-enhanced Vector Index
Python
•3•1•0•0•Updated Sep 26, 2023Sep 26, 2023
DBTune
Public
A customized and efficient database tuning system [VLDB'22]
Python
•
Other
•23•33•1•0•Updated Sep 21, 2023Sep 21, 2023
HGAMLP
Public
HGAMLP: A Scalable Training Framework for Heterogeneous Graph Neural Networks
Python
•0•7•1•0•Updated Jul 15, 2023Jul 15, 2023
AIR
Public
Python
•2•7•0•0•Updated Sep 26, 2022Sep 26, 2022
SSD
Public
Transfer Learning based Search Space Design for Hyperparameter Tuning [SIGKDD'22]
Python
•1•4•0•0•Updated Aug 25, 2022Aug 25, 2022
GNN-in-RS
Public
GNN in Recommendation System (ACM Computing Surveys 2022)
65•84•0•0•Updated Jun 25, 2022Jun 25, 2022
GAMLP
Public
Code of GAMLP for Open Graph Benchmark. KDD‘22
Python
•13•62•0•0•Updated Jun 25, 2022Jun 25, 2022
NAFS
Public
ICML‘22 NAFS
Python
•5•5•0•0•Updated Jun 20, 2022Jun 20, 2022
KnobsTuningEA
Public
An Experimental Evaluation for Database Configuration Tuning
ReScript
•15•26•2•0•Updated Mar 15, 2022Mar 15, 2022
DFG-NAS
Public
ICML‘22 DF-GNAS
Python
•2•1•0•0•Updated Jan 28, 2022Jan 28, 2022
2021_CCF_BDCI_LargeBERT_Rank1st
Public
Cuda
•
Apache License 2.0
•0•8•0•0•Updated Jan 20, 2022Jan 20, 2022
2021_AIAC_Task2_1st
Public
QQ浏览器2021AI算法大赛赛道二第1名方案. Rank 1st solution to QQ Browser 2021 AI Algorithm Competition (CIKM AnalytiCup 2021) Track 2 Automated Hyperparameter Optimization.
Python
•6•26•0•0•Updated Dec 7, 2021Dec 7, 2021
HyperTune
Public
Efficient Hyper-parameter Tuning at Scale (VLDB'22)
Python
•3•8•0•0•Updated Dec 1, 2021Dec 1, 2021
mindware
Public
An efficient open-source AutoML system for automating machine learning lifecycle, including feature engineering, neural architecture search, and hyper-parameter tuning.
python distributed-systems data-science machine-learning deep-learning ensemble-learning bayesian-optimization neural-architecture-search meta-learning hyper-parameter-optimization
Python
•
MIT License
•28•58•0•0•Updated Nov 16, 2021Nov 16, 2021
RIM
Public
RIM: Reliable Influence-based Active Learning on Graphs (NeurIPS'21 Spotlight)
2•2•0•0•Updated Oct 27, 2021Oct 27, 2021