Skip to content
This repository has been archived by the owner on Oct 19, 2024. It is now read-only.

Commit

Permalink
Update publications (#885)
Browse files Browse the repository at this point in the history
  • Loading branch information
merrymercy authored Feb 24, 2023
1 parent 979a45a commit 97d4524
Show file tree
Hide file tree
Showing 3 changed files with 30 additions and 8 deletions.
7 changes: 3 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,11 +76,10 @@ for batch in data_loader:
```

## Learning more
- [OSDI 2022 paper](https://arxiv.org/abs/2201.12023)
- [Papers](docs/publications/publications.rst)
- [Google AI blog](https://ai.googleblog.com/2022/05/alpa-automated-model-parallel-deep.html)
- [Talk slides](https://docs.google.com/presentation/d/1CQ4S1ff8yURk9XmL5lpQOoMMlsjw4m0zPS6zYDcyp7Y/edit?usp=sharing)
- [ICML 2022 Big Model Tutorial slides](https://sites.google.com/view/icml-2022-big-model/home)
- [ICML 2022 Big Model Tutorial video recording](https://icml.cc/virtual/2022/tutorial/18440)
- [OSDI 2022 talk slides](https://docs.google.com/presentation/d/1CQ4S1ff8yURk9XmL5lpQOoMMlsjw4m0zPS6zYDcyp7Y/edit?usp=sharing)
- [ICML 2022 big model tutorial](https://sites.google.com/view/icml-2022-big-model/home)
- [Prof. Ion Stoica introduces the system](https://www.youtube.com/watch?v=qzYoMldlyoA)

## Getting Involved
Expand Down
14 changes: 10 additions & 4 deletions docs/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,14 @@ Alpa is a system for training and serving large-scale neural networks.
tutorials/alpa_on_slurm.rst
tutorials/faq.rst

.. toctree::
:maxdepth: 1
:caption: Architecture

architecture/overview.rst
architecture/alpa_compiler_walk_through.rst
architecture/intra_op_solver.rst

.. toctree::
:maxdepth: 1
:caption: Benchmark
Expand All @@ -36,11 +44,9 @@ Alpa is a system for training and serving large-scale neural networks.

.. toctree::
:maxdepth: 1
:caption: Architecture
:caption: Publications

architecture/overview.rst
architecture/alpa_compiler_walk_through.rst
architecture/intra_op_solver.rst
publications/publications.rst

.. toctree::
:maxdepth: 1
Expand Down
17 changes: 17 additions & 0 deletions docs/publications/publications.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
Publications
============

Alpa is developed as a research project with collaborators from multiple institutions.
This page includes references to publications describing the ideas behind Alpa.

| `Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning <https://arxiv.org/abs/2201.12023>`_
| Lianmin Zheng*, Zhuohan Li*, Hao Zhang*, Yonghao Zhuang, Zhifeng Chen, Yanping Huang, Yida Wang, Yuanzhong Xu, Danyang Zhuo, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica
| *OSDI 2022*
|
| `On Optimizing the Communication of Model Parallelism <https://arxiv.org/abs/2211.05322>`_
| Yonghao Zhuang*, Hexu Zhao*, Lianmin Zheng, Zhuohan Li, Eric P. Xing, Qirong Ho, Joseph E. Gonzalez, Ion Stoica, Hao Zhang
| *MLSys 2023*
|
| `AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving <https://arxiv.org/abs/2302.11665>`_
| Zhuohan Li*, Lianmin Zheng*, Yinmin Zhong*, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica
| *Preprint*

0 comments on commit 97d4524

Please sign in to comment.