Skip to content

Commit fb944f4

Browse files
committed
Update README.md
1 parent 982da2e commit fb944f4

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

README.md

+8
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,13 @@
11
# FastAPI-BitNet
22

3+
This project uses a combination of [Uvicorn](https://www.uvicorn.org/), [FastAPI](https://fastapi.tiangolo.com/) (Python) and [Docker](https://www.docker.com/) to provide a reliable REST API for testing [Microsoft's BitNet](https://github.com/microsoft/BitNet) out locally!
4+
5+
It supports running the inference framework, running BitNet model benchmarks and calculating BitNet model perplexity values.
6+
7+
It's offers the same functionality as the [Electron-BitNet](https://github.com/grctest/Electron-BitNet) project, however it does so through a REST API which devs/researchers can use to automate testing/benchmarking of 1-bit BitNet models!
8+
9+
## Setup instructions
10+
311
Install Conda: https://anaconda.org/anaconda/conda
412

513
Initialize the python environment:

0 commit comments

Comments
 (0)