10号issue吧?

[CL-nevins]

issue 和 pr 的优先级，哪个更高？

改动 04

[CL-nevins]

11111

[CL-nevins]

Welcome to Xinference!

getting_started/index models/index user_guide/index examples/index
reference/index development/index

Xorbits Inference (Xinference) is an open-source platform to streamline
the operation and integration of a wide array of AI models. With
Xinference, you're empowered to run inference using any open-source
LLMs, embedding models, and multimodal models either in the cloud or on
your own premises, and create robust AI-driven applications.

Developing Real-world AI Applications with Xinference

python LLM

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

# Chat to LLM model.chat( messages=[{"role": "system", "content": "You
are a helpful assistant"}, {"role": "user", "content": "What is the
largest animal?"}], generate_config={"max_tokens": 1024} )

python Embedding

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

model.create_embedding("What is the capital of China?")

python Image

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

model.text_to_image("An astronaut walking on the mars")

python Audio

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

with open("speech.mp3", "rb") as audio_file:
model.transcriptions(audio_file.read())

python Rerank

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

query = "A man is eating pasta." corpus = [ "A man is eating food.", "A
man is eating a piece of bread.", "The girl is carrying a baby.", "A man
is riding a horse.", "A woman is playing violin." ]
print(model.rerank(corpus, query))

python Video

from xinference.client import Client

client = Client("http://localhost:9997") model =
client.get_model("MODEL_UID")

model.text_to_video("")

Getting Started

2

Install Xinference

Install Xinference on Linux, Windows, and macOS.

Try it out!

Start by running Xinference on a local machine.

2

Explore models

Explore a wide range of models supported by Xinference.

Register your own model

Register model weights and turn it into an API.

Explore the API

2

Chat & Generate

Learn how to chat with LLMs in Xinference.

Tools

Learn how to connect LLM with external tools.

2

Embeddings

Learn how to create text embeddings in Xinference.

Rerank

Learn how to use rerank models in Xinference.

2

Images

Learn how to generate images with Xinference.

Multimodal

Learn how to process images and audio with LLMs.

2

Audio

Learn how to turn audio into text or text into audio with Xinference.

Video

Learn how to generate video with Xinference.

2

Flexible

Learn how to inference traditional ML models with Xinference.

Getting Involved

sd-font-weight-normal sd-fs-5

Get Latest News

1

twitter Follow us on Twitter

zhihu Read our blogs

sd-font-weight-normal sd-fs-5

Get Support

1

weixin Find community on WeChat

discord Find community on Discord

github Open an issue

sd-fs-5

Contribute to Xinference

1

github Create a pull request