Author: vLLM Team
License: Apache 2.0
Summary: A high-throughput and memory-efficient inference and serving engine for LLMs
Can't find the visual you need? Build your own here
Downloads over time
Top versions
Downloads by Python version over time
Top contributors
Downloads by system over time
Related packages
Downloads by country
File types by installer
Package | Downloads | Stars |
---|---|---|
Package | Downloads 5.4M | Stars 9.6K |
Package | Downloads 3.4M | Stars 7.1K |
Package | Downloads 1.5M | Stars 3.6K |
Package | Downloads 1M | Stars 46 |
Package | Downloads 724K | Stars 12K |
Package | Downloads 420K | Stars 0 |
Package | Downloads 250K | Stars 6.8K |
Package | Downloads 231K | Stars 66 |
Package | Downloads 222K | Stars 9.7K |