GPUStack

An open-source GPU cluster manager for running large language models.

Developer ToolAI
Visit Website

Project Description

GPUStack allows you to create a unified cluster from any brand of GPUs in Apple MacBooks, Windows PCs, and Linux servers. Administrators can deploy LLMs from popular repositories such as Hugging Face. Developers can then access LLMs just as easily as accessing public LLM services from vendors like OpenAI or Microsoft Azure.

An open-source GPU cluster manager for running large language models.
Back to Home Page