GridCore

GridCore is a scheduler that enables several local large language models to share a single GPU. It manages resource allocation and concurrent access to GPU resources, allowing multiple LLM instances to operate on the same hardware without requiring separate GPUs for each model.