llm-d incubation

Popular repositories Loading

1. llm-d-infra llm-d-infra Public archive

   llm-d helm charts and deployment examples

   Go Template 59 56

2. llm-d-modelservice llm-d-modelservice Public

   helm charts for deploying models with llm-d

   Go Template 32 62

3. llm-d-planner llm-d-planner Public

   Python 28 13

4. llm-d-fast-model-actuation llm-d-fast-model-actuation Public

   Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping

   Go 17 21

5. py-inference-scheduler py-inference-scheduler Public

   Python based inference-scheduler for Reinforcement Learning

   Python 12 10

6. llm-d-rl-time-slicing llm-d-rl-time-slicing Public

   Go 10 9