Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ the tests is in [docs/TESTING.md](docs/TESTING.md).

## Install

`v0.1.2` is the current release. Pick one path:
`v0.1.3` is the current release. Pick one path:

- **You already run vLLM:** install the plugin into that environment, below. This is the path tested most.
- **You want a container:** build the image from this repository, further below. It is
Expand All @@ -35,7 +35,7 @@ Prerequisites:

```bash
pip install "granite-switch[vllm]==0.1.1" "transformers>=5.16"
pip install "git+https://github.com/generative-computing/granite-switch-systemone@v0.1.2"
pip install "git+https://github.com/generative-computing/granite-switch-systemone@v0.1.3"
export VLLM_PLUGINS=register_granite_switch,granite_switch_systemone
export SYSTEMONE_INVOCATION_MARKER="### DECISION"
vllm serve ibm-granite/granite-switch-4.1-8b --served-model-name granite-switch \
Expand All @@ -53,7 +53,7 @@ with an NVIDIA GPU, the NVIDIA container toolkit and Docker:

```bash
# 1. Get the code at a release tag
git clone --branch v0.1.2 https://github.com/generative-computing/granite-switch-systemone
git clone --branch v0.1.3 https://github.com/generative-computing/granite-switch-systemone
cd granite-switch-systemone

# 2. Download the checkpoint (public, not gated; about 18 GB)
Expand Down
2 changes: 1 addition & 1 deletion pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"

[project]
name = "granite-switch-systemone"
version = "0.1.2"
version = "0.1.3"
description = "jev system-one (/v1/systemone) and OpenAI Decisions (/v1/decisions) APIs as vLLM endpoint plugins for granite-switch, mounted alongside /v1/chat/completions on the same server."
readme = "README.md"
# SPDX license expressions and license-files need setuptools 77.
Expand Down
2 changes: 1 addition & 1 deletion src/granite_switch_systemone/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -8,4 +8,4 @@
prompt convention); `plugin.py` itself has no knowledge of any specific adapter.
"""

__version__ = "0.1.2"
__version__ = "0.1.3"
Loading