Explore how ITS algorithms enhance model performance through computational scaling at inference time
Explore pre-loaded scenarios showing representative ITS improvements across different algorithms and providers.
Run live comparisons with your own questions and configurations against hosted models.
ITS is officially available in Red Hat OpenShift AI through the Red Hat AI Python Index — built and delivered by Red Hat, optimized for hardware accelerators, and tightly coupled to Red Hat AI Base Images for a secure, reliable AI supply chain.
Install the its_hub SDK directly in your RHOAI workbench. Base images are pre-configured to use the index — packages are built by Red Hat, tested for platform integrity, and optimized for CUDA, ROCm, and CPU.
pip install its_hub
Deploy models with the RHOAI vLLM serving runtime (Granite, Llama, etc.) and point its_hub at the serving endpoint. Fully on-cluster, no external API calls needed.
endpoint = "https://<model-route>/v1"
ITS will be integrated into the Red Hat AI Gateway, providing inference-time scaling as a managed service — no SDK installation required.
Red Hat AI Gateway — stay tuned
Compare baseline inference with ITS algorithms side by side