Using models with...
This section describes some particular ways to use models with AI Accelerator Pipelines. These techniques show how to use API-compatible services, running locally or in the cloud, with Pipelines and how to make use of NVIDIA NIM.
- OpenAI API-compatible services with Pipelines.
- NVIDIA NIM Microservices with Pipelines.
OpenAI-compatible models
Using an OpenAI-compatible API with Pipelines by setting options and credentials.
NVIDIA NIM Microservices
How to use NVIDIA NIM microservices available on build.nvidia.com, with AI Accelerator Pipelines.
← Prev
Model Serving Quickstart
↑ Up
Pipelines models
Next →
Using an OpenAI-compatible API with Pipelines
Could this page be better? Report a problem or suggest an addition!