Using models with... Innovation Release
This documentation covers the current Innovation Release of
EDB Postgres AI. See also:
- Hybrid Manager dual release strategy
- Documentation for the current Long-term support release
This section describes some particular ways to use models with AI Accelerator Pipelines. These techniques show how to use API-compatible services, running locally or in the cloud, with Pipelines and how to make use of NVIDIA NIM.
- OpenAI API-compatible services with Pipelines.
- NVIDIA NIM Microservices with Pipelines.
OpenAI-compatible models
Using an OpenAI-compatible API with Pipelines by setting options and credentials.
NVIDIA NIM Microservices
How to use NVIDIA NIM microservices available on build.nvidia.com, with AI Accelerator Pipelines.