Using models with... Innovation Release
This documentation covers the current Innovation Release of
EDB Postgres AI. You may also want the docs for the current LTS version.
This section describes some particular ways to use models with AI Accelerator Pipelines. These techniques show how to use API-compatible services, running locally or in the cloud, with Pipelines and how to make use of NVIDIA NIM.
- OpenAI API-compatible services with Pipelines.
- NVIDIA NIM Microservices with Pipelines.
OpenAI-compatible models
Using an OpenAI-compatible API with Pipelines by setting options and credentials.
NVIDIA NIM Microservices
How to use NVIDIA NIM microservices available on build.nvidia.com, with AI Accelerator Pipelines.