Pipelines models reference

This reference documentation for EDB Postgres AI - AI Accelerator Pipelines models includes information on the functions and views available in the aidb extension for working with models.

Tables

aidb.model_providers

The aidb.model_providers table stores information about the model providers that are available.

aidb.models

Returns a list of all models in the registry and their configured options, including predefined models and user-created models.

Example

SELECT * FROM aidb.models;

 name  |  provider  |    options
-------+------------+---------------
 bert  | bert_local | {"config={}"}
 clip  | clip_local | {"config={}"}
 t5    | t5_local   | {"config={}"}

Functions

aidb.create_model

Creates a new model in the system by saving its name, provider, and optional configuration.

Parameters

Example

SELECT aidb.create_model(
               name => 'my_t5'::text,
               provider => 't5_local'::character varying,
               config => '{"param1": "value1", "param2": "value2"}'::jsonb,
               credentials => '{"token": "abcd"}'::jsonb
           );

or equivalently, using default values:

SELECT aidb.create_model('my_t5', 't5_local');

or if updating the credentials of a model's provider, which has already been created.

SELECT aidb.create_model(
               name => 'my_t5'::text,
               provider => 't5_local'::character varying,
               config => '{"param1": "value1", "param2": "value2"}'::jsonb,
               credentials => '{"token": "abcd"}'::jsonb,
               replace_credentials => true
           );

TLS Configuration (optional)

To securely connect to HTTPS-based model endpoints, the config object can include a tls_config field:

"tls_config": {
  "insecure_skip_verify": true,  // (optional) disables certificate validation
  "ca_path": "/etc/aidb/myCA.pem"  // (optional) path to a trusted CA certificate
}

aidb.get_model

Returns the configuration for a model in the registry.

Parameters

Returns

Example

SELECT * FROM aidb.get_model('t5');

 name | provider |    options
------+----------+---------------
 t5   | t5_local | {"config={}"}
(1 row)

aidb.delete_model

Deletes a model from the registry.

Parameters

Example

SELECT aidb.delete_model('t5');

     delete_model
---------------------------------
 (t5,t5_local,"{""config={}""}")
(1 row)

Returns

aidb.list_hcp_models

Gets models running on the hybrid control plane.

Returns

Example

SELECT * FROM  aidb.get_hcp_models();
                 name                  |                                       url                                        |               model                
---------------------------------------+----------------------------------------------------------------------------------+------------------------------------
 llama-3-1-8b-instruct-1xgpu-g6        | http://llama-3-1-8b-instruct-1xgpu-g6-predictor.default.svc.cluster.local        | meta/llama-3.1-8b-instruct
 llama-3-2-nv-embedqa-1b-v2            | http://llama-3-2-nv-embedqa-1b-v2-predictor.default.svc.cluster.local            | nvidia/llama-3.2-nv-embedqa-1b-v2
 meta-nim-llama3-70b-instruct-8xgpu-g5 | http://meta-nim-llama3-70b-instruct-8xgpu-g5-predictor.default.svc.cluster.local | meta/llama3-70b-instruct
(3 rows)

aidb.create_hcp_model

Creates a new model in the system by referencing a running instance in the HCP

Parameters

aidb.sync_hcp_models

Creates models in the HCP and sets is_hcp_model=true; deletes models with that setting if not found in the HCP.

Returns

aidb.encode_text

Encodes text using a model, generating a vector representation of a given text input.

Parameters

aidb.encode_text_batch

Encodes a batch of text using a model, generating a vector representation of a given text input.

Parameters

aidb.decode_text

Decodes text using a model, generating a vector representation of a given text input.

Parameters

Returns

aidb.decode_text_batch

Decodes a batch of text using a model, generating a representation of a given text input.

Parameters

Returns

aidb.encode_image

Encodes an image using a model, generating a vector representation of a given image input.

Parameters

Returns

aidb.rerank_text

Reranks text using a model, generating a vector representation of a given text input.

Parameters

Returns