Scale API | Model Servers › Fixed Server Interface For Model Execution

Model Servers

model_servers

Methods

Create A New Model Server ->

ModelServerInfo

post/v4/serving

Create a new Model Server

Fixed Server Interface For Model Execution ->

GenericModelResponse

post/v4/serving/{model_server_id}/execute

Fixed Server interface for Model execution

Security

API Key Header

Example: x-api-key: My API Key

Parameters

model_server_id: string

Response fields

GenericModelResponse

Request example

curl https://api.egp.scale.com/v4/serving/$MODEL_SERVER_ID/execute \
    -H 'Content-Type: application/json' \
    -H "x-api-key: $SGP_API_KEY" \
    -d '{}'

200Example

{
  "error_message": "error_message",
  "status": "status",
  "status_code": 0
}

Fixed Server Interface For Model Execution By Named Alias -> TopLevelArray<

ModelServerInfo

get/v4/serving

Fixed Server interface for Model execution by named alias

Fixed Server Interface For Model Execution By Named Alias ->

ModelServerInfo

get/v4/serving/{model_server_id}

Fixed Server interface for Model execution by named alias

Rollback Backend Of The Model Server -> { from_deployment, rolled_back_to_deployment }

post/v4/serving/{model_server_id}/rollback

Rollback backend of the Model Server

Change Backend Of The Model Server -> { account_id, model_deployment_id, model_server_id, 4 more... }

put/v4/serving/{model_server_id}/backend

Change backend of the Model Server

Model Servers

Deployment

model_servers.deployment

Methods

Get Current Deployment Of The Model Server -> { model_deployment_id }

get/v4/serving/{model_server_id}/deployment

Get current deployment of the Model Server