Machine Learning Models

Removed in v2.2: Support for loading and serving traditional machine learning (ONNX) models for inference was removed in v2.2, along with the /v1/predict and /v1/models/{name}/predict prediction endpoints. See the v2.1 docs for documentation of this feature.

Spice no longer loads or serves traditional machine learning (ONNX) models. The Models component now serves large language models (LLMs) only.

For LLM configuration and usage, see Large Language Models.