Configuration Requirements

  • Target Service: Hugging Face Serverless Inference API.
  • Model Compatibility: Requires models with defined chat templates to ensure correct formatting and responses.

Setup

  1. Obtain a Hugging Face API token.
  2. Configure the integration in Settings.
  3. Select the desired model. The model selection can be updated at any time.