Skip to content

feat: add FriendliAI serverless models and pricing - #1033

Open
Lee-Si-Yoon wants to merge 1 commit into
Portkey-AI:mainfrom
Lee-Si-Yoon:feat/friendli-serverless-models
Open

Lee-Si-Yoon wants to merge 1 commit into
Portkey-AI:mainfrom
Lee-Si-Yoon:feat/friendli-serverless-models

Conversation

@Lee-Si-Yoon

Copy link
Copy Markdown

Adds FriendliAI serverless models to general/ and pricing/. The data comes from the public catalog at https://api.friendli.ai/serverless/v1/models, which needs no auth.

This is a data-only replacement for #871. That PR also shipped a sync script, and its model list has gone stale since then.

Provider key friendli matches the gateway provider in Portkey-AI/gateway#1756.

Models (5)

Model Input ¢/tok Output ¢/tok Cache read ¢/tok max_tokens Supported
google/gemma-4-31B-it 0.000014 0.00004 – 262144 tools, image
zai-org/GLM-5.1 0.00014 0.00044 0.000026 202752 tools
zai-org/GLM-5.2 0.00014 0.00044 0.000026 1048576 tools
zai-org/GLM-5.3 0.000126 0.000396 0.0000234 1048576 tools
zai-org/GLM-5.3-Flash 0.000015 0.00005 0.000003 1048576 tools, image
  • The API reports prices in USD/token. They are multiplied by 100 to get cents/token.
  • The default pricing block uses the same cache-read-aware calculate as novita-ai / moonshot.
  • general defaults (temperature, top_p, top_k, min_p, repetition_penalty) come from the API's per-model default_params, which are the same for all 5 models. Min/max ranges are set only where Friendli's API spec documents them.

zai-org/GLM-5.1 has deprecation_date: 2026-11-20 in the catalog. I'll send a follow-up to remove it after that date.

Checks

  • eslint --ext .json and prettier --check (2.8.8) pass on the changed files
  • python3 scripts/check_duplicate_keys.py passes
  • A script compared every price, max_tokens and image flag against a live response from the API, and all of them match

Adds general/friendli.json and pricing/friendli.json for the 5 models
currently listed at https://api.friendli.ai/serverless/v1/models.
Prices converted from USD/token to cents/token (x100).
@Lee-Si-Yoon
Lee-Si-Yoon marked this pull request as ready for review November 14, 2026 07:07
Copilot AI balanced review requested due to automatic review settings November 14, 2026 07:07

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The FriendliAI catalog additions have no active review issues.

No open issues 🎉

What changed in this PR

Adds FriendliAI serverless support to the model catalog as a data-only replacement for #871, using the friendli provider key aligned with the gateway integration.

Changes:

  • Adds five models with parameter defaults, token limits, and tool/image capabilities.
  • Defines per-model pricing in cents per token, including cache-read rates and calculations.
  • Lists FriendliAI among the supported providers.
File Description
README.md Adds FriendliAI to the provider list.
pricing/​friendli.json Adds token pricing and cache-read-aware cost calculations.
general/​friendli.json Defines provider defaults and capabilities for five models.

Review effort: Balanced

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants