💄 style: add `ModelFetcher` for supported provider #5316

hezhijie0327 · 2025-01-06T15:11:26Z

💻 变更类型 | Change Type

🔀 变更说明 | Description of Change

补齐所有支持从 v1/models 或自定义 Endpoint 获取模型列表的提供商
移除不支持/暂无适配模型列表的供应商配置中的 showModelFetcher

azureOpenai, bedrock, hunyuan, minimax, perplexity, spark, taichu, upstage, wenxin

更新 Ai360, Taichu, GiteeAI, Zhipu, Upstage 默认模型列表，适配 aiModels
加入 2025-01-15 发布的 MiniMax-Text-01 模型 MiniMax-Text-01
加入 2025-01-14 发布的 moonshot-v1-8k-vision-preview 视觉模型，并适配 vision 标签使用 Kimi 视觉模型（Vision）

📝 补充信息 | Additional Information

提供商	提供商	提供商
Ai360	DeepSeek	InternLM
Moonshot	Stepfun	ZeroOne
Qwen	Groq	Mistral
FireworksAI	GiteeAI	SiliconCloud
Baichuan	SenseNova	Zhipu
Anthropic	Google	HuggingFace

vercel · 2025-01-06T15:11:30Z

@hezhijie0327 is attempting to deploy a commit to the LobeHub Team on Vercel.

A member of the Team first needs to authorize it.

lobehubbot · 2025-01-06T15:11:38Z

👍 @hezhijie0327

Thank you for raising your pull request and contributing to our Community
Please make sure you have followed our contributing guidelines. We will review it as soon as possible.
If you encounter any problems, please feel free to connect with us.
非常感谢您提出拉取请求并为我们的社区做出贡献，请确保您已经遵循了我们的贡献指南，我们会尽快审查它。
如果您遇到任何问题，请随时与我们联系。

codecov · 2025-01-06T15:16:48Z

Codecov Report

Attention: Patch coverage is 64.17556% with 302 lines in your changes missing coverage. Please review.

Project coverage is 92.15%. Comparing base (b4a160b) to head (2139cb6).
Report is 2 commits behind head on main.

Files with missing lines	Patch %	Lines
src/libs/agent-runtime/huggingface/index.ts	24.32%	28 Missing ⚠️
src/libs/agent-runtime/siliconcloud/index.ts	26.47%	25 Missing ⚠️
src/libs/agent-runtime/anthropic/index.ts	33.33%	24 Missing ⚠️
src/libs/agent-runtime/google/index.ts	42.50%	23 Missing ⚠️
src/libs/agent-runtime/sensenova/index.ts	28.57%	20 Missing ⚠️
src/libs/agent-runtime/giteeai/index.ts	32.14%	19 Missing ⚠️
src/libs/agent-runtime/groq/index.ts	34.48%	19 Missing ⚠️
src/libs/agent-runtime/zhipu/index.ts	45.71%	19 Missing ⚠️
src/libs/agent-runtime/baichuan/index.ts	42.85%	16 Missing ⚠️
src/libs/agent-runtime/qwen/index.ts	36.00%	16 Missing ⚠️
... and 10 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #5316      +/-   ##
==========================================
- Coverage   92.59%   92.15%   -0.45%     
==========================================
  Files         642      642              
  Lines       56124    56824     +700     
  Branches     2693     4243    +1550     
==========================================
+ Hits        51966    52364     +398     
- Misses       4158     4460     +302

Flag	Coverage Δ
app	`92.15% <64.17%> (-0.45%)`	⬇️
server	`97.99% <ø> (ø)`

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

arvinxx · 2025-01-06T16:19:39Z

等 #5158 合并后再提 PR 哈，近期不再接受现有的 provider 变更的PR。等 #5158 合并后再提~

lobehubbot · 2025-01-06T16:19:51Z

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

Wait until #5158 is merged before submitting a PR. PRs for existing provider changes will no longer be accepted in the near future. Will mention it again after #5158 is merged~

This reverts commit 049662d.

hezhijie0327 · 2025-01-08T14:32:31Z

@arvinxx 改造好了，理论上所有能适配的，都支持自动获取模型列表了～

lobehubbot · 2025-01-08T14:32:43Z

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

@arvinxx The transformation has been completed. In theory, everything that can be adapted supports automatically obtaining the model list~

vercel · 2025-01-14T17:18:48Z

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated (UTC)
lobe-chat-database	✅ Ready (Inspect)	Visit Preview	Jan 15, 2025 4:02am

arvinxx

LOBE_DEFAULT_MODEL_LIST 需要从 aiModels 引入，后续 modelProviders 里的这个变量会被删除

hezhijie0327 · 2025-01-14T23:17:08Z

LOBE_DEFAULT_MODEL_LIST 需要从 aiModels 引入，后续 modelProviders 里的这个变量会被删除

全部切换到 @/config/aiModels 了

lobehubbot · 2025-01-14T23:17:20Z

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

LOBE_DEFAULT_MODEL_LIST needs to be imported from aiModels, and this variable in modelProviders will be deleted later.

All switched to @/config/aiModels

arvinxx · 2025-01-15T02:14:26Z

src/libs/agent-runtime/utils/openaiCompatibleFactory/index.ts

@@ -3,7 +3,7 @@ import utc from 'dayjs/plugin/utc';
 import OpenAI, { ClientOptions } from 'openai';
 import { Stream } from 'openai/streaming';

-import { LOBE_DEFAULT_MODEL_LIST } from '@/config/modelProviders';


这里先不改，需要兼容原有实现，等V2再改

arvinxx

原有使用 LOBE_DEFAULT_MODEL_LIST 的地方需要保持现状，用以兼容旧版实现。所有新增都走 aiModels

hezhijie0327 · 2025-01-15T02:23:15Z

原有使用 LOBE_DEFAULT_MODEL_LIST 的地方需要保持现状，用以兼容旧版实现。所有新增都走 aiModels

好了，已回退

lobehubbot · 2025-01-15T02:23:28Z

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

The original use of LOBE_DEFAULT_MODEL_LIST needs to remain current to be compatible with older implementations. All new additions go to aiModels

OK, rolled back

hezhijie0327 · 2025-01-15T03:16:54Z

Kimi 刚发了视觉模型，稍后加个视觉模型判定，~~已能拿到模型信息但缺少vision标签~~ 已适配

Before	After

* Update moonshot.ts * Update index.ts * Update moonshot.ts

💄 style: add ModelFetcher for supported provider

c84e84f

dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Jan 6, 2025

dosubot bot added the 💄 Design Design an style | 样式问题 label Jan 6, 2025

hezhijie0327 added 4 commits January 7, 2025 12:56

💄 style: add Mistral ModelFetcher support

ec83218

💄 style: add glm-zero-preview model for Zhipu

b7e67c8

💄 style: add more supported providers

e056ce7

💄 style: add SenseNova & Baichuan support with custom models endpoint

4757282

dosubot bot added size:XL This PR changes 500-999 lines, ignoring generated files. and removed size:L This PR changes 100-499 lines, ignoring generated files. labels Jan 7, 2025

hezhijie0327 added 10 commits January 7, 2025 23:47

🐛 fix: fix fc keyword typo, should lowercase

18e0395

Merge branch 'lobehub:main' into fetchModels

b429652

💄 style: update aiModels list

7fb95a0

♻️ refactor: use aiModels sheme

049662d

Revert "♻️ refactor: use aiModels sheme" (#252)

f27b46b

This reverts commit 049662d.

🐛 fix: fix firefunction series not set as functionCall

7fb875d

💄 style: add Zhipu FetchModel support

80a1c4c

💄 style: add Anthropic FetchModel support

41eb03a

💄 style: add Google ModelFetch support

adb7234

Merge branch 'main' into fetchModels

de09627

hezhijie0327 added 2 commits January 13, 2025 22:02

💄 style: add HuggingFace ModelFetch support

98ed8d7

🐛 fix: fix stepfun fc tag

20b6324

arvinxx requested changes Jan 14, 2025

View reviewed changes

vercel bot temporarily deployed to Preview – lobe-chat-database January 14, 2025 17:32 Inactive

hezhijie0327 added 2 commits January 15, 2025 06:40

♻️ refactor: refactor LOBE_DEFAULT_MODEL_LIST import

10155f6

Merge branch 'main' into fetchModels

3b9a390

arvinxx reviewed Jan 15, 2025

View reviewed changes

🔨 chore: revert some changes

8e73626

Merge branch 'main' into fetchModels

ab0827f

hezhijie0327 added 3 commits January 15, 2025 10:30

🐛 fix: fix aiModels import

a448c61

🐛 fix: fix CI error

48a70c5

💄 style: add MiniMax-Text-01

d6fd159

💄 style: add vision model support for Moonshot

c71e673

* Update moonshot.ts * Update index.ts * Update moonshot.ts

vercel bot deployed to Preview – lobe-chat-database January 15, 2025 04:02 View deployment

hezhijie0327 added 2 commits January 17, 2025 06:12

Merge branch 'main' into fetchModels

f244702

Merge branch 'main' into fetchModels

2139cb6

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

💄 style: add `ModelFetcher` for supported provider #5316

💄 style: add `ModelFetcher` for supported provider #5316

hezhijie0327 commented Jan 6, 2025 •

edited

Loading

vercel bot commented Jan 6, 2025

lobehubbot commented Jan 6, 2025

codecov bot commented Jan 6, 2025 •

edited

Loading

arvinxx commented Jan 6, 2025

lobehubbot commented Jan 6, 2025

hezhijie0327 commented Jan 8, 2025

lobehubbot commented Jan 8, 2025

vercel bot commented Jan 14, 2025 •

edited

Loading

arvinxx left a comment •

edited

Loading

hezhijie0327 commented Jan 14, 2025

lobehubbot commented Jan 14, 2025

arvinxx Jan 15, 2025

hezhijie0327 Jan 15, 2025

arvinxx left a comment

hezhijie0327 commented Jan 15, 2025

lobehubbot commented Jan 15, 2025

hezhijie0327 commented Jan 15, 2025 •

edited

Loading

💄 style: add ModelFetcher for supported provider #5316

Are you sure you want to change the base?

💄 style: add ModelFetcher for supported provider #5316

Conversation

hezhijie0327 commented Jan 6, 2025 • edited Loading

💻 变更类型 | Change Type

🔀 变更说明 | Description of Change

📝 补充信息 | Additional Information

vercel bot commented Jan 6, 2025

lobehubbot commented Jan 6, 2025

codecov bot commented Jan 6, 2025 • edited Loading

Codecov Report

arvinxx commented Jan 6, 2025

lobehubbot commented Jan 6, 2025

hezhijie0327 commented Jan 8, 2025

lobehubbot commented Jan 8, 2025

vercel bot commented Jan 14, 2025 • edited Loading

arvinxx left a comment • edited Loading

Choose a reason for hiding this comment

hezhijie0327 commented Jan 14, 2025

lobehubbot commented Jan 14, 2025

arvinxx Jan 15, 2025

Choose a reason for hiding this comment

hezhijie0327 Jan 15, 2025

Choose a reason for hiding this comment

arvinxx left a comment

Choose a reason for hiding this comment

hezhijie0327 commented Jan 15, 2025

lobehubbot commented Jan 15, 2025

hezhijie0327 commented Jan 15, 2025 • edited Loading

💄 style: add `ModelFetcher` for supported provider #5316

💄 style: add `ModelFetcher` for supported provider #5316

hezhijie0327 commented Jan 6, 2025 •

edited

Loading

codecov bot commented Jan 6, 2025 •

edited

Loading

vercel bot commented Jan 14, 2025 •

edited

Loading

arvinxx left a comment •

edited

Loading

hezhijie0327 commented Jan 15, 2025 •

edited

Loading