inference-providers
Operate the TaskingAI inference microservice provider/model catalog, credential validation, chat completion, text embedding, rerank, provider icons, custom/local providers, proxy safety, and provider troubleshooting.
- License 许可
- Apache-2.0
- 最近更新
- 2026-10-08
- Stars
- ★ 11
- Forks
- 3
01 前言 Front Matter
- name
- inference-providers
- license
- Apache 2.0
- metadata
- { "disco-role": "operating" }
- description
- Operate the TaskingAI inference microservice provider/model catalog, credential validation, chat completion, text embedding, rerank, provider icons, custom/local providers, proxy safety, and provider troubleshooting.
- disable-model-invocation
- true
02 资源文件 4
- 参考文档references/api-reference.md13.0 KB
- 参考文档references/native-testing.md7.8 KB
- 参考文档references/provider-catalog.md12.0 KB
- 参考文档references/troubleshooting.md11.1 KB
03 SKILL.md 正文
TaskingAI Inference Providers
Use this sub-skill when a task is about TaskingAI's inference microservice: provider and model schema discovery, provider credentials, credential verification, chat completion, text embedding, rerank, provider icons, OpenAI-compatible/custom hosts, local model providers, proxy/URL blacklist behavior, or provider-specific failure diagnosis.
Load this first
- For provider/model selection, credential fields, wildcard schemas, local/custom-host choices, and catalog counts, read references/provider-catalog.md.
- For HTTP route contracts, request/response bodies, validation order, streaming, fallbacks, proxy/custom-header behavior, and icon routes, read references/api-reference.md.
- For source-backed native-test behavior, credential-sensitive checks, and safe skip criteria, read references/native-testing.md.
- For symptoms, likely causes, and recovery steps, especially
PROVIDER_ERRORversusREQUEST_VALIDATION_ERROR, read references/troubleshooting.md. - To inspect a user-supplied TaskingAI source tree without network calls or credentials, use scripts/inspect_inference_catalog.py.
Source-backed facts to preserve
- The verified inference catalog snapshot contains 35 provider directories.
- Model schema types are exactly
chat_completion,text_embedding,rerank, andwildcard. - Provider and model metadata are loaded from bundled YAML resources into runtime caches before route handlers use them.
- Static import probes passed in Python 3.10 for
APIRouter,Provider, andDebugChatCompletionModel. - Credential verification can be schema-only at provider level or can call a default chat, embedding, or rerank model depending on provider metadata.
Quick routing
- Backend object lifecycle, model-instance APIs exposed by the main backend, backend proxy endpoints, authentication, and database/API object semantics belong to
../backend-api/. - Deployment variables, container startup, service URLs, image tags, port wiring,
TASKINGAI_INFERENCE_URL, global outbound proxy setup, and storage configuration belong to../deployment-configuration/. - Plugin tool bundles, plugin vision/tool schemas, plugin execution, and plugin image generation belong to
../plugin-bundles/. - Stay here for provider catalog semantics, inference route payloads, credentials,
custom_host, Ollama/LM Studio/LocalAI, provider icons, and provider-specific troubleshooting.
Operating workflow
- Classify the requested model capability. Use
chat_completion,text_embedding,rerank, orwildcard; do not assume a wildcard schema has enough information withoutprovider_model_id,model_type, and any requiredproperties. - Choose the provider path. Use provider selection guidance for hosted providers, hosted OpenAI-compatible routers,
custom_host, and local OpenAI-compatible servers. - Validate credentials before invocation. Compare the request to the provider
credentials_schema; pass either plaintextcredentialsorencrypted_credentials, never both. Use credential validation semantics when the user needs encrypted credentials for later reuse. - Build the inference payload. Use chat completion, text embedding, or rerank contracts. Check model properties and configs before provider calls.
- Handle proxy and URL safety deliberately. Request-level
proxyvalues must be HTTPS and are rejected if they contain a configured provider URL blacklist entry.custom_hostendpoint URLs are checked against the same blacklist before a provider call. - Diagnose by error class. Treat schema/model/property/proxy failures as request validation first. Treat upstream HTTP/API/auth/quota failures as provider failures. Use troubleshooting before retrying with new credentials.
Hard usability cases covered here
- Choose between
custom_host, Ollama/LM Studio/LocalAI, OpenRouter, and a named hosted provider for an OpenAI-compatible user task while preserving the difference between actual provider model IDs and TaskingAI model schema IDs. - Diagnose
PROVIDER_ERRORversusREQUEST_VALIDATION_ERRORduring credential validation by separating local schema/model/proxy checks from upstream provider responses.
04 同仓库更多 Skills
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
obsidian-clipper-template-creator
Guide for creating templates for the Obsidian Web Clipper. Use when you want to create a new clipping template, understand available variables, or format clipped content.
python-api
Programmatic Object-Detection-Metrics API guidance for BoundingBox, BoundingBoxes, Evaluator, enums, coordinate conversion, AP/mAP semantics, and source-style import diagnostics.
file-evaluation
Folder-based PASCAL VOC AP/mAP evaluation from ground-truth and detection text files.
object-detection-metrics
Guides legacy Object-Detection-Metrics PASCAL VOC AP/mAP evaluation from detection text folders and direct Python API classes.
nx-workspace-patterns
Configure and optimize Nx monorepo workspaces. Use when setting up Nx, configuring project boundaries, optimizing build caching, or implementing affected commands.