freellmapi
Run and use FreeLLMAPI, one OpenAI-compatible /v1 endpoint that stacks the free tiers of 34 LLM providers with automatic routing and failover. Use when the user wants free LLM inference, to point an OpenAI SDK, coding agent or other client at a free multi-provider endpoint, to self-host FreeLLMAPI with Docker, to pick a routing strategy such as auto:fast or auto:smart, or to fix a FreeLLMAPI setup problem.
- License 许可
- MIT
- 所属仓库
- siddu1004/SFP
- 最近更新
- 2026-11-09
- Stars
- ★ 5
- Forks
- 0
01 前言 Front Matter
- name
- freellmapi
- description
- Run and use FreeLLMAPI, one OpenAI-compatible /v1 endpoint that stacks the free tiers of 34 LLM providers with automatic routing and failover. Use when the user wants free LLM inference, to point an OpenAI SDK, coding agent or other client at a free multi-provider endpoint, to self-host FreeLLMAPI with Docker, to pick a routing strategy such as auto:fast or auto:smart, or to fix a FreeLLMAPI setup problem.
02 资源文件 6
- 参考文档reference/clients.md24.7 KB
- 参考文档reference/install.md20.7 KB
- 参考文档reference/rest-api.md28.7 KB
- 参考文档reference/troubleshooting.md4.1 KB
- 脚本scripts/app.json1.5 KB
- 脚本scripts/sfp_app.py10.1 KB
03 SKILL.md 正文
This skill needs FreeLLMAPI, which is installed separately. From this skill's folder, run
python3 scripts/sfp_app.py statusto see whether it is installed and running. If it is not, runpython3 scripts/sfp_app.py installto get the plan (it changes nothing), tell the user what it will do, and run it again with--yesonly after they agree.startruns it when it is installed but stopped.
FreeLLMAPI
FreeLLMAPI aggregates the free tiers of many LLM providers behind one OpenAI-compatible /v1 API. Provider keys are stored encrypted, and a router picks an available model and fails over when one is rate-limited.
The docs are bundled in reference/:
reference/install.md: Docker, Docker Compose, local development, LAN access, backupsreference/rest-api.md: endpoints, routing strategies, streaming, tools, vision, embeddings, the Anthropic Messages surfacereference/clients.md: coding agents and other clients, the config generator, the MCP serverreference/troubleshooting.md: common problems
Read the one that matches the task instead of all four.
Run it
With Docker installed, the project's one-liner sets up ~/freellmapi, generates an encryption key, pulls the image and starts the container (safe to re-run; it keeps your .env):
curl -fsSL https://freellmapi.co/install.sh | bash
Tell the user they can read the script first at that URL before piping it to bash. On Windows there is a desktop installer on the project's GitHub Releases page. Then:
- Open http://localhost:3001.
- Add provider keys on the Keys page, and reorder the Fallback Chain if wanted.
- Copy the unified API key from the Keys page header. Clients use that key, never the provider keys.
Use it
Point any OpenAI-compatible client at http://localhost:3001/v1 with the unified key:
from openai import OpenAI
client = OpenAI(base_url="http://localhost:3001/v1", api_key="freellmapi-your-unified-key")
resp = client.chat.completions.create(
model="auto", # or "auto:fast", "auto:smart", "auto:cheap", "auto:reliable", "auto:balanced", or a model id
messages=[{"role": "user", "content": "Hello"}],
)
model: "auto"lets the router pick.auto:fastfavors speed,auto:smartfavors the strongest models,auto:reliablefavors recent success rate,auto:balancedis the default blend.- The response header
x-routed-viasays which provider answered. - For a coding agent, use the project's generator described in
reference/clients.mdrather than hand-editing the agent's config.
Rules
- Keys go in the dashboard or environment, never in committed files.
- Free tiers have quotas and providers change them without notice. If requests fail, check the dashboard's logs and fallback chain before changing code.
- The project has paid options (a live model catalog). Mention them only if asked; the free install works without them.
- Verify commands against
reference/install.md, since install steps change between releases.
04 同仓库更多 Skills
scientific-schematics
Generates scientific diagram drafts using Nano Banana 2 AI with smart iterative refinement. Uses Gemini 3.7 Flash for quality review. Refines when the review requests improvement, with at most two generations. Specialized in neural network architectures, system diagrams, flowcharts, biological pathways, and complex scientific visualizations.
polyhaven-texture-apply
Apply realistic PBR textures from PolyHaven to any Blender object. Supports metals, wood, concrete, fabric, and more. Trigger when asked to texture an object, apply a material from PolyHaven, make something look like metal/wood/marble, or change object surface.
polyhaven-studio-setup
Set up a professional product photography studio in Blender using PolyHaven HDRIs and PBR ground materials. Trigger when asked to create a studio setup, add HDRI lighting, set up product photography, or create a showroom scene.
polyhaven-scene-builder
Build complete product scenes using PolyHaven assets — HDRI environment, textured ground/pedestal, and optional props from the 3D model library. Trigger when asked to build a product scene, create a showcase setup, add a pedestal, or compose a product shot.
polyhaven-material-swap
Cycle through multiple PolyHaven materials on a product and render each variant. Great for showing color/finish options. Trigger when asked to show material variants, swap textures, create color options, show finish comparisons, or render product in different materials.
polyhaven-hdri-showcase
Render the same product across multiple HDRI environments and output a comparison grid. Trigger when asked to compare lighting setups, test different environments, show product in multiple settings, or create an HDRI comparison.