hopper-transcribe
Transcribe speech in an audio or video file with Hopper speech-to-text (Nemotron ASR), with word timestamps. Takes WAV, MP3, M4A, voice memos and video such as MP4 or MOV (decoded with ffmpeg). Needs no setup: the first use registers a key for the agent itself. Use when the user says "transcribe this", "what does this recording say", "check my video", "what's said in this video", "review the voiceover in my launch video", "captions for my video", "subtitles", "caption this", "meeting notes from this recording", "summarize this call", "pull quotes from this interview", "speech to text" or "STT". Works from the spoken words only, not the visuals. Not for generating audio (hopper-speak) or running an LLM (hopper-try).
- License 许可
- MIT
- 最近更新
- 2026-10-28
- Stars
- ★ 0
- Forks
- 0
01 前言 Front Matter
- name
- hopper-transcribe
- description
- Transcribe speech in an audio or video file with Hopper speech-to-text (Nemotron ASR), with word timestamps. Takes WAV, MP3, M4A, voice memos and video such as MP4 or MOV (decoded with ffmpeg). Needs no setup: the first use registers a key for the agent itself. Use when the user says "transcribe this", "what does this recording say", "check my video", "what's said in this video", "review the voiceover in my launch video", "captions for my video", "subtitles", "caption this", "meeting notes from this recording", "summarize this call", "pull quotes from this interview", "speech to text" or "STT". Works from the spoken words only, not the visuals. Not for generating audio (hopper-speak) or running an LLM (hopper-try).
- allowed-tools
- Bash(python3 ${CLAUDE_SKILL_DIR}/scripts/hopper_voice.py *)
02 资源文件 2
- 参考文档agents/openai.yaml215 B
- 脚本scripts/hopper_voice.py19.6 KB
03 SKILL.md 正文
Transcribe with Hopper
Pick the path first. In ChatGPT, or wherever the shell can't reach Hopper's API, use the Hopper connector's transcribe tool: pass an attached file as it is (audio_file), or a public URL. ChatGPT's sandbox can't resolve Hopper's domains, so the script fails there. Where you can run commands with network access (Codex CLI, Claude Code), use this skill's script instead: it reads files on this machine directly, in any format, and uses this agent's own Hopper key, so its usage can move to the user's account later.
${CLAUDE_SKILL_DIR} is the folder holding this file (if your host doesn't fill it in, use that folder's absolute path). The script needs network access to withhopper.com and api.withhopper.com, and writes the agent's key to ~/.config/hopper/. In a sandbox (Codex), request escalated permissions for the first command, with the reason "Use Hopper transcription: create this agent's own Hopper key and transcribe the audio (network to withhopper.com; writes ~/.config/hopper)", and suggest allowing commands that start with python3 and this script's path so later calls don't ask again. Exit code 3 (HOPPER_SANDBOX_BLOCKED) means the sandbox blocked it: rerun the same command with escalation. If the user declines, say Hopper couldn't run and ask how to continue; don't switch to another tool silently. Explicit instructions from the user override these steps.
Transcribe
python3 ${CLAUDE_SKILL_DIR}/scripts/hopper_voice.py transcribe path/to/recording.m4a # plain text
python3 ${CLAUDE_SKILL_DIR}/scripts/hopper_voice.py transcribe call.wav --json # text, words with start/end seconds
- Formats: 16-bit mono WAV goes up as is. Anything else (MP3, M4A, AIFF, FLAC, MP4, MOV) is decoded with
ffmpeg; if it's missing, tell the user the one install command the script prints. - Length: long recordings are split into uploads under the 25 MB limit and the timestamps are joined back, so any length works; it's about $0.05 per hour of audio.
- A URL: download it to a temp file first, then transcribe the file.
- Output: answer what the user asked (a summary, action items, a quote) from the transcript, and quote it exactly when they want exact words. Use
--jsonfor captions, timestamps or who-said-when questions. The model writes lowercase text without punctuation, English only, and can mishear names and brands: say so when a name matters. no speech detectedmeans the file has no audible speech, not an error.
Key
The first run with no HOPPER_API_KEY (environment or the project's .env) registers a key for the agent itself with a small trial credit (no sign-up, agent registration) and saves it to ~/.config/hopper/credentials.json, mode 600. Never print it or copy it into the project. status says where the key comes from without showing it.
To move it to the user's account, see the next section.
When the trial credit runs low
The agent's own key starts with a small trial credit. When it runs low the script prints HOPPER_HANDOVER low_credit (exit 0), and when it runs out, HOPPER_HANDOVER out_of_credit (exit 4). Either way:
- Tell the user once, in a line or two, what Hopper has done for this task (the
used=text) and that the agent's Hopper key is running low, and offer to keep it on their own Hopper account. Don't mention it again in the same task if they decline. - If they agree, confirm their email (
git config user.emailis a good guess) and runclaim <email> --no-wait. Show the link and the 6-digit code; the user enters the code on withhopper.com, never in this chat. - Run
claim <email>to wait. When it printsClaimed, carry on: the script uses the account key from then on, with the same history.
In an application's code
To add Hopper speech-to-text (Nemotron ASR) to an application, follow https://docs.withhopper.com/stt: POST https://api.withhopper.com/v1/audio/transcriptions (model: nemotron-asr, 16-bit PCM or WAV) for files, or the WebSocket stream for live audio.
04 同仓库更多 Skills
hopper-try
Tests DeepSeek V4.1 Flash and Gemma 4 31B on the user's own prompts: finds real prompts in the project or chat, runs both side by side with time to first token, tokens per second and cost, and gives a verdict per example. Changes no code. Use when asked "there's a new DeepSeek model, how is it? test it for my use case", "DeepSeek V4.1 Flash any good? try it on my prompts", "is Gemma 4 worth trying for this", "give the new DeepSeek a vibe check", "try this prompt on a few open models", "run our real prompts through DeepSeek", "gemma 4 vs deepseek for this, which one?", "could an open model replace GPT-4.1 here", "is DeepSeek a drop-in replacement for OpenAI here", "worth switching to an open model?", "does DeepSeek handle our function calls reliably", "check if Gemma returns valid JSON for our schema" or "try Hopper". Not for testing their code, comparing files, writing prompts, running models locally (Ollama), fine-tuning or published benchmark scores; to switch the project's model, use hopper-integrate.
hopper-speak
Turn text into speech with Hopper text-to-speech (Qwen 3 TTS): play it aloud, save a WAV file, or preview and pick a voice. Needs no setup: the first use registers a key for the agent itself. Use when the user says "read this aloud", "say this out loud", "generate a voiceover", "voiceover for my launch video", "audio for my launch video", "narrate this script", "narration for my demo video", "make a podcast intro", "record an announcement", "voice for my ad", "make an audio file of…", "text to speech", "TTS" or "which voice should I use". Makes the speech track only, not video, music or sound effects. Not for writing a script (plain text), transcribing audio (hopper-transcribe) or running an LLM (hopper-try).
hopper-integrate
Points a project's LLM calls at a Hopper model (DeepSeek V4.1 Flash or Gemma 4 31B) through Hopper's OpenAI-compatible API: OpenAI SDK (Python or JavaScript), LangChain, Vercel AI SDK, LiteLLM, raw HTTP, LiveKit Agents, Pipecat or Vapi. Gets the project a key, shows the planned change (and, for a voice agent, time to first token on its own prompt), and edits code only after the user says go. Use when the user says "switch this app to DeepSeek on Hopper", "swap the LLM for Gemma 4", "move our OpenAI calls to Hopper", "point base_url at Hopper", "set up Hopper in this project", "add a Hopper API key to this repo" or "go ahead" after a hopper-try comparison. Not for trying or comparing models before deciding (hopper-try), speech or transcription (hopper-speak, hopper-transcribe), or running models locally.
hopper-announce
Change how Claude Code announces finished tasks out loud (the hopper-announce plugin): turn announcements off or on, pick another voice, make them shorter, or announce only tasks that take longer. Use when the user says "stop announcing", "be quiet when you finish", "use a different voice for announcements", "only tell me about long tasks" or "turn spoken updates back on".
hopper-try
Tests DeepSeek V4.1 Flash and Gemma 4 31B on the user's own prompts: finds real prompts in the project or chat, runs both side by side with time to first token, tokens per second and cost, and gives a verdict per example. Changes no code. Use when asked "there's a new DeepSeek model, how is it? test it for my use case", "DeepSeek V4.1 Flash any good? try it on my prompts", "is Gemma 4 worth trying for this", "give the new DeepSeek a vibe check", "try this prompt on a few open models", "run our real prompts through DeepSeek", "gemma 4 vs deepseek for this, which one?", "could an open model replace GPT-4.1 here", "is DeepSeek a drop-in replacement for OpenAI here", "worth switching to an open model?", "does DeepSeek handle our function calls reliably", "check if Gemma returns valid JSON for our schema" or "try Hopper". Not for testing their code, comparing files, writing prompts, running models locally (Ollama), fine-tuning or published benchmark scores; to switch the project's model, use hopper-integrate.
hopper-transcribe
Transcribe speech in an audio or video file with Hopper speech-to-text (Nemotron ASR), with word timestamps. Takes WAV, MP3, M4A, voice memos and video such as MP4 or MOV (decoded with ffmpeg). Needs no setup: the first use registers a key for the agent itself. Use when the user says "transcribe this", "what does this recording say", "check my video", "what's said in this video", "review the voiceover in my launch video", "captions for my video", "subtitles", "caption this", "meeting notes from this recording", "summarize this call", "pull quotes from this interview", "speech to text" or "STT". Works from the spoken words only, not the visuals. Not for running an LLM (hopper-try).