[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"skill:01M7ASW7TZYC5N7ZGK67BY3C44":3,"skill-same:01M7ASW7TZYC5N7ZGK67BY3C44":48},{"skillNo":4,"name":5,"nameZh":6,"description":7,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":16,"categories":17,"keywords":18,"publishedAt":19,"linkOnly":20,"markdownContent":21,"markdownBody":22,"frontMatter":23,"refName":24,"commitSha":25,"skillDirectory":26,"forksCount":27,"repositoryHtmlUrl":28,"repositoryHomepageUrl":29,"ownerHtmlUrl":30,"ownerBlogUrl":31,"ownerDescription":32,"updatedAt":33,"install":34,"resources":47},"01M7ASW7TZYC5N7ZGK67BY3C44","scraping-scale-reliability-and-data-quality",null,"Use when a scraper has to run reliably and produce trustworthy data: scale and reliability engineering (concurrency, rate limiting, retries and backoff, proxies, scheduling), data quality and validation against the silent breakage that produces plausible-looking wrong data for months, and storage, pipelines and operations including deduplication, change detection and monitoring.","the-vibey-project\u002Fvibey","the-vibey-project","https:\u002F\u002Favatars.githubusercontent.com\u002Fu\u002F329298758?v=4","01M7AJHGZ9722CTJ4JNQZVRH0Q","the vibey project","01M7AJHGZVMG2K7TGXQ6XFHVG3",5,"MIT","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fweb-scraping\u002Fskills\u002Fscraping-scale-reliability-and-data-quality\u002FSKILL.md",[],[],"2026-11-15 14:19:17",false,"---\nname: scraping-scale-reliability-and-data-quality\ndescription: \"Use when a scraper has to run reliably and produce trustworthy data: scale and reliability engineering (concurrency, rate limiting, retries and backoff, proxies, scheduling), data quality and validation against the silent breakage that produces plausible-looking wrong data for months, and storage, pipelines and operations including deduplication, change detection and monitoring.\"\n---\n\n# Web Scraping: Scale and Reliability, Data Quality, and Storage and Operations\n\n> **Part 3 of 5** of the *Web Scraping* reference (plugin `web-scraping`), covering §8–§10. Sibling skills: `scraping-legal-landscape-and-permissions` (§0–§3), `scraping-tooling-extraction-and-blocking` (§4–§7), `scraping-ethics-ai-corpora-and-site-defense` (§11–§13), `scraping-reference` (§14–§19). Section numbers are shared across the set; a reference written as §N → `skill` points into that sibling skill.\n>\n> **Currency:** Verified August 2026. See §16 → `scraping-reference` for the currency snapshot and what goes stale first.\n\n> **How to read this.** Reference, not tutorial. Three markers:\n> - **[DURABLE]** — how HTTP and the web work, engineering practice, or ethics. Doesn't expire.\n> - **[VERSIONED]** — case law, regulation, tooling, platform behaviour. **This domain's\n>   legal layer is moving faster than its technical layer right now.** Verify.\n> - **[CONTESTED]** — genuine disagreement.\n>\n> **⚠️ GOTCHA** boxes mark the mistakes that get you blocked, sued, or quietly producing\n> wrong data for months.\n>\n> **This is not legal advice.** §1 → `scraping-legal-landscape-and-permissions` is a map of the frameworks that apply and the questions\n> to put to counsel, not an answer for your jurisdiction or your use case. **The legal\n> position depends heavily on what data, from where, about whom, and for what purpose** —\n> and those four variables move the answer more than any technical choice you make.\n>\n> **The three framings that organize everything below:**\n> 1. **The legal question is not \"is scraping legal.\" It is four separate questions** —\n>    *how did you access it* (computer-access law), *what did you agree to* (contract),\n>    *what is the data* (copyright, personal data), and *what will you do with it*\n>    (privacy, AI training, resale). **They have different answers and you need all four**\n>    (§1 → `scraping-legal-landscape-and-permissions`).\n> 2. **You are a guest on someone else's infrastructure, and they're paying for it.**\n>    Nearly every operational rule in this document — rate limiting, caching, conditional\n>    requests, off-peak scheduling — follows from taking that seriously, and doing so also\n>    happens to be what keeps you unblocked (§11 → `scraping-ethics-ai-corpora-and-site-defense`).\n> 3. **Scrapers rot.** A scraper is a hard dependency on someone else's HTML, which they\n>    will change without telling you. **Silent breakage that produces plausible-looking\n>    wrong data is the characteristic failure of this field** (§9), and it's worse than\n>    a crash because nobody notices.\n\n---\n\n## §8. Scale and Reliability\n\n**[DURABLE] The architecture that survives contact with reality:**\n\n```\nURL frontier (queue, deduplicated, prioritized)\n   → fetcher pool (rate-limited PER DOMAIN, retries with backoff)\n     → response cache (raw HTML stored — see below)\n       → parser (pure function: HTML → structured record)\n         → validator (§9)\n           → storage + change detection\n```\n\n**[DURABLE] Store the raw response, not just the parsed output.** This is the single most\nvaluable architectural decision in a scraping system: when your parser turns out to have\nbeen wrong for three weeks, **you can re-parse history instead of re-crawling** — which is\ncheaper for you and, more importantly, costs the target site nothing.\n\n**Rate limiting is per-domain, not global.** A token bucket per host, with concurrency\ncaps. Scrapy's `AutoThrottle` adapts to observed latency, which is both polite and\neffective.\n\n**Retries**: exponential backoff **with jitter**, only on transient failures (429, 5xx,\ntimeouts), with a cap. **⚠️ Retrying a 404 or a 403 is just extra load** — classify errors\nbefore retrying.\n\n**Also**: **conditional requests** (`If-Modified-Since`, `If-None-Match` → 304 responses\ncost the server almost nothing), **incremental crawling** (only fetch what changed —\nsitemaps with `lastmod` help), **checkpointing** so a crash doesn't restart from zero,\n**idempotent writes** so a re-run doesn't duplicate, and **distributed queues** (Redis,\nSQS) when one machine isn't enough.\n\n**Proxies**: legitimate uses exist — geographic content variation, avoiding\nsingle-IP saturation, and reliability. **⚠️ But note that \"rotating residential proxies to\nevade blocking\" is the use case §7.2 → `scraping-tooling-extraction-and-blocking` flags**, and separately, **residential proxy networks\nhave documented supply-chain ethics problems** around how consumer bandwidth is sourced and\nwhether those users understood what they consented to. That's worth knowing before you buy.\n\n---\n\n## §9. Data Quality\n\n**[DURABLE] This is the section that separates a scraper from a data pipeline, and it is\nthe one people skip.**\n\n> **⚠️ GOTCHA — silent breakage is the characteristic failure of this field.** A site\n> redesigns. Your selector no longer matches. Your extractor returns empty strings.\n> **Your pipeline runs green, your dashboard shows data, and every number is wrong.**\n> Nobody notices for weeks because nothing crashed.\n>\n> **A scraper that crashes is a good scraper. A scraper that silently returns `None` for\n> the price field is a liability.**\n\n**Validate every record**: required fields present; types correct; **values within\nplausible ranges** (a price of 0 or 10,000,000 is a parser bug, not a bargain); enums in\ntheir expected set; dates sane.\n\n**Validate every batch — this is where breakage actually surfaces**: record count within\nexpected bounds, **null rate per field compared against the historical baseline** (the\nsingle most effective breakage detector), value distributions not suddenly shifted,\nduplicate rate stable. **Alert on the delta, not on absolute failure.**\n\n**Cross-check** against a second source, an official API, or a manual spot-check on a\nsample. **[DURABLE] Manually verify a handful of records at the start and after every\nchange** — it takes ten minutes and catches the class of error nothing else will.\n\n**Also track provenance**: source URL, fetch timestamp, parser version, and raw-response\nreference on every record. When you find a problem you need to know exactly which records\nare affected.\n\n**⚠️ And in 2026, add one more check**: with tarpit and content-poisoning defences now\ndeployed (§7.1 → `scraping-tooling-extraction-and-blocking`), **verify that what you're collecting is real content**, not generated\nfiller served to something the site classified as a bot.\n\n---\n\n## §10. Storage and Operations\n\n**Format by purpose**: JSON\u002FJSONL for raw and semi-structured; **Parquet** for analytics\n(columnar, compressed, and far faster to query); a relational database for\nrelationships and deduplication; object storage for raw HTML archives; a vector store only\nif you're doing retrieval (§12 → `scraping-ethics-ai-corpora-and-site-defense`).\n\n**[DURABLE] Design for change detection, not just snapshots.** Most scraping value comes\nfrom *what changed* — price movements, new listings, removed items. That means either\nstoring versions with valid-from\u002Fvalid-to, or storing a content hash per record and\nrecording transitions.\n\n**Schema evolution**: sites add and remove fields, so store the raw payload alongside the\nparsed record and **make your schema additive**.\n\n**Operational monitoring**: success rate by domain, latency, block\u002FCAPTCHA rate,\nrecords-per-run against baseline, **field-level null rates** (§9), cost per record, and\nqueue depth. **Alert on trends, not just failures** — a slow decline in fields extracted\nis the signal that matters.\n\n**Legal and ethical hygiene at the data layer**: know your **retention period** and\nenforce it; **be able to delete a person's data on request** if you hold personal data\n(GDPR\u002FCCPA rights are not optional and \"it's in a training set\" is not an answer — §1.6 → `scraping-legal-landscape-and-permissions`);\ndocument **provenance and legal basis per source**, because that documentation is what a\nregulator will ask for and it is very hard to reconstruct retroactively.\n","# Web Scraping: Scale and Reliability, Data Quality, and Storage and Operations\n\n> **Part 3 of 5** of the *Web Scraping* reference (plugin `web-scraping`), covering §8–§10. Sibling skills: `scraping-legal-landscape-and-permissions` (§0–§3), `scraping-tooling-extraction-and-blocking` (§4–§7), `scraping-ethics-ai-corpora-and-site-defense` (§11–§13), `scraping-reference` (§14–§19). Section numbers are shared across the set; a reference written as §N → `skill` points into that sibling skill.\n>\n> **Currency:** Verified August 2026. See §16 → `scraping-reference` for the currency snapshot and what goes stale first.\n\n> **How to read this.** Reference, not tutorial. Three markers:\n> - **[DURABLE]** — how HTTP and the web work, engineering practice, or ethics. Doesn't expire.\n> - **[VERSIONED]** — case law, regulation, tooling, platform behaviour. **This domain's\n>   legal layer is moving faster than its technical layer right now.** Verify.\n> - **[CONTESTED]** — genuine disagreement.\n>\n> **⚠️ GOTCHA** boxes mark the mistakes that get you blocked, sued, or quietly producing\n> wrong data for months.\n>\n> **This is not legal advice.** §1 → `scraping-legal-landscape-and-permissions` is a map of the frameworks that apply and the questions\n> to put to counsel, not an answer for your jurisdiction or your use case. **The legal\n> position depends heavily on what data, from where, about whom, and for what purpose** —\n> and those four variables move the answer more than any technical choice you make.\n>\n> **The three framings that organize everything below:**\n> 1. **The legal question is not \"is scraping legal.\" It is four separate questions** —\n>    *how did you access it* (computer-access law), *what did you agree to* (contract),\n>    *what is the data* (copyright, personal data), and *what will you do with it*\n>    (privacy, AI training, resale). **They have different answers and you need all four**\n>    (§1 → `scraping-legal-landscape-and-permissions`).\n> 2. **You are a guest on someone else's infrastructure, and they're paying for it.**\n>    Nearly every operational rule in this document — rate limiting, caching, conditional\n>    requests, off-peak scheduling — follows from taking that seriously, and doing so also\n>    happens to be what keeps you unblocked (§11 → `scraping-ethics-ai-corpora-and-site-defense`).\n> 3. **Scrapers rot.** A scraper is a hard dependency on someone else's HTML, which they\n>    will change without telling you. **Silent breakage that produces plausible-looking\n>    wrong data is the characteristic failure of this field** (§9), and it's worse than\n>    a crash because nobody notices.\n\n---\n\n## §8. Scale and Reliability\n\n**[DURABLE] The architecture that survives contact with reality:**\n\n```\nURL frontier (queue, deduplicated, prioritized)\n   → fetcher pool (rate-limited PER DOMAIN, retries with backoff)\n     → response cache (raw HTML stored — see below)\n       → parser (pure function: HTML → structured record)\n         → validator (§9)\n           → storage + change detection\n```\n\n**[DURABLE] Store the raw response, not just the parsed output.** This is the single most\nvaluable architectural decision in a scraping system: when your parser turns out to have\nbeen wrong for three weeks, **you can re-parse history instead of re-crawling** — which is\ncheaper for you and, more importantly, costs the target site nothing.\n\n**Rate limiting is per-domain, not global.** A token bucket per host, with concurrency\ncaps. Scrapy's `AutoThrottle` adapts to observed latency, which is both polite and\neffective.\n\n**Retries**: exponential backoff **with jitter**, only on transient failures (429, 5xx,\ntimeouts), with a cap. **⚠️ Retrying a 404 or a 403 is just extra load** — classify errors\nbefore retrying.\n\n**Also**: **conditional requests** (`If-Modified-Since`, `If-None-Match` → 304 responses\ncost the server almost nothing), **incremental crawling** (only fetch what changed —\nsitemaps with `lastmod` help), **checkpointing** so a crash doesn't restart from zero,\n**idempotent writes** so a re-run doesn't duplicate, and **distributed queues** (Redis,\nSQS) when one machine isn't enough.\n\n**Proxies**: legitimate uses exist — geographic content variation, avoiding\nsingle-IP saturation, and reliability. **⚠️ But note that \"rotating residential proxies to\nevade blocking\" is the use case §7.2 → `scraping-tooling-extraction-and-blocking` flags**, and separately, **residential proxy networks\nhave documented supply-chain ethics problems** around how consumer bandwidth is sourced and\nwhether those users understood what they consented to. That's worth knowing before you buy.\n\n---\n\n## §9. Data Quality\n\n**[DURABLE] This is the section that separates a scraper from a data pipeline, and it is\nthe one people skip.**\n\n> **⚠️ GOTCHA — silent breakage is the characteristic failure of this field.** A site\n> redesigns. Your selector no longer matches. Your extractor returns empty strings.\n> **Your pipeline runs green, your dashboard shows data, and every number is wrong.**\n> Nobody notices for weeks because nothing crashed.\n>\n> **A scraper that crashes is a good scraper. A scraper that silently returns `None` for\n> the price field is a liability.**\n\n**Validate every record**: required fields present; types correct; **values within\nplausible ranges** (a price of 0 or 10,000,000 is a parser bug, not a bargain); enums in\ntheir expected set; dates sane.\n\n**Validate every batch — this is where breakage actually surfaces**: record count within\nexpected bounds, **null rate per field compared against the historical baseline** (the\nsingle most effective breakage detector), value distributions not suddenly shifted,\nduplicate rate stable. **Alert on the delta, not on absolute failure.**\n\n**Cross-check** against a second source, an official API, or a manual spot-check on a\nsample. **[DURABLE] Manually verify a handful of records at the start and after every\nchange** — it takes ten minutes and catches the class of error nothing else will.\n\n**Also track provenance**: source URL, fetch timestamp, parser version, and raw-response\nreference on every record. When you find a problem you need to know exactly which records\nare affected.\n\n**⚠️ And in 2026, add one more check**: with tarpit and content-poisoning defences now\ndeployed (§7.1 → `scraping-tooling-extraction-and-blocking`), **verify that what you're collecting is real content**, not generated\nfiller served to something the site classified as a bot.\n\n---\n\n## §10. Storage and Operations\n\n**Format by purpose**: JSON\u002FJSONL for raw and semi-structured; **Parquet** for analytics\n(columnar, compressed, and far faster to query); a relational database for\nrelationships and deduplication; object storage for raw HTML archives; a vector store only\nif you're doing retrieval (§12 → `scraping-ethics-ai-corpora-and-site-defense`).\n\n**[DURABLE] Design for change detection, not just snapshots.** Most scraping value comes\nfrom *what changed* — price movements, new listings, removed items. That means either\nstoring versions with valid-from\u002Fvalid-to, or storing a content hash per record and\nrecording transitions.\n\n**Schema evolution**: sites add and remove fields, so store the raw payload alongside the\nparsed record and **make your schema additive**.\n\n**Operational monitoring**: success rate by domain, latency, block\u002FCAPTCHA rate,\nrecords-per-run against baseline, **field-level null rates** (§9), cost per record, and\nqueue depth. **Alert on trends, not just failures** — a slow decline in fields extracted\nis the signal that matters.\n\n**Legal and ethical hygiene at the data layer**: know your **retention period** and\nenforce it; **be able to delete a person's data on request** if you hold personal data\n(GDPR\u002FCCPA rights are not optional and \"it's in a training set\" is not an answer — §1.6 → `scraping-legal-landscape-and-permissions`);\ndocument **provenance and legal basis per source**, because that documentation is what a\nregulator will ask for and it is very hard to reconstruct retroactively.\n",{"name":5,"description":7},"develop","ae32736a1aabddabca5d2c96d665aa0ebc7d8700","src\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fweb-scraping\u002Fskills\u002Fscraping-scale-reliability-and-data-quality",3,"https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey","https:\u002F\u002Fthe-vibey-project.github.io\u002Fvibey\u002F","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project","https:\u002F\u002Fvibewithadam.matthewsteinberger.com","freedom for software engineers","2026-11-15 05:47:42",{"source":8,"skillName":5,"commands":35,"prompt":45,"zipAvailable":46},[36,39,42],{"tool":37,"command":38},"npx","npx skills add the-vibey-project\u002Fvibey --skill scraping-scale-reliability-and-data-quality",{"tool":40,"command":41},"bunx","bunx skills add the-vibey-project\u002Fvibey --skill scraping-scale-reliability-and-data-quality",{"tool":43,"command":44},"pnpm","pnpm dlx skills add the-vibey-project\u002Fvibey --skill scraping-scale-reliability-and-data-quality","安装技能，技能地址：https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fweb-scraping\u002Fskills\u002Fscraping-scale-reliability-and-data-quality\u002FSKILL.md",true,[],[49,56,63,70,77,84],{"skillNo":50,"name":51,"nameZh":6,"description":52,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":53,"categories":54,"keywords":55,"publishedAt":19},"01M7AT1FQJAE1FQYAMDTF490Y4","white-paper-writing","Use when writing white papers, technical reports, policy documents, thought leadership pieces, or any long-form authoritative document. Triggers on requests to write, structure, outline, or review white papers, technical reports, position papers, policy briefs, or evidence-driven arguments. Also use for B2B content marketing strategy, technical documentation requiring authority, academic-style reports, or any document that must educate while persuading. Use when someone asks \"how should I structure this\" for a long-form document.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Fwhite-paper-writing\u002FSKILL.md",[],[],{"skillNo":57,"name":58,"nameZh":6,"description":59,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":60,"categories":61,"keywords":62,"publishedAt":19},"01M7AT16BJRJJKK2MASXRZS76G","prose-technical-mechanics","Use when editing or writing prose at a technical\u002Fmechanical level: choosing between Anglo-Saxon and Latinate diction, placing information in topic vs stress positions, writing periodic vs cumulative sentences, handling sentence rhythm, punctuation as logic, transitions, paragraph structure, or phonesthetics. Use when someone wants to understand WHY prose works or doesn't, not just surface-level style advice. Triggers on word choice, sentence structure, emphasis, rhythm, diction, or any deep writing mechanics question.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Fprose-technical-mechanics\u002FSKILL.md",[],[],{"skillNo":64,"name":65,"nameZh":6,"description":66,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":67,"categories":68,"keywords":69,"publishedAt":19},"01M7AT0W9HT0ZZ9Y287NW99MR3","prose-mechanics","Use when writing, editing, or analyzing prose style; when trying to avoid generic AI-sounding writing; when applying specific prose styles such as journalistic, academic, narrative, KJV biblical, Hemingway plain, Latinate\u002FJamesian, Orwellian, Augustan, Victorian, Early Modern (Bacon, Browne, Milton), or free indirect discourse; or when coaching someone on writing voice and mechanics. Triggers on any request to improve, analyze, or write in a specific prose style, to fix \"AI-sounding\" writing, to make prose more vivid or concrete, to vary sentence rhythm, or to understand how a particular writer achieves their effects.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Fprose-mechanics\u002FSKILL.md",[],[],{"skillNo":71,"name":72,"nameZh":6,"description":73,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":74,"categories":75,"keywords":76,"publishedAt":19},"01M7AT0KR635JX66X2X6F3E2CP","narrative-structure","Use when structuring stories, pitches, presentations, white papers, or any persuasive narrative; analyzing the hero's journey in fiction or non-fiction; applying StoryBrand for business communication; designing narrative arcs for thought leadership; or understanding Vogler, Snyder, Propp, or Campbell frameworks. Triggers on any narrative structure, storytelling, pitch structure, StoryBrand, hero's journey, three-act structure, Freytag, Save the Cat, narrative arc, or \"how should I structure this story\u002Fpitch\u002Fpresentation\" request.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Fnarrative-structure\u002FSKILL.md",[],[],{"skillNo":78,"name":79,"nameZh":6,"description":80,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":81,"categories":82,"keywords":83,"publishedAt":19},"01M7AT0AKGW09NKKZDYBT8VRDE","legal-brief-writing","Use when writing legal briefs, motions, or any court filing; when analyzing judicial cognition and persuasion; when applying elite brief-writing techniques from Roberts, Clement, Kagan, Garner; or when structuring legal arguments for maximum persuasion. Also use for autistic\u002Fneurodivergent advocates who need to understand how their natural communication style maps to elite legal advocacy. Triggers on any legal writing, brief drafting, motion preparation, or legal argument structuring request.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Flegal-brief-writing\u002FSKILL.md",[],[],{"skillNo":85,"name":86,"nameZh":6,"description":87,"descriptionZh":6,"repositoryFullName":8,"ownerLogin":9,"ownerAvatarUrl":10,"ownerAccountNo":11,"ownerDisplayName":12,"repositoryNo":13,"starsCount":14,"licenseSpdxId":15,"licenseFileUrl":6,"sourceHtmlUrl":88,"categories":89,"keywords":90,"publishedAt":19},"01M7AT00VWPS4Q8B5VEMXX9NQT","journal-publishability-criteria","Use whenever a research paper, article or preprint is being written, revised, reviewed or published, and specifically before every publication of docs\u002Fpaper.md. Covers what legitimate journals actually gate on, in order of gating — the editor's desk screen (scope, novelty, package problems), what reviewers judge (methodological soundness, claims the evidence can carry, statistical and qualitative reporting), EQUATOR reporting guidelines, the ICMJE authorship criteria, COPE's view of text recycling, the near-universal generative-AI policy (no AI author, disclosure, author responsibility), TOP 2025 transparency standards, how to verify a journal is legitimate, submitting without an institution, and a pre-submission checklist. Triggers on requests to evaluate, review, prepare or submit a paper, to judge publishability, to write a declarations or data-availability section, to disclose AI use, or to check a journal.","https:\u002F\u002Fgithub.com\u002Fthe-vibey-project\u002Fvibey\u002Fblob\u002Fdevelop\u002Fsrc\u002Fvibey_tools\u002Fskills\u002Fplugins\u002Fwriting-craft\u002Fskills\u002Fjournal-publishability-criteria\u002FSKILL.md",[],[]]