Make the skill installable, and stop it giving a verdict the product retired - #67
Merged
Conversation
…retired The skill has existed since July and was never installable by any of the routes people actually use. It sat in skill/signs-of-ai/, and the instructions were "paste the repo link into your AI harness, or copy the folder". Meanwhile the whole ecosystem standardised on a root SKILL.md and two plugin manifests, which is how a competitor with a tenth of the engine reaches Claude Code, Codex, Gemini CLI and Cursor with one command. So: the skill moves to the repository root, where every installer looks, and gains .claude-plugin/, .codex-plugin/ and a Gemini command. One file, one place, three ways in — npx skills add, /plugin install, or copy it by hand. Reading it again to move it turned up something worse than the packaging. Its detect mode told the assistant to give "a plain-language verdict (reads clean / mixed / heavily AI-flavored)" — a three-band verdict on a scale nobody measured, which is exactly what #32 removed from the report and the score card in August. The product stopped saying it and the instructions kept saying it, to an assistant that would repeat them verbatim in a session we never see. Fixed: detect mode is now examine mode, and it reports the tells with what they do and do not support. Added the six rules about what a finding may claim — the score is a fact about the tool, finding nothing is not evidence a person wrote it, the error rate travels with the number, only English and Spanish have one, the boundary was never validated on a pasted paragraph (#59), and a tell is not a tally. Also that compare_to_baseline has no result meaning "someone else wrote this", and that check_originality must show the passages rather than a percentage. The hand-off section was stale in two ways: it listed six MCP tools when there are ten, and it configured the server by absolute path to a build output instead of `dnx SignsOfAI.Mcp --yes`. And the assistant's own turn is now the first family of tells, since the engine learned to score it. Guarded rather than trusted: SkillDocumentTests checks the numbers in the skill against the calibration this build ships, so re-running the calibration and forgetting the skill fails the suite. 314 tests, 7 new. Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_015PEbbiYSNPw7jE3LrPNhyF
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The skill funnel, finally — plus a defect the move uncovered.
The packaging
The skill has existed since July in
skill/signs-of-ai/and was never installable by any route peopleactually use. The instructions were "paste the repo link into your AI harness, or copy the folder".
Meanwhile the ecosystem standardised on a root
SKILL.mdplus plugin manifests, which is how acompetitor with a tenth of the engine reaches four assistants with one command.
It now lives at the repository root, where every installer looks:
npx skills add peopleworks/SignsofAI -g # Claude Code, Codex, Gemini CLI, Cursor…New:
.claude-plugin/plugin.json,.claude-plugin/marketplace.json,.codex-plugin/plugin.json,commands/gemini/signs-of-ai.toml.skill/keeps its README (rewritten) andeval.md.The defect
Reading it again to move it turned up something worse than the packaging. Its detect mode told the
assistant to give "a plain-language verdict (reads clean / mixed / heavily AI-flavored)" — a
three-band verdict on a scale nobody measured, which is exactly what #32 removed from the report
and the score card on 5 August.
The product stopped saying it. The instructions kept saying it, to an assistant that would repeat them
verbatim in a session none of us will ever see.
Detect mode is now examine mode, and it reports the tells with what they do and do not support.
What else went in
Six rules about what a finding may claim, mirroring the report's own:
Plus the two hand-offs that need their own warning:
compare_to_baselinehas no result meaning"someone else wrote this", and
check_originalitymust show the passages rather than a percentage.The hand-off section was stale in two ways: six MCP tools listed when there are ten, and the
server configured by absolute path into a build output instead of
dnx SignsOfAI.Mcp --yes.The assistant's own turn is now the first family of tells — "I hope this helps", "As of my last
training update", "¡Por supuesto!" — since the engine learned to score it in #65. The vocabulary
section also now names the seven words it deliberately does not flag, and why.
Guarded, not trusted
SkillDocumentTestschecks the numbers inSKILL.mdagainst the calibration this build actuallyships, and that the refusals are still in the text. Re-running the calibration and forgetting the
skill fails the suite. 314 tests, 7 new.
Note
Touches
README.md§5, as does #65 (a Credits paragraph). Different hunks, so they merge — butverify with
git merge-base --is-ancestorrather than the badge, as ever.🤖 Generated with Claude Code
https://claude.ai/code/session_015PEbbiYSNPw7jE3LrPNhyF