-
Notifications
You must be signed in to change notification settings - Fork 35
Description
Bug Description
CLAUDE.md for AgentReady repo is outdated in multiple layers.
To Reproduce
Review the CLAUDE.md file and verify some of the aspects listed below with the actual code base. You will find either CLAUDE.md is incorrect in some facts or outdated about the limitations and capabilities.
"9/31 Stub Assessors" is Completely Outdated
-
https://github.com/ambient-code/agentready/blob/main/CLAUDE.md#known-issues--limitations
-
create_stub_assessors() returns []. There are 25 fully implemented assessors, 0 stubs. All former stubs were implemented or removed.
-
# Add remaining stub assessors (currently none - all implemented or removed)
Tier weights are incorrectly specified
-
Actual (src/agentready/data/default-weights.yaml:3-10):
- Tier 1: 55% (not 50%)
- Tier 2: 27% (not 30%)
- Tier 3: 15% (correct)
- Tier 4: 3% (not 5%)
-
https://github.com/ambient-code/agentready/blob/main/CLAUDE.md#scoring-algorithm
-
agentready/src/agentready/data/default-weights.yaml
Lines 6 to 9 in c169827
# Tier 1 (Essential): 55% total (5×10% + 1×5%, 6 attributes) # Tier 2 (Critical): 27% total (3% each, 9 attributes) # Tier 3 (Important): 15% total (3% each, 5 attributes) # Tier 4 (Advanced): 3% total (1% each, 3 attributes)
CI/CD Section Claims Manual Workflow
- CLAUDE.md says: "Current: Manual workflow (tests run locally before push)"
- Actual (.github/workflows/): 16 GitHub Actions workflows exist — ci.yml, release.yml, security.yml, coverage-comment.yml, leaderboard.yml, pr-review-auto-fix.yml, and more.
Python Version Requirement is Wrong
- https://github.com/ambient-code/agentready/blob/main/pyproject.toml#L8
- https://github.com/ambient-code/agentready/blob/main/CLAUDE.md#technologies
Lock file spec mismatch
- https://github.com/ambient-code/agentready/blob/main/CLAUDE.md#known-issues--limitations
- https://github.com/ambient-code/agentready/blob/main/uv.lock
Roadmap Says Bootstrap/Align are "Planned"
- Both are implemented — src/agentready/cli/bootstrap.py and src/agentready/cli/align.py exist and are registered as CLI commands.
Arch. tree is misrepresented
- https://github.com/ambient-code/agentready/blob/main/CLAUDE.md#architecture
- 4 entire top-level directories missing from the tree:
- data/ — default-weights.yaml, RESEARCH_REPORT.md
- fixers/ — automated remediation (base, documentation, testing)
- github/ — review_formatter.py
- utils/ — preflight, privacy, security, subprocess_utils
Missing/Moved Referenced Files
- GITHUB_ISSUES.md doesn't exist (issue templates are in .github/ISSUE_TEMPLATE/)
- contracts/ directory, does not exist at root (existing contracts are only in this path: specs/001-agentready-scorer/contracts/)
Environment
NA
Possible Solution
Update CLAUDE.md and double check to make sure the behavior of the Agent Ready is consistent before and after the CLAUDE.md change w.r.t
- Fixing bugs in the repo
- Reviewing PRs
- Handling CI/CD issues etc.,