Improving Python coverage
SkillDev toolsimproving-python-coverage is a skill that lets an AI agent measure and raise Python test coverage. The agent runs the project's tests with coverage, reads the report to find poorly covered files, and writes targeted pytest cases for untested branches, errors, and edge cases. It iterates until coverage rises by roughly 0.2%, then cleans up and reviews the changes.
Use Improving Python coverage in Claude, ChatGPT or Ahel Desktop
Free. Sign in, add Improving Python coverage and connect your AI. About a minute.
Also: Claude Code · Cursor · Codex
Then ask your AI: use the Improving Python coverage skill
Details
Instructions available. Your AI can read the instructions. Execution depends on the setup they require.
Account requirements not reviewed. Check the skill instructions before use; ahel provides instructions and does not run this skill.
No other account needed.
Have a Python project with tests that can be run under coverage.
What your AI can do with it
- Runs Python unit tests with coverage
- Analyzes coverage reports to find poorly covered files
- Writes targeted tests for untested branches, errors, and edge cases using pytest
- Iterates until coverage rises by roughly 0.2%
- Cleans up and reviews the changes after testing
Getting started
- Have a Python project with tests that can be run under coverage.
- Add the improving-python-coverage skill to your agent's available skills.
- Ask the agent to improve the project's Python test coverage.
- Review the new tests and coverage changes the agent produces.
What this skill tells your AI
The instructions your AI receives, as published by streamlit/streamlit in .claude/skills/improving-python-coverage/SKILL.md and read by ahel’s review.
Increase Python unit test coverage by ~0.2% through meaningful tests that add real value.
Be fully autonomous — Do NOT stop or pause to ask for confirmation. Keep iterating (analyze → implement → verify) until the 0.2% coverage target is reached. If you encounter ambiguities about what to test, make a reasonable choice and proceed.
Workflow
Step 1: Run tests with coverage
make python-tests # ~3 min, creates .coverage file
Generate JSON report for analysis:
uv run coverage json -o coverage.json
The JSON contains per-file missing_lines arrays showing uncovered line numbers.
Step 2: Analyze and prioritize
Read coverage.json to find files with:
- Large size + below-average
percent_covered(high impact) - Core modules in
lib/streamlit/elements/orlib/streamlit/runtime/ - Pure utility functions
Skip: >97% coverage, proto/*, vendor/*, static/*, test files.
Step 3: Implement tests (in subagent)
Launch a subagent to implement tests for each prioritized file. Provide the subagent with:
- The target file path and its
missing_linesfrom coverage - Instructions to read the source, existing tests, and write new tests
- The test selection guidelines below
The subagent should:
- Read source and existing tests at
lib/tests/streamlit/<path>/<module>_test.py - Write tests for: conditional branches, error handling, edge cases, exception paths
- Follow
lib/tests/AGENTS.md: prefer pytest-style standalone functions overunittest.TestCaseclasses, use@pytest.mark.parametrizeto consolidate tests that only differ in inputs/expected outputs, add numpydoc docstrings and type annotations - Run the new tests to verify they pass:
uv run pytest lib/tests/streamlit/path/to/module_test.py -v
Step 4: Verify and iterate
uv run pytest lib/tests/streamlit/path/to/module_test.py -v # Run new tests
make python-tests # Measure progress
Repeat steps 2-4 until coverage improves by ≥0.2%, then run make check.
Step 5: Simplify, review, and address feedback
Once all tests pass and coverage target is met:
- Run the
simplifying-local-changessubagent to clean up and simplify the code changes. Wait for completion. - Run the
reviewing-local-changessubagent to review the changes. Wait for completion and read the review output. - Address the review feedback: for each recommendation, implement it if valid and improves code quality; skip with brief reasoning if not applicable or would over-engineer.
- Run /checking-changes to verify everything still passes after changes.
Test selection
DO test: Conditional logic, error handling, edge cases (None, empty, zero, max), public API functions, complex branches.
DON'T test: Simple accessors, protobufs, implementation details, already well-covered code.
Coverage exclusions: Use # pragma: no cover sparingly for code that genuinely doesn't need testing. Always include a reason (e.g., # pragma: no cover - defensive):
- Platform-specific branches that can't run in CI (
# pragma: no cover - platform-specific) - Defensive code that should never execute (
# pragma: no cover - defensive) - Abstract method stubs or protocol definitions (
# pragma: no cover - abstract)
Integration dependencies: Packages listed under [dependency-groups] integration in pyproject.toml (e.g., pydantic, sympy, polars, sqlalchemy) are only installed for integration tests, not regular unit tests. When writing tests that use these packages:
- Import them inside the test function, not at module top-level
- Add
@pytest.mark.require_integrationmarker to the test - This ensures tests gracefully skip when run outside the integration test environment
Test file location
lib/tests/streamlit/<package>/<module>_test.py mirrors lib/streamlit/<package>/<module>.py
Notes
-
Quality > coverage numbers - skip tests that don't catch real bugs
-
Target is 95%+ coverage per
lib/tests/AGENTS.md -
Use
/checking-changesafter implementing tests -
Some code paths involving external libraries (e.g., database connectors, optional dependencies) are already covered by integration tests marked with
pytest.mark.require_integration. These integration tests are not included in the coverage numbers frommake python-tests. When analyzing missing lines, check whether the uncovered code is exercised by integration tests before adding unit tests or# pragma: no coverannotations. -
Local vs CI coverage differences: Code that is version-specific (Python version, library version) or uses integration dependencies may appear uncovered locally but is tested and covered in CI. Examples:
- Python version-specific branches (e.g.,
if sys.version_info >= (3, 14)) run only on matching CI jobs - Library version-specific code (e.g., pandas 2.x vs 3.x behavior) is covered across CI matrix
- Integration dependency tests (
@pytest.mark.require_integration) run in separate CI jobs with those packages installed
Before adding tests or
# pragma: no coverfor such code, verify whether it's already exercised in CI. - Python version-specific branches (e.g.,
Signals
- GitHub stars
- 46k
- Forks
- 4k
- Last commit
- Oct 2026
Questions
- How much does coverage increase?
- The skill iterates until coverage rises by roughly 0.2% per run, focusing on high-value test cases.
- Which test framework does it use?
- It writes new tests using pytest.
- What kinds of tests does it write?
- Targeted tests for untested branches, error paths, and edge cases in poorly covered files.
- When should I use it?
- Use it when you want to systematically improve Python test coverage with high-value test cases.
Advanced
- Item type
- skill
- Key
improving-python-coverage- Source
- github.com/streamlit/streamlit
github.com/streamlit/streamlit
Related picks
Skill · streamlit
Does the same job in other wordspython-performance-optimization
Skill · wshobson
The pick for Pythonpython-pro
Skill · jeffallan
The pick for Pythonteach
Skill · mattpocock
More in Dev toolsimplement
Skill · mattpocock
More in Dev toolsponytail
Skill · dietrichgebert
More in Dev tools