Skip to content
dsh-market Browse plugins GitHub 中文

STARDUSTLC666/dsh-flakefinder

Test-stability tools: repeatedly run vitest/jest/pytest/node:test suites, classify flaky cases, keep history and maintain a quarantine manifest.

Stars ★ 1 Category Development & Runtime Listed 2026-08-17 npm dsh-flakefinder

Install

Inside DeepSeek Harness, with dsh-market

dsh plugin --profile web add dshmarket

Or from the command line

dsh plugin --profile web add dsh-flakefinder

Installing runs third-party code with your own permissions — it can read your files, use your credentials and reach the network. Review the source first, and pin a commit (github:owner/repo#sha) when you can.

README

Teach agents the difference between broken code and a flaky test.

A DeepSeek Harness plugin for test stability: run tests repeatedly, classify flaky cases, keep history, maintain a quarantine manifest, and gate writes with approvals. Zero runtime dependencies.

Tools

Tool Purpose Write
flaky_detect Repeat tests N times and classify stable-pass / stable-fail / flaky history only
flaky_history Query detection history, filter by target no
flaky_report Combine quarantine manifest and history into a report no
flaky_quarantine Write flaky cases to .flakefinder.json yes (approval)
flaky_clear Remove recovered cases from the manifest yes (approval)

Frameworks: vitest / jest / pytest (setup.cfg / pyproject / pytest.ini / tox.ini) / node:test, auto-detected in that order. JUnit XML entities and TAP SKIP directives are parsed.

Install

dsh plugin --profile web add dsh-flakefinder

Example

User: src/checkout.test.ts keeps failing recently, is it real?
Agent:
  flaky_detect(target="src/checkout.test.ts", runs=5)
  -> verdict: flaky (3/5 passed; failures cluster on fake timers)
  -> flaky_quarantine(tests=["src/checkout.test.ts > timer restore"], reason="timer race")

Config

See cordis.patch.yml; defaults: defaultRuns=5, maxRuns=20, timeoutMs=120000, writeApproval=true, pythonPath=python (python3 on Linux/macOS; used for pytest runs).

Development

pnpm test
pnpm typecheck

MIT

Content from the project README on GitHub ↗