Guide
How to validate a crypto trading strategy before risking capital
A backtest that looks good is not yet evidence. This guide explains what FLAWLINE measures when it validates a rule-based crypto strategy, how that differs from a conventional backtest, and how to interpret each verdict — including the negative ones.
How FLAWLINE works
You choose one of the supported strategy families, a market (BTC, ETH or SOL against USDT), a timeframe and the parameters. FLAWLINE then runs a deterministic historical validation of that exact configuration: the same configuration, data and rules always produce the same result.
The result is a verdict with its evidence — metrics, the checks applied with observed values and thresholds, the data coverage and reproducibility identifiers — downloadable as HTML, JSON and PDF.
What a validation actually measures
Walk-forward evidence: results are measured across out-of-sample windows, which exposes configurations that only work in one convenient period.
Costs first: fees and slippage are applied before the evidence is judged.
Activity: too few closed trades cannot support a strong robustness claim.
Fixed criteria: measured results are compared with the same thresholds for every validation. Drawdown is reported as a historical risk diagnostic.
Credibility warnings: diagnostics flag evidence that deserves less confidence.
Backtesting versus robustness analysis
A conventional backtest answers one question: how would these rules have done on this history? With enough tweaking, almost any idea can be made to look good on a single period — that is overfitting.
Robustness analysis asks a harder question: does the evidence survive costs, out-of-sample windows and fixed criteria that were not tuned for this strategy? FLAWLINE applies the same method to every configuration instead of searching for winners.
How to read a REJECTED result
REJECTED means the configuration failed one or more defined historical checks. The report shows which check failed and by how much, so you know whether the problem is costs, too few trades, unstable out-of-sample results or another criterion.
That is useful: it lets you discard or rethink a fragile hypothesis before it receives capital. REJECTED is a valid result, not a system failure, and it does not by itself mean future losses.
What INSUFFICIENT_EVIDENCE means
Sometimes the available data do not allow a valid evaluation under the protocol — for example when a configuration produces too little activity to measure. FLAWLINE then assigns no favourable or unfavourable conclusion. It describes the limits of the evidence, which is itself information worth having.
PASSED means the configuration passed the defined checks over the historical coverage used; WATCHLIST means the evidence is not strong enough for PASSED without the protocol rejecting it. Neither is a prediction or a recommendation.
See a real report
The public sample report shows a real REJECTED validation of an archived Donchian breakout configuration on BTC/USDT, with the binding criterion, the observed value and the threshold. It contains no user data.
Supported strategy families
- ATR volatility breakout — long only — Looks for breakouts after volatility compression, with a trend filter and ATR-based risk controls.
- Donchian breakout with regime filter — long only — Looks for Donchian breakouts only when the configured trend and volatility regime filters allow them.
- Higher-timeframe trend pullback — long only — Looks for trend continuation after a pullback, using EMA/RSI context and ATR-based exits.
BTC/USDT, ETH/USDT, SOL/USDT · 1h, 4h, 1d
Historical results do not guarantee future results. FLAWLINE is a research tool: it does not give financial advice, issue signals, execute trades or connect to exchanges. Read the risk notice