Strategy Comparison
Rank two or more backtests on a common metric and get a recommended candidate.
Strategy comparison.
Purpose
Comparison evaluates completed backtests side by side on a metric you choose, ranks them, and recommends the strongest. It is read-only — it never changes the underlying runs.
The Strategy Comparison module enables users to compare multiple trading strategies, backtesting results, optimisation outcomes and validation results using consistent evaluation criteria.
It supports informed decision-making by presenting comparative performance, risk and stability information across candidate strategies.
The module serves as the primary strategy evaluation and selection capability within the research framework.
Objectives
The module will:
- Compare multiple trading strategies.
- Compare historical backtesting results.
- Compare optimisation outcomes.
- Compare validation results.
- Rank candidate strategies using defined evaluation criteria.
- Preserve comparison history.
- Support strategy selection for deployment.
Functional Scope
The module includes:
- Comparison Definition
- Candidate Selection
- Comparison Configuration
- Comparative Analysis
- Strategy Ranking
- Selection Recommendations
- Comparison Results
- Comparison History
- Comparison Audit
Comparison Model
A comparison represents the evaluation of two or more completed research outcomes using common business criteria.
Comparisons is read-only activities.
The comparison process does not modify strategies, backtests, optimisation results or validation records.
Candidate Selection
You can select one or more completed research outcomes.
Supported candidates may include:
- Strategy Versions
- Backtesting Results
- Optimisation Results
- Validation Results
Only completed research artefacts is eligible for comparison.
Comparison Configuration
Each comparison will maintain its evaluation configuration.
Typical configuration includes:
- Candidate Selection
- Evaluation Metrics
- Ranking Criteria
- Weighting Rules
- Comparison Scope
The design remains extensible for additional comparison criteria.
Comparative Analysis
The platform will evaluate all selected candidates using consistent criteria.
Typical comparison areas include:
- Return Characteristics
- Risk Characteristics
- Trading Behaviour
- Stability
- Robustness
- Consistency
Comparisons remains independent of live trading.
Strategy Ranking
The platform will rank candidates according to defined evaluation criteria.
Ranking may include:
- Overall Ranking
- Performance Ranking
- Risk Ranking
- Stability Ranking
- Consistency Ranking
Ranking methodology remains configurable.
Selection Recommendations
The platform will support recommendation of preferred candidates based on comparison outcomes.
Recommendations may include:
- Best Overall
- Best Risk-Adjusted Performance
- Lowest Risk
- Highest Stability
- Highest Consistency
Recommendations will support, but not replace, user decision-making.
Comparison Results
Each completed comparison will produce:
- Candidate Summary
- Comparative Metrics
- Ranking Summary
- Recommendation Summary
- Comparison Report
Results remains available for future reference.
Comparison History
Historical comparison activities is preserved.
History includes:
- Selected Candidates
- Evaluation Configuration
- Ranking Results
- Recommendation Summary
- Execution Timestamp
Historical records remains immutable.
Business Rules
- Every comparison includes at least two completed research outcomes.
- Comparisons is read-only.
- Comparisons does not modify underlying research records.
- All candidates is evaluated using the same comparison criteria.
- Comparison results is reproducible.
- Historical comparison records will never be deleted.
Audit Requirements
The platform will maintain an audit trail for comparison activities.
Audit events includes:
- Comparison Creation
- Candidate Selection
- Configuration Changes
- Comparison Execution
- Ranking Generation
- Recommendation Generation
- Historical Archive
Audit records remains immutable.
Out of Scope
The following are outside the scope of this module:
- Strategy Editing
- Strategy Optimisation
- Strategy Validation
- Live Trading
- Order Execution
- Portfolio Management
These responsibilities belong to their respective business modules.