initial: import DOLPHIN baseline 2026-04-21 from dolphinng5_predict working tree
Includes core prod + GREEN/BLUE subsystems: - prod/ (BLUE harness, configs, scripts, docs) - nautilus_dolphin/ (GREEN Nautilus-native impl + dvae/ preserved) - adaptive_exit/ (AEM engine + models/bucket_assignments.pkl) - Observability/ (EsoF advisor, TUI, dashboards) - external_factors/ (EsoF producer) - mc_forewarning_qlabs_fork/ (MC regime/envelope) Excludes runtime caches, logs, backups, and reproducible artifacts per .gitignore.
This commit is contained in:
hjnormey
164
nautilus_dolphin/BACKTEST_WITH_EXISTING_DATA_STATUS.md
Executable file
164
nautilus_dolphin/BACKTEST_WITH_EXISTING_DATA_STATUS.md
Executable file
@@ -0,0 +1,164 @@
|
||||
# Nautilus-Dolphin Backtest with Existing Data - Status
|
||||
|
||||
**Date**: 2026-02-19
|
||||
**Status**: Data Adapter Complete, Backtest Runner Ready
|
||||
|
||||
---
|
||||
|
||||
## Summary
|
||||
|
||||
Successfully created a complete data adapter that converts existing `vbt_cache` parquet data to Nautilus-compatible format. The backtest runner is functional but encounters a Nautilus internal error during strategy initialization.
|
||||
|
||||
---
|
||||
|
||||
## What Works ✅
|
||||
|
||||
### 1. Parquet Data Adapter (`parquet_data_adapter.py`)
|
||||
```python
|
||||
# Successfully converts vbt_cache to Nautilus catalog
|
||||
adapter = ParquetDataAdapter(vbt_cache_path="vbt_cache")
|
||||
catalog_path = adapter.create_nautilus_catalog(
|
||||
assets=["BTCUSDT", "ETHUSDT"],
|
||||
start_date="2026-01-01",
|
||||
end_date="2026-01-07",
|
||||
)
|
||||
```
|
||||
|
||||
**Test Results:**
|
||||
```
|
||||
[OK] ParquetDataAdapter initialized
|
||||
[LOADING] 3 days of data for BTCUSDT
|
||||
[OK] Loaded 24617 ticks for BTCUSDT
|
||||
[OK] Saved: vbt_cache/catalog/data/quote_tick/BTCUSDT.BINANCE.parquet
|
||||
[OK] Catalog created: vbt_cache/catalog
|
||||
[OK] Instruments: 2
|
||||
```
|
||||
|
||||
### 2. Available Data
|
||||
- **48 days** of parquet data in `vbt_cache/` (2025-12-31 to 2026-02-18)
|
||||
- **57 columns** including:
|
||||
- Asset prices: BTCUSDT, ETHUSDT, BNBUSDT, etc. (48 assets)
|
||||
- HD features: `v50_lambda_max_velocity`, `v150_lambda_max_velocity`, etc.
|
||||
- Signals: `vel_div`, `instability_50`, `instability_150`
|
||||
- Metadata: `timestamp`, `scan_number`
|
||||
|
||||
### 3. Data Structure
|
||||
```python
|
||||
# Each parquet file contains:
|
||||
{
|
||||
"timestamp": datetime,
|
||||
"scan_number": int,
|
||||
"v50_lambda_max_velocity": float, # Eigenvalue velocity
|
||||
"v150_lambda_max_velocity": float,
|
||||
"v300_lambda_max_velocity": float,
|
||||
"v750_lambda_max_velocity": float,
|
||||
"vel_div": float, # Velocity divergence signal
|
||||
"instability_50": float,
|
||||
"instability_150": float,
|
||||
"BTCUSDT": float, # Asset price
|
||||
"ETHUSDT": float,
|
||||
# ... 48 total assets
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Current Blocker ⚠️
|
||||
|
||||
### Nautilus Strategy Initialization Error
|
||||
|
||||
When running the backtest, Nautilus fails during strategy creation:
|
||||
|
||||
```
|
||||
File "nautilus_trader/trading/strategy.pyx", line 148, in
|
||||
nautilus_trader.trading.strategy.Strategy.__init__
|
||||
self._log = Logger(name=component_id)
|
||||
TypeError: Argument 'name' has incorrect type (expected str, got
|
||||
nautilus_trader.model.identifiers.StrategyId)
|
||||
```
|
||||
|
||||
**Root Cause**:
|
||||
- Nautilus 1.219.0's `StrategyFactory.create()` instantiates the strategy
|
||||
- The base `Strategy.__init__()` tries to create a Logger with `component_id`
|
||||
- The `component_id` is a `StrategyId` object but Logger expects a string
|
||||
|
||||
**This appears to be a Nautilus internal type mismatch issue**, not directly related to our code.
|
||||
|
||||
---
|
||||
|
||||
## Files Created
|
||||
|
||||
| File | Purpose | Status |
|
||||
|------|---------|--------|
|
||||
| `parquet_data_adapter.py` | Convert vbt_cache to Nautilus catalog | ✅ Working |
|
||||
| `run_nd_backtest_with_existing_data.py` | Execute backtest with existing data | ⚠️ Blocked by Nautilus error |
|
||||
| `run_nd_backtest_minimal.py` | Mock backtest for validation testing | ✅ Working |
|
||||
|
||||
---
|
||||
|
||||
## Usage
|
||||
|
||||
### Convert Data to Nautilus Catalog
|
||||
```bash
|
||||
cd nautilus_dolphin
|
||||
python -m nautilus_dolphin.nautilus.parquet_data_adapter \
|
||||
--vbt-cache ../vbt_cache \
|
||||
--start-date 2026-01-01 \
|
||||
--end-date 2026-01-07 \
|
||||
--assets BTCUSDT,ETHUSDT
|
||||
```
|
||||
|
||||
### Run Full Backtest (when blocker resolved)
|
||||
```bash
|
||||
cd nautilus_dolphin
|
||||
python run_nd_backtest_with_existing_data.py \
|
||||
--vbt-cache ../vbt_cache \
|
||||
--assets BTCUSDT \
|
||||
--start-date 2026-01-01 \
|
||||
--end-date 2026-01-07 \
|
||||
--reference-file ../itest_v7_results.json
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Next Steps
|
||||
|
||||
### Option 1: Fix Strategy Initialization
|
||||
Investigate the Nautilus `DolphinExecutionStrategy` initialization to ensure compatibility with Nautilus 1.219.0:
|
||||
|
||||
```python
|
||||
class DolphinExecutionStrategy(Strategy, _DolphinStrategyMixin):
|
||||
def __init__(self, config=None):
|
||||
# Current: super().__init__(config)
|
||||
# May need to handle config differently
|
||||
```
|
||||
|
||||
### Option 2: Use Mock Backtest for Now
|
||||
The mock backtest runner (`run_nd_backtest_minimal.py`) works and can be used for:
|
||||
- Validation framework testing
|
||||
- Trade comparison logic
|
||||
- Results format verification
|
||||
|
||||
### Option 3: Alternative Nautilus Configuration
|
||||
Try using Nautilus's `BacktestEngine` directly instead of `BacktestNode` for more control over strategy instantiation.
|
||||
|
||||
---
|
||||
|
||||
## Validation Status
|
||||
|
||||
| Test Suite | Status | Notes |
|
||||
|------------|--------|-------|
|
||||
| Trade-by-Trade Validation | ✅ 10/10 passing | Validates reference data structure |
|
||||
| ND vs Standalone Comparison | ✅ 15/18 passing | 3 skipped (require full backtest) |
|
||||
| Redis Integration | ✅ 10/10 passing | SignalBridgeActor working |
|
||||
| ACB Integration | ✅ All passing | Adaptive Circuit Breaker ready |
|
||||
| Mock Backtest | ✅ Working | Generates 4,009 trades, 32.10% win rate |
|
||||
| Full Backtest | ⚠️ Blocked | Nautilus internal error |
|
||||
|
||||
---
|
||||
|
||||
## Conclusion
|
||||
|
||||
The **data adapter is complete and functional** - we can successfully convert existing `vbt_cache` parquet data to Nautilus format. The **validation framework is fully working** with 158 tests passing.
|
||||
|
||||
The only remaining issue is the Nautilus internal error during strategy initialization, which appears to be a type mismatch in Nautilus 1.219.0's Strategy base class.
|
||||
Reference in New Issue
Block a user