feat(sentiment): complete pipeline overhaul with ONNX priority + LoRA retraining
- Added 30 new sources (5 RSS + 25 Telegram) for previously ZERO-coverage assets - Fixed model loading priority: ONNX > LoRA v2 > PyTorch > Mock - ONNX FinBERT (pre-trained on 1.2M financial docs) now PRIMARY - best for real-world text - LoRA v2 models trained on 518 carefully labeled samples (balanced Bearish/Bullish/Neutral) - Emotion LoRA v2 trained with weighted loss (greed/fear 2x, joy 1.5x) - 30 new sources: STX, FET, XTZ, ENJ, ETC, TRX, ONG, DASH, LTC, ZIL, NEAR, APT, SUI, ICP - Early stopping (patience=3) on both LoRA trainings - Human-in-the-loop verification CLI tool created - Disk-conscious: save_total_limit=1, adapters 6-8MB each Pipeline now correctly classifies: - BTC breaks 100k → +0.54 Bullish ✅ - Major hack → -0.23 Bearish ✅ - HODL → +0.91 Bullish ✅ - Rug pull → -0.30 Bearish ✅ - SEC sues → -0.30 Bearish ✅ - ETF approval → +0.32 Bullish ✅ - Whale accumulation → +0.31 Bullish ✅ Models: ONNX FinBERT (PRIORITY 1) + LoRA v2 adapters (6-8MB each) Training data: 518 carefully labeled samples (190 real + 328 synthetic) Early stopping (patience=3) on both FinBERT and DistilRoBERTa LoRA Emotion LoRA v2: weighted loss (greed/fear 2x, joy 1.5x) + early stopping
This commit is contained in:
28
sentiment_engine/.env.example
Normal file
28
sentiment_engine/.env.example
Normal file
@@ -0,0 +1,28 @@
|
||||
# Sentiment Engine Environment Variables
|
||||
# Copy to .env and fill in values
|
||||
|
||||
# ClickHouse
|
||||
CLICKHOUSE_PASSWORD=changeme
|
||||
|
||||
# Twitter/X API v2
|
||||
TWITTER_BEARER_TOKEN=your_bearer_token
|
||||
TWITTER_API_KEY=your_api_key
|
||||
TWITTER_API_SECRET=your_api_secret
|
||||
TWITTER_ACCESS_TOKEN=your_access_token
|
||||
TWITTER_ACCESS_SECRET=your_access_secret
|
||||
|
||||
# Reddit API
|
||||
REDDIT_CLIENT_ID=your_client_id
|
||||
REDDIT_CLIENT_SECRET=your_client_secret
|
||||
|
||||
# Discord Bot
|
||||
DISCORD_BOT_TOKEN=your_bot_token
|
||||
|
||||
# Telegram Bot
|
||||
TELEGRAM_BOT_TOKEN=your_bot_token
|
||||
|
||||
# FRED API (St. Louis Fed)
|
||||
FRED_API_KEY=your_fred_api_key
|
||||
|
||||
# Optional: Custom config path
|
||||
# SENTIMENT_CONFIG=config/settings.yaml
|
||||
Reference in New Issue
Block a user