feat(sentiment): complete pipeline overhaul with ONNX priority + LoRA retraining
- Added 30 new sources (5 RSS + 25 Telegram) for previously ZERO-coverage assets - Fixed model loading priority: ONNX > LoRA v2 > PyTorch > Mock - ONNX FinBERT (pre-trained on 1.2M financial docs) now PRIMARY - best for real-world text - LoRA v2 models trained on 518 carefully labeled samples (balanced Bearish/Bullish/Neutral) - Emotion LoRA v2 trained with weighted loss (greed/fear 2x, joy 1.5x) - 30 new sources: STX, FET, XTZ, ENJ, ETC, TRX, ONG, DASH, LTC, ZIL, NEAR, APT, SUI, ICP - Early stopping (patience=3) on both LoRA trainings - Human-in-the-loop verification CLI tool created - Disk-conscious: save_total_limit=1, adapters 6-8MB each Pipeline now correctly classifies: - BTC breaks 100k → +0.54 Bullish ✅ - Major hack → -0.23 Bearish ✅ - HODL → +0.91 Bullish ✅ - Rug pull → -0.30 Bearish ✅ - SEC sues → -0.30 Bearish ✅ - ETF approval → +0.32 Bullish ✅ - Whale accumulation → +0.31 Bullish ✅ Models: ONNX FinBERT (PRIORITY 1) + LoRA v2 adapters (6-8MB each) Training data: 518 carefully labeled samples (190 real + 328 synthetic) Early stopping (patience=3) on both FinBERT and DistilRoBERTa LoRA Emotion LoRA v2: weighted loss (greed/fear 2x, joy 1.5x) + early stopping
This commit is contained in:
@@ -0,0 +1 @@
|
||||
{"description": "", "citation": "", "homepage": "", "license": "", "features": {"text": {"dtype": "string", "_type": "Value"}, "label": {"dtype": "int64", "_type": "Value"}}, "builder_name": "csv", "dataset_name": "twitter-financial-news-sentiment", "config_name": "default", "version": {"version_str": "0.0.0", "major": 0, "minor": 0, "patch": 0}, "splits": {"train": {"name": "train", "num_bytes": 939352, "num_examples": 9543, "dataset_name": "twitter-financial-news-sentiment"}, "validation": {"name": "validation", "num_bytes": 237530, "num_examples": 2388, "dataset_name": "twitter-financial-news-sentiment"}}, "download_checksums": {"hf://datasets/zeroshot/twitter-financial-news-sentiment@ccbe24de388e287beb92dd393a335c376b350ac3/sent_train.csv": {"num_bytes": 858645, "checksum": null}, "hf://datasets/zeroshot/twitter-financial-news-sentiment@ccbe24de388e287beb92dd393a335c376b350ac3/sent_valid.csv": {"num_bytes": 217378, "checksum": null}}, "download_size": 1076023, "dataset_size": 1176882, "size_in_bytes": 2252905}
|
||||
Reference in New Issue
Block a user