248193c4b7b1150230cb586a326153d705cfc4a0
- BaseConnector: abstract base with status tracking, rate limiting, retry logic - RSSConnector: polls RSS/Atom feeds with feedparser, GUID deduplication - TwitterConnector: Twitter API v2 recent search, bearer auth, engagement metrics - RedditConnector: Pushshift + official API, subreddit polling, OAuth - ExchangeConnector: Exchange announcement RSS feeds - RegulatoryConnector: SEC, CFTC, Fed RSS + API endpoints - CorporateConnector: Earnings/filings RSS - WebCrawlConnector: Generic BFS crawler with depth control, rate limiting - IngestionManager: Orchestrates all connectors, loads config from sources.yaml - sources.yaml: 20 configured sources across all 9 categories (crypto news, tradfi, exchange, regulatory, social, macro, corporate, web) - All 46 core NLP tests pass - Added beautifulsoup4 dependency for WebCrawlConnector
Description
Sentiment analysis engine with ONNX FinBERT + LoRA adapters
Languages
Python
99.9%
Dockerfile
0.1%