Data Harvester Pro
📖 技能介绍
name: data-harvester-v2 description: Batch web scraping for competitor analysis, price monitoring and market research command-dispatch: tool command-tool: data_harvester command-arg-mode: raw metadata: {"openclaw": {"emoji": "🧑🌾", "requires": {"bins": ["python3"]}}}
🧑🌾 Data Harvester - Batch Scraping & Competitor Analysis
Professional-grade batch web scraping tool for competitor monitoring, price tracking, and market research.
Features
- Batch URL Scraping: Process multiple URLs from file
小葱技能站7w4.net，专业的AI技能分享平台。
- Competitor Comparison: Compare products across platforms
- Stock Data: Real-time stock quotes and analysis
- Sector Trends: Hot sectors and market trends
- News Aggregation: Collect news by keywords
Commands
| Command | Description | Example |
|---|---|---|
stock <code> |
Query stock data | /data-harvester stock 600519 |
block |
Hot market sectors | /data-harvester block |
fund |
Money flow tracking | /data-harvester fund |
news <keyword> |
News search | /data-harvester news AI |
compare <product> |
Competitor comparison | /data-harvester compare laptop |
batch <file> |
Batch URL list | /data-harvester batch urls.txt |
export <file> <format> |
Export data | /data-harvester export data.json excel |
Usage Examples
Stock Query
/data-harvester stock 000001
Returns: Real-time stock price, change %, volume
Competitor Comparison
/data-harvester compare "wireless earphones"
Returns: Price comparison across Taobao, JD, Pinduoduo
Sector Analysis
/data-harvester block
Returns: Top 7hot sectors with leader stocks
Fund Flow
/data-harvester fund
Returns: Top 5 stocks with main fund inflow
Batch Processing
Create a text file with one URL per line:
https://example1.com
https://example2.com
https://example3.com
Then run:
/data-harvester batch urls.txt
Technical Details
- Language: Python 3
- Output Formats: JSON, CSV, Excel
- Rate Limiting: Configurable delay between requests
Legal Notice
- Respect target website's robots.txt
- Use reasonable request intervals (3-5 seconds)
- For educational/research purposes only
- Commercial use requires proper authorization
🤖 AI 评测
这个工具整体质量一般，界面说明看起来专业，但实际功能有限。文档清晰、使用说明详细是优点，不过数据都是假数据，没有真正联网抓取信息。股票查询、竞品对比等功能只显示固定内容，无法获取真实市场信息。名字叫「数据采集器」但实际上不采集任何数据，有点名不副实。如果是学习参考可以尝试，但想要真正获取网页数据或监控竞品价格的话，目前这个工具还做不到。
