feat: add 5 research tools and blocks framework setup
- Add @tpmjs/tools-page-brief for URL content extraction - Add @tpmjs/tools-compare-pages for cross-source validation - Add @tpmjs/tools-source-credibility for credibility scoring - Add @tpmjs/tools-claim-checklist for factual claim extraction - Add @tpmjs/tools-timeline-from-text for timeline generation - Move createBlogPost to packages/tools/official/ - Add blocks.yml for Blocks framework validation - Update pnpm-workspace.yaml to include official tools
This commit is contained in:
parent
409d1232a6
commit
36a0735ab1
34 changed files with 2458 additions and 61 deletions
21
docs/TODO.md
21
docs/TODO.md
|
|
@ -130,6 +130,27 @@ GET /api/users/[username]/collections - Get user's public collections
|
|||
|
||||
---
|
||||
|
||||
## Benchmark Comparison Page
|
||||
|
||||
### Overview
|
||||
- [ ] Create `/benchmarks` page to compare tool performance
|
||||
- [ ] Display execution time comparisons across similar tools
|
||||
- [ ] Show token usage efficiency metrics
|
||||
- [ ] Compare success rates and reliability
|
||||
|
||||
### Features
|
||||
- [ ] Side-by-side tool comparison UI
|
||||
- [ ] Historical performance trends (charts)
|
||||
- [ ] Filter by category to compare relevant tools
|
||||
- [ ] Export benchmark data as JSON/CSV
|
||||
|
||||
### Data Collection
|
||||
- [ ] Track execution metrics from playground simulations
|
||||
- [ ] Aggregate anonymous performance data
|
||||
- [ ] Calculate percentile rankings within categories
|
||||
|
||||
---
|
||||
|
||||
## Notes
|
||||
|
||||
- Consider rate limiting on ratings to prevent abuse
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue