engineering/tpmjs
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1.9k
tpmjs/packages
History
Ajax Davis ea742c9386 feat: add scenarios system for collection testing 
Implements the complete scenarios feature for TPMJS:

API endpoints:
- GET/POST /api/scenarios - list/create scenarios
- GET/PATCH/DELETE /api/scenarios/:id - scenario CRUD
- POST /api/scenarios/:id/run - execute scenario
- GET /api/scenarios/:id/runs - run history
- POST /api/scenarios/check-similarity - vector similarity check
- GET /api/scenarios/featured - featured scenarios
- POST /api/collections/:id/scenarios/generate - AI scenario generation
- GET /api/collections/:id/scenarios - list collection scenarios

Services:
- generate-prompt.ts - AI prompt generation using GPT-4o-mini
- similarity.ts - vector embedding and cosine similarity
- evaluate.ts - LLM-based success evaluation
- execute.ts - scenario execution orchestration

CLI commands:
- tpm scenario list [collection] - list scenarios
- tpm scenario run <collection> - run all scenarios
- tpm scenario test <id> - run single scenario
- tpm scenario generate <collection> - generate scenarios
- tpm scenario info <id> - scenario details

Database:
- Scenario, ScenarioEmbedding, ScenarioRun, ScenarioQuota models
- Streak-based quality scoring
- Daily quota management

Migration script included for converting existing useCases.
2026-01-18 09:31:31 +10:00
..
bridge feat: complete MCP Bridge implementation 2026-01-13 00:59:34 +10:00
cli feat: add scenarios system for collection testing 2026-01-18 09:31:31 +10:00
config feat(ui): add comprehensive design system with 14 new components 2026-01-16 05:51:12 +10:00
db feat: add scenarios system for collection testing 2026-01-18 09:31:31 +10:00
env chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00
mcp-client feat: complete MCP Bridge implementation 2026-01-13 00:59:34 +10:00
mocks chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00
npm-client chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00
package-executor fix: pass explicit version to executor to avoid Deno cache issues 2026-01-15 00:59:05 +10:00
storybook fix: enable Biome CSS tailwindDirectives for @apply parsing 2026-01-09 23:35:53 +10:00
test chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00
tool-ideas chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00
tools fix(hllm): update package configuration and exports 2026-01-18 01:52:36 +10:00
types fix(agents): correct model id to 5.1-mini 2026-01-17 07:42:50 +10:00
ui fix(ui): resolve table dark mode styling issues 2026-01-18 01:51:41 +10:00
utils chore: update dependencies with compatibility fixes 2026-01-09 22:49:41 +10:00