5d2096fb5d
Implements a comprehensive suite of AI SDK v6 tools across multiple categories: - Research (5): page-brief, compare-pages, source-credibility, claim-checklist, timeline-from-text - Web (10): fetch-text, links-catalog, extract-meta, extract-json-ld, redirect-trace, sitemap-read, rss-read, table-extract, robots-policy, url-normalize - Data (15): csv-parse, csv-stringify, json-repair, json-schema-validate, yaml-parse, yaml-stringify, text-chunk, normalize-whitespace, dedupe-by-key, pivot, rows-filter, rows-sort, rows-group-aggregate, rows-join, schema-infer - Doc (12): toc-generate, glossary-build, faq-from-text, executive-brief, decision-record-adr, prd-outline, acceptance-criteria, style-rewrite - Eng (12): diff-text-unified, env-var-docs-generate, dependency-audit-lite, conventional-commit-suggest, markdown-lint-basic, test-case-generate, stacktrace-parse, release-notes, changelog-entry, release-checklist - Security (7): redact-secrets, secret-scan-text, url-risk-heuristic, csp-compose, hardening-checklist-web, access-control-matrix, data-classification-heuristic - Stats (9): effect-size-suite, bootstrap-ci, permutation-test, multiple-testing-adjust, linear-regression-ols, logistic-regression, time-series-decompose-lite, anomaly-detect-mad - Ops (7): slo-draft, runbook-draft, postmortem-draft, postmortem-action-extractor, error-log-triage, coverage-tracker, monitoring-gap-analysis - Agent (15): prompt-to-workflow-skeleton, workflow-validate-io, workflow-explain, workflow-cost-estimate, tool-call-accuracy-score, eval-fixture-build, guardrail-policy-draft, workflow-auto-repair, tool-selection-plan, novelty-score-workflow, workflow-variant-generate, config-normalize, recipe-* - Utility (8): base64-encode, base64-decode, hash-text, regex-extract, template-render, date-parse, json-path-query, url-parse - HTML (3): html-sanitize, html-to-markdown, markdown-to-html All tools follow AI SDK v6 pattern with tool() and jsonSchema<T>(). 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
1.8 KiB
1.8 KiB
@tpmjs/tools-sitemap-read
Parse XML sitemaps and extract URLs from sitemap.xml files.
Installation
npm install @tpmjs/tools-sitemap-read
Usage
import { sitemapReadTool } from '@tpmjs/tools-sitemap-read';
import { generateText } from 'ai';
const result = await generateText({
model: yourModel,
tools: { sitemapReadTool },
prompt: 'Get all URLs from https://example.com/sitemap.xml',
});
Tool Parameters
url(string, required): The sitemap.xml URL to parse
Returns
{
urls: Array<{
loc: string;
lastmod?: string;
changefreq?: string;
priority?: string;
}>;
isSitemapIndex: boolean;
urlCount: number;
sitemapIndexUrls?: Array<{
loc: string;
lastmod?: string;
}>;
metadata: {
fetchedAt: string;
sourceUrl: string;
type: 'urlset' | 'sitemapindex';
};
}
Features
- Supports both regular sitemaps (urlset) and sitemap indexes (sitemapindex)
- Extracts URL locations with optional metadata (lastmod, changefreq, priority)
- Handles sitemap index files that reference other sitemaps
- Comprehensive error handling
- 30-second timeout protection
- Validates XML structure
Sitemap Types
Regular Sitemap (urlset)
Contains direct page URLs with optional metadata:
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://example.com/page</loc>
<lastmod>2024-01-01</lastmod>
<changefreq>weekly</changefreq>
<priority>0.8</priority>
</url>
</urlset>
Sitemap Index (sitemapindex)
Contains references to other sitemap files:
<sitemapindex xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<sitemap>
<loc>https://example.com/sitemap1.xml</loc>
<lastmod>2024-01-01</lastmod>
</sitemap>
</sitemapindex>
Requirements
- Node.js 18+ (uses native fetch API)
License
MIT