new browser-toys.html with install instructions, storage/privacy
docs, and per-browser guides. sidebar link added to all 26 pages.
browser toys section added to index.html and uncloseai-js.html.
- Add 'Our Crawler' link to left sidebar navigation after Text-to-Speech on all HTML pages
- Fix missing Text-to-Speech link in inference.html navigation
- Update Discord bot link in crawler.html to point to Git repo instead of domain
Created /crawler.html page explaining:
- Our user agent (uncloseai.com/1.42)
- What we use the crawler for (research, Q&A, content aggregation)
- Ethical practices (robots.txt, crawl delays, caching, smart depth)
- How to block the crawler
- Link to Discord bot
Added crawler link to sidebar navigation in inference.html
This provides transparency for webmasters and explains our ethical
crawling practices in human-friendly terms.