engineering/uncloseai.com
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
uncloseai.com/public
History
Russell Ballestrini bfee917049 docs: Add ethical web crawler documentation page 
Created /crawler.html page explaining:
- Our user agent (uncloseai.com/1.42)
- What we use the crawler for (research, Q&A, content aggregation)
- Ethical practices (robots.txt, crawl delays, caching, smart depth)
- How to block the crawler
- Link to Discord bot

Added crawler link to sidebar navigation in inference.html

This provides transparency for webmasters and explains our ethical
crawling practices in human-friendly terms.
2025-11-27 10:11:10 -05:00
..
css Reorganize project structure: move public files to public/ directory 2025-10-24 13:23:42 -04:00
languages Fix Go code style and module import issues 2025-11-20 19:32:53 -05:00
src Fix code block buttons visibility by allowing vertical overflow on pre elements 2025-11-10 16:46:33 -05:00
crawler.html docs: Add ethical web crawler documentation page 2025-11-27 10:11:10 -05:00
csharp-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
dart-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
demo.html Add privacy policy, terms of use, and copyright notices to all pages 2025-11-07 19:17:01 -05:00
elixir-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
favicon.ico Reorganize project structure: move public files to public/ directory 2025-10-24 13:23:42 -04:00
go-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
index.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
inference.html docs: Add ethical web crawler documentation page 2025-11-27 10:11:10 -05:00
java-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
kotlin-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
nodejs-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
php-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
privacy-policy.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
python-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
ruby-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
rust-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
swift-examples.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
terms-of-use.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
text-to-speech.html Remove Quick Links section from text-to-speech page 2025-11-10 03:52:45 -05:00
uncloseai-js.html Add text-to-speech navigation link to all public pages 2025-11-09 18:12:44 -05:00
uncloseai.js Reorganize project structure: move public files to public/ directory 2025-10-24 13:23:42 -04:00