Russell Ballestrini
a1a58fbb50
- backfill-markdown: regenerate markdown with absolute URLs for a domain - Download button on /view page with slugified filename from alt/title - html2text baseurl resolves relative URLs during crawl - Fallback URL lookup by filename for older crawls - Video hover-to-play on all video elements - Avatar CSS float:left for text wrapping - FileResponse inline disposition (view not download) - Dynamic screenshot delay based on content length
25 lines
322 B
Text
25 lines
322 B
Text
# Core crawler
|
|
aiohttp>=3.9.0
|
|
aiofiles>=23.0.0
|
|
beautifulsoup4>=4.12.0
|
|
html5lib>=1.1
|
|
miniuri>=0.1.0
|
|
|
|
# Database
|
|
aiosqlite>=0.19.0
|
|
|
|
# Storage
|
|
filevault>=0.1.0
|
|
|
|
# SERP server
|
|
fastapi>=0.104.0
|
|
uvicorn>=0.24.0
|
|
python-multipart>=0.0.6
|
|
|
|
# Progress bar
|
|
tqdm>=4.66.0
|
|
|
|
# Optional
|
|
pillow>=10.0.0
|
|
html2text>=2024.2.26
|
|
markdown>=3.5.0
|