Russell Ballestrini
21e344f675
- archive.py: New site archiver wrapper with embedded serve.py - --serve flag starts SERP server alongside crawl for live viewing - --fast mode for sites without robots.txt (no crawl delay) - Symlink-based storage: domain views link to hash vault - Tarball resolves symlinks to include only domain content - Fixed bytes_downloaded/bytes_stored accounting for screenshots - Data directory (data/) for databases and state files - Standardized on - separator in filenames
26 lines
225 B
Text
26 lines
225 B
Text
# Python
|
|
__pycache__/
|
|
*.py[cod]
|
|
*.so
|
|
.venv/
|
|
venv/
|
|
*.egg-info/
|
|
|
|
# Database and vault (generated data)
|
|
*.db
|
|
vault/
|
|
test_vault/
|
|
|
|
# Vendored dependencies
|
|
vendor/
|
|
|
|
# IDE
|
|
.idea/
|
|
.vscode/
|
|
*.swp
|
|
*.swo
|
|
|
|
# OS
|
|
.DS_Store
|
|
Thumbs.db
|
|
data/
|