engineering/pig.py
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
262 commits 1 branch 0 tags 11 MiB
Commit graph

7 commits

Author SHA1 Message Date
Russell Ballestrini
66d2f4d1d9 Port 31337 default, code file display fixes 
- Change default port from 8000 to 31337 across all files
- About page: and → &, beast → pig
- Search results: SVG placeholder for code files (shows extension)
- Download button: remove .bin fallback, use original extension
 2026-01-02 15:35:39 -05:00
Russell Ballestrini
af50334a7b Fix tests for code media type, add source URL and lore 2026-01-02 13:41:10 -05:00
Russell Ballestrini
da538ea9b0 README: clarify domain_vault vs filevault, add linkpeek path mapping 2025-12-31 15:46:37 -05:00
Russell Ballestrini
99c836e2c8 Unify filevault: merge storage.py into single sync+async module 
- filevault.py: Vault (sync) + AsyncVault (async) in one file
- Delete storage.py (redundant async wrapper)
- Both classes share identical API: store, get, exists, delete, stats
- Add content_hash() and hash_to_path() utility functions
- Update all imports: neopig.py, serp.py, test files
- Update README with unified documentation
- 72 lines saved, cleaner architecture
 2025-12-31 15:44:39 -05:00
Russell Ballestrini
8d669e206c Comprehensive README rewrite with full API documentation 
- README.md: Complete rewrite in About page style with origin story
- Documents all storage systems: filevault, ImageVault, domain_vault
- Full database schema and method reference
- Screenshot capture with all engines and config options
- HTML to Markdown converter with content detection
- CLI reference for neopig.py, archive.py, serp.py
- All API endpoints documented
 2025-12-31 15:21:55 -05:00
Russell Ballestrini
16f869d7de Enable screenshots by default, --no-screenshot to disable 2025-12-30 15:21:41 -05:00
Russell Ballestrini
bc11c516b6 Add filevault system with async wrapper and convert sync ops to async 
New files:
- filevault.py: Hash-based file storage with use_pairs option (v1.1.0)
- async_filevault.py: Async wrapper using asyncio.to_thread()
- domain_vault.py: Triple vault system for web archival (HTML, Media, Linkpeek)
- screenshot.py: Async screenshot capture using uri2png
- tests/unit/: Comprehensive test suite (85 tests)

Sync-to-async conversions:
- storage.py: Wrap Path operations in asyncio.to_thread()
- domain_vault.py: Wrap exists(), mkdir(), rglob(), os.walk() in asyncio.to_thread()
- screenshot.py: Wrap read_bytes(), write_bytes(), unlink() in asyncio.to_thread()

All sync filesystem operations now run in thread pool to avoid blocking async loop.
 2025-12-22 20:18:20 -05:00