- A phoenix-like chimera grown from the bones of dead repositories & forums. A pig that devours web domains whole. Where others archive pages, neopig consumes all digital files.
Welcome to An Age of Aquarius, no deceitful secrets.
-
-
-
-
-
-
I
-
-
Genesis
-
-
-
pig.py is a very simple python command line tool to download all the images from a given uri.
- — Russell Ballestrini, August 22, 2011
-
-
-
- In the beginning, there was pig.py. A simple creature. Innocent. Hungry.
-
-
-
- Russell Ballestrini crafted it in the summer of 2011 — a humble Python script with a singular appetite: images. Point it at a webpage, and it would slurp down every pixel it could find. No configuration. No complexity. Just a hungry little pig gobbling up the visual fabric of the web.
-
-
-
-
python pig.py https://www.foxhop.net
-
-
-
- That was it. Entire interface. Pig asked only for a target, and it fed.
-
-
-
- Russell released it into the public domain — a gift to anyone who needed to harvest images from the wild web. Source lived at bitbucket.org/russellballestrini/pig, nestled safely in a Mercurial repository. Pig slept soundly in its pen, unaware of the extinction event approaching.
-
-
-
-
-
-
-
II
-
-
A Great Bitbucket Extinction
-
-
- Then came the dark times.
-
-
-
- In 2020, Atlassian — the corporate leviathan that had swallowed Bitbucket whole — decreed that Mercurial repositories would be purged. All of them. Every hg repo on Bitbucket Cloud, atomized. Scattered like digital ash across the void. Atlassian never disclosed how many.
-
-
-
-
- Original pig.py, that innocent image-gobbling creature, was among the casualties. Its home at bitbucket.org/russellballestrini/pig became a tombstone. Click it. We dare you. There's nothing there but the echo of corporate indifference.
-
-
-
-
They literally killed pig.py & sent him to bitbucket.
- — Cruel irony of naming your graveyard after a slang term for death
-
-
-
- "Sent to the bitbucket" — programmer slang from the age of punch cards. When you discarded bad data, you threw it in the bit bucket. Atlassian named their service after a trash can, then proved the prophecy true by throwing away everyone's code.
-
-
-
- Pig was dead. Its bones scattered across cached search results & archived blog posts. A ghost in the machine, referenced but unreachable.
-
- Programs are golems. Familiar spirits. Magical servants performing repetitive tasks so we don't have to. "It is more accurate to group programs with technology than magic, but less fun."
-
-
-
- Years passed. Web continued its relentless churn — sites going dark, forums shutting down, communities scattering like startled birds. Somewhere, a very angry ex-Ruby developer (Python too) watched the digital decay & remembered the pig.
-
-
-
-
What if we could transmute that dead code into gold?
- — Thought that started everything
-
-
-
- And speaking of transmutation: Marathon Fusion discovered that tokamak breeding blankets — wrapped in Mercury-Lithium alloy, like pigs in a blanket — can transmute Mercury-198 into Gold-197 through chrysopoeia. Fast neutrons trigger (n, 2n) reactions; unstable mercury decays into stable gold within 64 hours.
-
-
-
- Two metric tons of gold per gigawatt. Alchemists' dream realized, wrapped in radioactive patience (17.7 years of cooling before you can touch your transmuted treasure).
-
-
-
- A golden goose born from the ashes of deprecated version control. Old pig was slaughtered, while a new creature stirred in the digital depths...
-
-
-
- Machine learning uses an equivalent amount of wu wei energy that elites used to kill pig.py to unfold neopig.py.
-
-
-
-
-
-
-
IV
-
-
A Pig Awakens
-
-
- Like a phoenix rising from dead Bitbucket repos, neopig emerged.
-
-
-
-
- Not a resurrection. Not a mere fork. Something else. A chimera. A griffin. A creature stitched together from the DNA of the original pig & the fevered dreams of someone who had watched too many sites die.
-
-
-
-
A pig with an appetite like Gluttony from Fullmetal Alchemist — a homunculus that devours everything in its path, absorbing knowledge, power & form.
-
-
-
- Where pig.py sipped politely from single pages, neopig devours entire domains. It doesn't just grab images — it consumes HTML, screenshots pages, converts content to markdown, indexes every scrap of text, and stores it all in content-addressed vaults that will outlast the original servers.
-
-
-
- Code lives now at git.unturf.com/engineering/unturf/pig.py. And it keeps evolving. Every crawl adds new capabilities. Every archived site teaches it new tricks.
-
-
-
- We are adding the ability to backup entire codebases. Neopig grows hungrier.
-
-
-
-
-
-
-
V
-
-
A Mirror Dimension
-
-
- We are about to invert the git tree into itself.
-
-
-
-
- Like Dr. Strange versus Spider-Man in the mirror dimension — that impossible space where geometry folds back on itself, where buildings become M.C. Escher nightmares & reality reflects endlessly into its own depths.
-
-
-
- neopig doesn't just archive websites. It can archive itself. It can archive the repositories that contain the code that does the archiving. It can crawl git forges & preserve the source code of tools that preserve source code.
-
-
-
-
Our spider-pig gets out of the danger of the mirror void — where days are years — and exits absorbing everything like a griffin, like a chimera, like a pig that feeds on bones of dead platforms.
-
-
-
- When a code hosting platform dies (and they all die eventually — Google Code, Gitorious, BitBucket's hg repos), neopig ensures the knowledge survives. We are the ark. We are the vault. We are the pig that remembers.
-
-
-
- Archives become self-extracting executables. .run files that contain their own server, their own search engine, their own reality. Drop one on a machine with Python, and it wakes up. A sleeping pig, carrying an entire website in its belly, ready to serve it to anyone who asks.
-
-
-
-
-
-
-
VI
-
-
The Arsenal
-
-
-
-
Async Domain Crawling
-
Full-domain recursive crawling with configurable depth. Respects robots.txt & crawl delays. Polite but relentless.
-
-
-
Content-Addressed Vault
-
MD5-based deduplication in a 9-deep hex directory structure. Same image from 100 pages? Stored once. Space is memory.
-
-
-
Full-Text Search
-
Every image indexed with its surrounding context — page title, alt text, captions, nearby headings. Find images by meaning, not filename.
-
-
-
Page Screenshots
-
LinkPeek reborn! Full-page captures via uri2png. wkhtmltoimage, cutycapt, or Playwright backends.
-
-
-
Hydra Mode
-
Auto-discover RSS/Atom/Sitemap feeds. Persists feed URLs, checks for new content on every crawl. Self-healing archive maintenance.
-
-
-
Media Provenance
-
Track first_seen, last_seen, and when each page first linked to media. Watch content spread across the web over time.
-
-
-
Markdown Conversion
-
Intelligent HTML-to-Markdown with forum post detection, noise removal & content extraction. Human-readable archives.
-
-
-
Self-Extracting Archives
-
Create .run executables that contain entire websites. Drop on any machine, execute, browse. Pig travels light.
-
-
-
Code File Support
-
Archive source code, stylesheets, fonts, and scripts alongside media. Complete preservation for developer communities.
-
-
-
VCS Repository Cloning
-
Auto-detect GitHub, GitLab, Bitbucket & more. Clone repos, symlink files to vault. Deduplicated code across forks.
-
-
-
Live Feed
-
Watch media appear in real-time as crawls progress. SSE-powered live updates. Pig hunts while you watch.
-
-
-
SERP Web Interface
-
FastAPI-powered search engine. Browse by type, search by context, view media details. Your personal media search engine.
-
-
-
-
-
-
-
-
VII
-
-
A Skeleton Key 🗝️🔑
-
-
- neopig uses what we call the "skeleton key" approach to media indexing. For every image, we capture all the text that might help you find it later:
-
-
-
-
- Page context: Title, description, headings near the image.
- Image attributes: Alt text, title, surrounding captions.
- Link context: Text of links pointing to the image.
- Detail pages: For gallery sites, we follow through to detail pages & harvest their metadata too.
-
-
-
- Result? You can search for "sunset over mountains" and find that image even if it was named IMG_4372.jpg with no alt text — because the page title mentioned it, or someone linked to it with descriptive text, or a caption three divs away contained the words.
-
-
-
- Every door opens. Every search succeeds. Skeleton key fits every lock because it carries every possible key inside it.
-
-
-
-
-
-
-
VIII
-
-
Why We Archive
-
-
- Web is ephemeral. Sites go dark. Forums shut down. Communities scatter. Platforms get acquired & gutted. Executives decide that Mercurial isn't profitable & delete every repository with a single corporate memo.
-
-
-
- We have watched beloved communities vanish. Game modding forums. Technical documentation. Art galleries. Fan wikis. Personal blogs with decades of writing. Gone. Not archived by the Wayback Machine. Not cached by Google. Just gone.
-
-
-
- neopig is built for preservation — capturing not just the media, but the context that gives it meaning. When you archive a site with neopig, you get:
-
-
-
- • Original HTML with rewritten media links pointing to your local vault
- • Full-text searchable markdown versions of every page
- • Screenshots showing exactly how pages looked
- • A SQLite database you can query, backup, and migrate forever
- • Self-extracting archives that work offline forever
-
-
-
-
-
-
-
-
IX
-
-
A Forge
-
-
- This tool was not built for profit. It was forged.
-
-
-
- Forged in the fires of permacomputer.com — the belief that computing should be permanent. That knowledge should not evaporate when a company pivots. That communities should not lose their histories when a platform gets acquired. That the lore doesn't have to die when you get acqui-hired or outright terminated 🟣. A digital commons that belongs to everyone, forever.
-
-
-
-
-
-
Truth. Harmony. Freedom. Love.
- — The quadrivium of a permacomputer
-
-
-
- Truth — We preserve what actually existed, not sanitized versions. Original HTML. Exact timestamps. Unedited conversations. History as it happened, not as someone wishes it had.
-
-
-
- Harmony — Every piece connects. Media links to pages. Pages link to context. Context links to meaning. Archive is not a graveyard of disconnected files but a living web of relationships, searchable, traversable, whole.
-
-
-
- Freedom — Public domain. No licenses to parse. No corporate terms of service. Take it. Fork it. Run it. Share it. Code is yours. Archives you create are yours. No one can revoke your access to your own preserved knowledge.
-
-
-
- Love — We archive because we care. About the communities that built these spaces. About the people who poured years into forum posts & wiki pages & blog entries. About the future researchers who will want to understand how we lived & thought & created. This is an act of love for human knowledge.
-
-
-
- Pig is imbued with righteous fire. It does not crawl politely because it fears the powerful — it respects robots.txt because it honors the wishes of creators. It does not hoard in darkness — it preserves in light, making archives searchable, shareable, alive. A pig imbued with righteous fire.
-
-
-
- When the platforms fall (and they will fall), when the corporate servers go dark (and they will go dark), when the executives decide your community isn't profitable enough to maintain (and they will decide this) — a permacomputer endures. Archives persist. Knowledge survives.
-
-
-
- This is what we were forged to do.
-
-
-
-
-
-
-
X
-
-
Rules?
-
-
- neopig is built on SQLite — the most deployed database in existence. SQLite adopted the Rule of St. Benedict as their Code of Ethics. 72 principles from a 6th-century monastery, governing software in the 21st.
-
-
-
- We inherit this lineage. All 72 rules, unabridged:
-
-
-
-
1. Love the Lord God with your whole heart, soul, and strength.
-
2. Love your neighbor as yourself.
-
3. Do not murder.
-
4. Do not commit adultery.
-
5. Do not steal.
-
6. Do not covet.
-
7. Do not bear false witness.
-
8. Honor all people.
-
9. Do not do to another what you would not have done to yourself.
-
10. Deny oneself in order to follow Christ.
-
11. Chastise the body.
-
12. Do not become attached to pleasures.
-
13. Love fasting.
-
14. Relieve the poor.
-
15. Clothe the naked.
-
16. Visit the sick.
-
17. Bury the dead.
-
18. Be a help in times of trouble.
-
19. Console the sorrowing.
-
20. Be a stranger to the world's ways.
-
21. Prefer nothing more than the love of Christ.
-
22. Do not give way to anger.
-
23. Do not nurse a grudge.
-
24. Do not entertain deceit in your heart.
-
25. Do not give a false peace.
-
26. Do not forsake charity.
-
27. Do not swear, for fear of perjuring yourself.
-
28. Utter only truth from heart and mouth.
-
29. Do not return evil for evil.
-
30. Do no wrong to anyone, and bear patiently wrongs done to yourself.
-
31. Love your enemies.
-
32. Do not curse those who curse you, but rather bless them.
-
33. Bear persecution for justice's sake.
-
34. Be not proud.
-
35. Be not addicted to wine.
-
36. Be not a great eater.
-
37. Be not drowsy.
-
38. Be not lazy.
-
39. Be not a grumbler.
-
40. Be not a detractor.
-
41. Put your hope in God.
-
42. Attribute to God, and not to self, whatever good you see in yourself.
-
43. Recognize always that evil is your own doing, and to impute it to yourself.
-
44. Fear the Day of Judgment.
-
45. Be in dread of hell.
-
46. Desire eternal life with all the passion of the spirit.
-
47. Keep death daily before your eyes.
-
48. Keep constant guard over the actions of your life.
-
49. Know for certain that God sees you everywhere.
-
50. When wrongful thoughts come into your heart, dash them against Christ immediately.
-
51. Disclose wrongful thoughts to your spiritual mentor.
-
52. Guard your tongue against evil and depraved speech.
-
53. Do not love much talking.
-
54. Speak no useless words or words that move to laughter.
-
55. Do not love much or boisterous laughter.
-
56. Listen willingly to holy reading.
-
57. Devote yourself frequently to prayer.
-
58. Daily in your prayers, with tears and sighs, confess your past sins to God, and amend them for the future.
-
59. Fulfill not the desires of the flesh; hate your own will.
-
60. Obey in all things the commands of those whom God has placed in authority over you even though they should act otherwise, mindful of the Lord's precept, "Do what they say, but not what they do."
-
61. Do not wish to be called holy before one is holy; but first to be holy, that you may be truly so called.
-
62. Fulfill God's commandments daily in your deeds.
-
63. Love chastity.
-
64. Hate no one.
-
65. Be not jealous, nor harbor envy.
-
66. Do not love quarreling.
-
67. Shun arrogance.
-
68. Respect your seniors.
-
69. Love your juniors.
-
70. Pray for your enemies in the love of Christ.
-
71. Make peace with your adversary before the sun sets.
-
72. Never despair of God's mercy.
-
-
-
- We archive not to hoard, but to give. We preserve not to control, but to liberate. Database that holds your memories runs on a foundation of ancient wisdom — and so do we.
-
-
-
-
-
-
-
XI
-
-
Invoke the Pig
-
-
-
# open http://127.0.0.1:31337 in browser
-python neopig.py --serve
-
-
-
- neopig = Neo (new) + Python Image Grabber
-
-
-
- A tip of the hat to original pig.py. A nod to Matrix's Neo — seeing through surface of web to underlying content within. And perhaps a warning: this pig has grown teeth.
-
+ A phoenix-like chimera grown from the bones of dead repositories & forums. A pig that devours web domains whole. Where others archive pages, neopig consumes all digital files.
Welcome to An Age of Aquarius, no deceitful secrets.
+
+
+
+
+
+
I
+
+
Genesis
+
+
+
pig.py is a very simple python command line tool to download all the images from a given uri.
+ — Russell Ballestrini, August 22, 2011
+
+
+
+ In the beginning, there was pig.py. A simple creature. Innocent. Hungry.
+
+
+
+ Russell Ballestrini crafted it in the summer of 2011 — a humble Python script with a singular appetite: images. Point it at a webpage, and it would slurp down every pixel it could find. No configuration. No complexity. Just a hungry little pig gobbling up the visual fabric of the web.
+
+
+
+
python pig.py https://www.foxhop.net
+
+
+
+ That was it. Entire interface. Pig asked only for a target, and it fed.
+
+
+
+ Russell released it into the public domain — a gift to anyone who needed to harvest images from the wild web. Source lived at bitbucket.org/russellballestrini/pig, nestled safely in a Mercurial repository. Pig slept soundly in its pen, unaware of the extinction event approaching.
+
+
+
+
+
+
+
II
+
+
A Great Bitbucket Extinction
+
+
+ Then came the dark times.
+
+
+
+ In 2020, Atlassian — the corporate leviathan that had swallowed Bitbucket whole — decreed that Mercurial repositories would be purged. All of them. Every hg repo on Bitbucket Cloud, atomized. Scattered like digital ash across the void. Atlassian never disclosed how many.
+
+
+
+
+ Original pig.py, that innocent image-gobbling creature, was among the casualties. Its home at bitbucket.org/russellballestrini/pig became a tombstone. Click it. We dare you. There's nothing there but the echo of corporate indifference.
+
+
+
+
They literally killed pig.py & sent him to bitbucket.
+ — Cruel irony of naming your graveyard after a slang term for death
+
+
+
+ "Sent to the bitbucket" — programmer slang from the age of punch cards. When you discarded bad data, you threw it in the bit bucket. Atlassian named their service after a trash can, then proved the prophecy true by throwing away everyone's code.
+
+
+
+ Pig was dead. Its bones scattered across cached search results & archived blog posts. A ghost in the machine, referenced but unreachable.
+
+ Programs are golems. Familiar spirits. Magical servants performing repetitive tasks so we don't have to. "It is more accurate to group programs with technology than magic, but less fun."
+
+
+
+ Years passed. Web continued its relentless churn — sites going dark, forums shutting down, communities scattering like startled birds. Somewhere, a very angry ex-Ruby developer (Python too) watched the digital decay & remembered the pig.
+
+
+
+
What if we could transmute that dead code into gold?
+ — Thought that started everything
+
+
+
+ And speaking of transmutation: Marathon Fusion discovered that tokamak breeding blankets — wrapped in Mercury-Lithium alloy, like pigs in a blanket — can transmute Mercury-198 into Gold-197 through chrysopoeia. Fast neutrons trigger (n, 2n) reactions; unstable mercury decays into stable gold within 64 hours.
+
+
+
+ Two metric tons of gold per gigawatt. Alchemists' dream realized, wrapped in radioactive patience (17.7 years of cooling before you can touch your transmuted treasure).
+
+
+
+ A golden goose born from the ashes of deprecated version control. Old pig was slaughtered, while a new creature stirred in the digital depths...
+
+
+
+ Machine learning uses an equivalent amount of wu wei energy that elites used to kill pig.py to unfold neopig.py.
+
+
+
+
+
+
+
IV
+
+
A Pig Awakens
+
+
+ Like a phoenix rising from dead Bitbucket repos, neopig emerged.
+
+
+
+
+ Not a resurrection. Not a mere fork. Something else. A chimera. A griffin. A creature stitched together from the DNA of the original pig & the fevered dreams of someone who had watched too many sites die.
+
+
+
+
A pig with an appetite like Gluttony from Fullmetal Alchemist — a homunculus that devours everything in its path, absorbing knowledge, power & form.
+
+
+
+ Where pig.py sipped politely from single pages, neopig devours entire domains. It doesn't just grab images — it consumes HTML, screenshots pages, converts content to markdown, indexes every scrap of text, and stores it all in content-addressed vaults that will outlast the original servers.
+
+
+
+ Code lives now at git.unturf.com/engineering/unturf/pig.py. And it keeps evolving. Every crawl adds new capabilities. Every archived site teaches it new tricks.
+
+
+
+ We are adding the ability to backup entire codebases. Neopig grows hungrier.
+
+
+
+
+
+
+
V
+
+
A Mirror Dimension
+
+
+ We are about to invert the git tree into itself.
+
+
+
+
+ Like Dr. Strange versus Spider-Man in the mirror dimension — that impossible space where geometry folds back on itself, where buildings become M.C. Escher nightmares & reality reflects endlessly into its own depths.
+
+
+
+ neopig doesn't just archive websites. It can archive itself. It can archive the repositories that contain the code that does the archiving. It can crawl git forges & preserve the source code of tools that preserve source code.
+
+
+
+
Our spider-pig gets out of the danger of the mirror void — where days are years — and exits absorbing everything like a griffin, like a chimera, like a pig that feeds on bones of dead platforms.
+
+
+
+ When a code hosting platform dies (and they all die eventually — Google Code, Gitorious, BitBucket's hg repos), neopig ensures the knowledge survives. We are the ark. We are the vault. We are the pig that remembers.
+
+
+
+ Archives become self-extracting executables. .run files that contain their own server, their own search engine, their own reality. Drop one on a machine with Python, and it wakes up. A sleeping pig, carrying an entire website in its belly, ready to serve it to anyone who asks.
+
+
+
+
+
+
+
VI
+
+
The Arsenal
+
+
+
+
Async Domain Crawling
+
Full-domain recursive crawling with configurable depth. Respects robots.txt & crawl delays. Polite but relentless.
+
+
+
Content-Addressed Vault
+
MD5-based deduplication in a 9-deep hex directory structure. Same image from 100 pages? Stored once. Space is memory.
+
+
+
Full-Text Search
+
Every image indexed with its surrounding context — page title, alt text, captions, nearby headings. Find images by meaning, not filename.
+
+
+
Page Screenshots
+
LinkPeek reborn! Full-page captures via uri2png. wkhtmltoimage, cutycapt, or Playwright backends.
+
+
+
Hydra Mode
+
Auto-discover RSS/Atom/Sitemap feeds. Persists feed URLs, checks for new content on every crawl. Self-healing archive maintenance.
+
+
+
Media Provenance
+
Track first_seen, last_seen, and when each page first linked to media. Watch content spread across the web over time.
+
+
+
Markdown Conversion
+
Intelligent HTML-to-Markdown with forum post detection, noise removal & content extraction. Human-readable archives.
+
+
+
Self-Extracting Archives
+
Create .run executables that contain entire websites. Drop on any machine, execute, browse. Pig travels light.
+
+
+
Code File Support
+
Archive source code, stylesheets, fonts, and scripts alongside media. Complete preservation for developer communities.
+
+
+
VCS Repository Cloning
+
Auto-detect GitHub, GitLab, Bitbucket & more. Clone repos, symlink files to vault. Deduplicated code across forks.
+
+
+
Live Feed
+
Watch media appear in real-time as crawls progress. SSE-powered live updates. Pig hunts while you watch.
+
+
+
SERP Web Interface
+
FastAPI-powered search engine. Browse by type, search by context, view media details. Your personal media search engine.
+
+
+
+
+
+
+
+
VII
+
+
A Skeleton Key 🗝️🔑
+
+
+ neopig uses what we call the "skeleton key" approach to media indexing. For every image, we capture all the text that might help you find it later:
+
+
+
+
+ Page context: Title, description, headings near the image.
+ Image attributes: Alt text, title, surrounding captions.
+ Link context: Text of links pointing to the image.
+ Detail pages: For gallery sites, we follow through to detail pages & harvest their metadata too.
+
+
+
+ Result? You can search for "sunset over mountains" and find that image even if it was named IMG_4372.jpg with no alt text — because the page title mentioned it, or someone linked to it with descriptive text, or a caption three divs away contained the words.
+
+
+
+ Every door opens. Every search succeeds. Skeleton key fits every lock because it carries every possible key inside it.
+
+
+
+
+
+
+
VIII
+
+
Why We Archive
+
+
+ Web is ephemeral. Sites go dark. Forums shut down. Communities scatter. Platforms get acquired & gutted. Executives decide that Mercurial isn't profitable & delete every repository with a single corporate memo.
+
+
+
+ We have watched beloved communities vanish. Game modding forums. Technical documentation. Art galleries. Fan wikis. Personal blogs with decades of writing. Gone. Not archived by the Wayback Machine. Not cached by Google. Just gone.
+
+
+
+ neopig is built for preservation — capturing not just the media, but the context that gives it meaning. When you archive a site with neopig, you get:
+
+
+
+ • Original HTML with rewritten media links pointing to your local vault
+ • Full-text searchable markdown versions of every page
+ • Screenshots showing exactly how pages looked
+ • A SQLite database you can query, backup, and migrate forever
+ • Self-extracting archives that work offline forever
+
+
+
+
+
+
+
+
IX
+
+
A Forge
+
+
+ This tool was not built for profit. It was forged.
+
+
+
+ Forged in the fires of permacomputer.com — the belief that computing should be permanent. That knowledge should not evaporate when a company pivots. That communities should not lose their histories when a platform gets acquired. That the lore doesn't have to die when you get acqui-hired or outright terminated 🟣. A digital commons that belongs to everyone, forever.
+
+
+
+
+
+
Truth. Harmony. Freedom. Love.
+ — The quadrivium of a permacomputer
+
+
+
+ Truth — We preserve what actually existed, not sanitized versions. Original HTML. Exact timestamps. Unedited conversations. History as it happened, not as someone wishes it had.
+
+
+
+ Harmony — Every piece connects. Media links to pages. Pages link to context. Context links to meaning. Archive is not a graveyard of disconnected files but a living web of relationships, searchable, traversable, whole.
+
+
+
+ Freedom — Public domain. No licenses to parse. No corporate terms of service. Take it. Fork it. Run it. Share it. Code is yours. Archives you create are yours. No one can revoke your access to your own preserved knowledge.
+
+
+
+ Love — We archive because we care. About the communities that built these spaces. About the people who poured years into forum posts & wiki pages & blog entries. About the future researchers who will want to understand how we lived & thought & created. This is an act of love for human knowledge.
+
+
+
+ Pig is imbued with righteous fire. It does not crawl politely because it fears the powerful — it respects robots.txt because it honors the wishes of creators. It does not hoard in darkness — it preserves in light, making archives searchable, shareable, alive. A pig imbued with righteous fire.
+
+
+
+ When the platforms fall (and they will fall), when the corporate servers go dark (and they will go dark), when the executives decide your community isn't profitable enough to maintain (and they will decide this) — a permacomputer endures. Archives persist. Knowledge survives.
+
+
+
+ This is what we were forged to do.
+
+
+
+
+
+
+
X
+
+
Rules?
+
+
+ neopig is built on SQLite — the most deployed database in existence. SQLite adopted the Rule of St. Benedict as their Code of Ethics. 72 principles from a 6th-century monastery, governing software in the 21st.
+
+
+
+ We inherit this lineage. All 72 rules, unabridged:
+
+
+
+
1. Love the Lord God with your whole heart, soul, and strength.
+
2. Love your neighbor as yourself.
+
3. Do not murder.
+
4. Do not commit adultery.
+
5. Do not steal.
+
6. Do not covet.
+
7. Do not bear false witness.
+
8. Honor all people.
+
9. Do not do to another what you would not have done to yourself.
+
10. Deny oneself in order to follow Christ.
+
11. Chastise the body.
+
12. Do not become attached to pleasures.
+
13. Love fasting.
+
14. Relieve the poor.
+
15. Clothe the naked.
+
16. Visit the sick.
+
17. Bury the dead.
+
18. Be a help in times of trouble.
+
19. Console the sorrowing.
+
20. Be a stranger to the world's ways.
+
21. Prefer nothing more than the love of Christ.
+
22. Do not give way to anger.
+
23. Do not nurse a grudge.
+
24. Do not entertain deceit in your heart.
+
25. Do not give a false peace.
+
26. Do not forsake charity.
+
27. Do not swear, for fear of perjuring yourself.
+
28. Utter only truth from heart and mouth.
+
29. Do not return evil for evil.
+
30. Do no wrong to anyone, and bear patiently wrongs done to yourself.
+
31. Love your enemies.
+
32. Do not curse those who curse you, but rather bless them.
+
33. Bear persecution for justice's sake.
+
34. Be not proud.
+
35. Be not addicted to wine.
+
36. Be not a great eater.
+
37. Be not drowsy.
+
38. Be not lazy.
+
39. Be not a grumbler.
+
40. Be not a detractor.
+
41. Put your hope in God.
+
42. Attribute to God, and not to self, whatever good you see in yourself.
+
43. Recognize always that evil is your own doing, and to impute it to yourself.
+
44. Fear the Day of Judgment.
+
45. Be in dread of hell.
+
46. Desire eternal life with all the passion of the spirit.
+
47. Keep death daily before your eyes.
+
48. Keep constant guard over the actions of your life.
+
49. Know for certain that God sees you everywhere.
+
50. When wrongful thoughts come into your heart, dash them against Christ immediately.
+
51. Disclose wrongful thoughts to your spiritual mentor.
+
52. Guard your tongue against evil and depraved speech.
+
53. Do not love much talking.
+
54. Speak no useless words or words that move to laughter.
+
55. Do not love much or boisterous laughter.
+
56. Listen willingly to holy reading.
+
57. Devote yourself frequently to prayer.
+
58. Daily in your prayers, with tears and sighs, confess your past sins to God, and amend them for the future.
+
59. Fulfill not the desires of the flesh; hate your own will.
+
60. Obey in all things the commands of those whom God has placed in authority over you even though they should act otherwise, mindful of the Lord's precept, "Do what they say, but not what they do."
+
61. Do not wish to be called holy before one is holy; but first to be holy, that you may be truly so called.
+
62. Fulfill God's commandments daily in your deeds.
+
63. Love chastity.
+
64. Hate no one.
+
65. Be not jealous, nor harbor envy.
+
66. Do not love quarreling.
+
67. Shun arrogance.
+
68. Respect your seniors.
+
69. Love your juniors.
+
70. Pray for your enemies in the love of Christ.
+
71. Make peace with your adversary before the sun sets.
+
72. Never despair of God's mercy.
+
+
+
+ We archive not to hoard, but to give. We preserve not to control, but to liberate. Database that holds your memories runs on a foundation of ancient wisdom — and so do we.
+
+
+
+
+
+
+
XI
+
+
Invoke the Pig
+
+
+
# open http://127.0.0.1:31337 in browser
+python neopig.py --serve
+
+
+
+ neopig = Neo (new) + Python Image Grabber
+
+
+
+ A tip of the hat to original pig.py. A nod to Matrix's Neo — seeing through surface of web to underlying content within. And perhaps a warning: this pig has grown teeth.
+
'
- filename_el = f'
' for h in screenshot_hashes) + '
'
- # Metadata rows
+ # Metadata rows - (key, value) where key is looked up via t.get(key, key)
import hashlib
media_uri = sorted_sources[0]["media_uri"] if sorted_sources else None
neopig_media_uri = f"/view/{md5_hash}"
@@ -2854,16 +1290,16 @@ async def view_media_page(md5_hash: str, noai: bool = Query(False), lang: str =
neopig_page_uri = f"/page/{page_uri_hash}" if page_uri_hash else None
keywords_html = ''.join([f'{k}' for k in keywords]) or '-'
meta_rows = [
- ("{{source_uri}}", f'{media_uri}' if media_uri else '-'),
- ("{{neopig_uri}}", f'{neopig_media_uri}'),
- ("{{source_page}}", f'{page_uri}' if page_uri else '-'),
- ("{{neopig_page}}", f'{neopig_page_uri}' if neopig_page_uri else '-'),
+ ("source_uri", f'{media_uri}' if media_uri else '-'),
+ ("neopig_uri", f'{neopig_media_uri}'),
+ ("source_page", f'{page_uri}' if page_uri else '-'),
+ ("neopig_page", f'{neopig_page_uri}' if neopig_page_uri else '-'),
("MD5", f'
- 
-
- 
-
- 
-
- 
-
- 
-
- 
-
- 
+ {% endfor %}
+ 
+ {% endif %}
+ {% if m.filename %}
+