Follow

I feel like bookmarks are good but insufficient. What I really want is something more akin to a personal Wayback Machine.

Does anyone know of a tool to do that easily? I could write a web scraping tool easily but I feel like this must already have been done.

· · Web · 6 · 1 · 4

@emacsen I believe there's a Firefox extension that basically saves every web page you visit. I forget the name. Possibly @Greg would know?

Maybe a name like memex?

@liw @emacsen Yup! That's it: addons.mozilla.org/en-US/firef

I had it installed for a while and it did what you want, it was just a bit unstable at the time. Haven't tried in over a year so maybe better now?

@Greg @liw @emacsen i had a similar experience. it seemed like a fairly powerful set of ideas, but it was too crashy and resource intensive at the time. might be worth revisiting.

@emacsen I've thought about running ArchiveBox:

archivebox.io/

And I've just noticed they have a potentially useful list of similar projects that might prove useful:

github.com/pirate/ArchiveBox/w

@emacsen HTTrack website copier
"It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer."

httrack.com/

@emacsen pinboard has a service tier where they scrape and archive anything you bookmark.

@emacsen
Scrapyard is a Firefox bookmarking extension that resides in sidebar where you can store and organize bookmarks, page fragments or complete documents in unlimited quantities.
github.com/GChristensen/scrapy

@emacsen

Recently I have interacted with a German user who has done something along these lines

You feed it a url and it stores it in an archive service and keeps a handle to the stored content

Too bad I can't find it again 😔

Sign in to participate in the conversation
Mastodon

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!