Software

The Dark and Stormy Archives project has started several software projects for community use. These projects help users analyze, reduce, and visualize web archive collections.

AIU

AIU is a Python library that gathers seed URLs and metadata from Archive-It, Pandora, and Trove collections via screen scraping and knowledge of APIs.

The Off Topic Memento Toolkit (OTMT)

The Off-Topic Memento Toolkit detects and identifies mementos that may be off-topic in a web archive collection. It does so through the use of topic modeling and similarity measures. This is a necessary step to discovering the best mementos in the collection for use in summarization and storytelling.

MementoEmbed

MementoEmbed produces surrogates of individual mementos from web archives. These surrogates represent the mementos in forms such as cards or thumbnails for use in social media storytelling.

Raintale

Raintale takes the data generated from MementoEmbed and produces full stories of mementos suitable for publishing using services such as Twitter, Jekyll, or Blogger.

Hypercane

Hypercane selects the best mementos from a collection using a variety of different methods. It uses content provided by other components such as AIU, the Off-Topic Memento Toolkit, and MementoEmbed.

The storm software icons on this page are derived from images created by Raphael Silva and the funnel icon is derived from an image created by Clker-Free-Vector-Images. Both have been remixed in compliance with the Pixabay License. No attribution is required, but we provide it here in gratitude to the original creators. The clock used as a web archive symbol in these icons is in the public domain.