Shush, it's SHS... The Scalable Hyperlink Store

Microsoft Research - Scalable Hyperlink Store

The Scalable Hyperlink Store is a specialized "database" for the web graph. SHS maintains the web graph in main memory, distributed over many machines. The system is available as C# source code as well as precompiled binaries.

Publications

• Marc Najork, The Scalable Hyperlink Store, in 20th ACM Conference on Hypertext and Hypermedia, Association for Computing Machinery, Inc., June 2009
• Marc Najork, Dennis Fetterly, Alan Halverson, Krishnaram Kenthapadi, and Sreenivas Gollapudi, Of Hammers and Nails: An Empirical Comparison of Three Paradigms for Processing Large Graphs, in 5th ACM International Conference on Web Search and Data Mining (WSDM), ACM, February 2012

...

Scalable Hyperlink Store (Download)

The Scalable Hyperlink Store is a specialized "database" for the web graph. SHS maintains the web graph in main memory, distributed over many machines.

Download details

File Name: SHS-release-v1.0.zip

Version: 1.0

Date Published: 18 December 2013

Download Size: 4.44 MB

Hum... how to use this... There's got to be a way I can do something with this...

Here's a snip from the zip;

NOTE: This is a MSR-LA licensed project (so no commercial usage)