Here’s a fascinating case study of the evolution of a (large!) log analysis toolset. It follows Rackspace as they strive to allow searching logfiles from an ever growing number of servers, starting from manual ssh/grep, through various incarnations of a MySQL database, and ending up using Hadoop/Lucene/Solr.  There’s (some) more info on the rackspace blog.  Cool stuff.

Via George Fairbanks.

Technorati Tags: , , ,

2 thoughts on “Hadoop logging case study

  1. moore says:

    Thanks George, lots of great numbers in the highscalability post.

Leave a Reply

Your email address will not be published. Required fields are marked *


one × 6 =

 


© Moore Consulting, 2003-2010 +