{"id":558,"date":"2009-12-02T09:53:30","date_gmt":"2009-12-02T15:53:30","guid":{"rendered":"http:\/\/www.mooreds.com\/wordpress\/archives\/000558"},"modified":"2009-12-02T11:06:45","modified_gmt":"2009-12-02T17:06:45","slug":"hadoop-logging-case-study","status":"publish","type":"post","link":"https:\/\/www.mooreds.com\/wordpress\/archives\/558","title":{"rendered":"Hadoop logging case study"},"content":{"rendered":"<p>Here&#8217;s a <a href=\"http:\/\/www.slideshare.net\/schubertzhang\/case-study-how-rackspace-query-terabytes-of-data-2400928\">fascinating case study of the evolution of a (large!) log analysis toolset<\/a>. It follows Rackspace as they strive to allow searching logfiles from an ever growing number of servers, starting from manual ssh\/grep, through various incarnations of a MySQL database, and ending up using <a href=\"http:\/\/hadoop.apache.org\/\">Hadoop<\/a>\/<a href=\"http:\/\/lucene.apache.org\/\">Lucene<\/a>\/<a href=\"http:\/\/lucene.apache.org\/solr\">Solr<\/a>.\u00a0 There&#8217;s (some) more info on the <a href=\"http:\/\/blog.racklabs.com\/index.php?s=mapreduce&#038;searchbutton.x=0&#038;searchbutton.y=0&#038;searchbutton=Go!\">rackspace blog<\/a>.\u00a0 Cool stuff.<\/p>\n<p>Via <a href=\"http:\/\/rhinoresearch.com\">George Fairbanks<\/a>.<\/p>\n<p>[tags]lucene, solr,case study,hadoop[\/tags]<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Here&#8217;s a fascinating case study of the evolution of a (large!) log analysis toolset. It follows Rackspace as they strive to allow searching logfiles from an ever growing number of [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28,4,33],"tags":[],"class_list":["post-558","post","type-post","status-publish","format-standard","hentry","category-mysql","category-technology","category-useful-tools"],"_links":{"self":[{"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/posts\/558","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/comments?post=558"}],"version-history":[{"count":0,"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/posts\/558\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/media?parent=558"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/categories?post=558"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.mooreds.com\/wordpress\/wp-json\/wp\/v2\/tags?post=558"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}