Google Shares Some Data - n-grams

Posted by Marshall on August 06, 2006 | Link It

Google Research is giving away a huge amount of data on 6 DVD’s that can be used for further keyword research.

"We believe that the entire research community can benefit from access to such massive amounts of data. It will advance the state of the art, it will focus research in the promising direction of large-scale, data-driven approaches, and it will allow all research groups, no matter how large or small their computing resources, to play together.

That’s why we decided to share this enormous dataset with everyone. We processed 1,011,582,453,213 words of running text and are publishing the counts for all 1,146,580,664 five-word sequences that appear at least 40 times. There are 13,653,070 unique words, after discarding words that appear less than 200 times.

Watch for an announcement at the LDC, who will be distributing it soon, and then order your set of 6 DVDs. And let us hear from you - we’re excited to hear what you will do with the data, and we’re always interested in feedback about this dataset, or other potential datasets that might be useful for the research community.

I’m not sure how a normal SEO person who is not a computer scientist is going to be able to use the data - also Google does not specify what time period the data was collected.  It’s interesting that Google is doing this.



Post a Response

Name (required)

Email (required, not published)

Website (optional)

Note: The following tags are approved for comments on this blog:
<a href=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <code> <em> <i> <del> <strong>





Subscribe

RSS Subscribe View my FriendFeed Current Subscribers