Wednesday, November 10, 2010

Google Refine 2.0

(Cross posted on Google Open Source blog.)

Our acquisition of Metaweb back in July also brought along Freebase Gridworks, an open source software project for cleaning and enhancing entire data sets. Today we’re announcing that the project has been renamed to Google Refine and version 2.0 is now available.

Google Refine is a power tool for working with messy data sets, including cleaning up inconsistencies, transforming them from one format into another, and extending them with new data from external web services or other databases. Version 2.0 introduces a new extensions architecture, a reconciliation framework for linking records to other databases (like Freebase), and a ton of new transformation commands and expressions.

Freebase Gridworks 1.0 has already been well received by the data journalism and open government data communities (you can read how the Chicago Tribune, ProPublica and data.gov.uk have used it) and we are very excited by what they and others will be able to do with this new release. To learn more about what you can do with Google Refine 2.0, watch the following screencasts:





Posted by at

14 comments:

  1. William LindnerNovember 11, 2010 at 11:18 AM

    This looks awesome! Is it possible to export it to an Oracle table?

    ReplyDelete
  2. Tim GrahamNovember 16, 2010 at 4:23 PM

    looks great. is it possible to do the following?

    1. create transformations and save in a "project"
    2. apply those transformations to newly arrived data and export to a file, all without opening google refine (eg: using a command line like "googlerefine.exe myproject.prj myoutput.csv"

    ReplyDelete
    Replies
    1. UnknownSeptember 19, 2013 at 4:22 PM

      did you ever get an answer to this question? i'm interested in doing the same thing

      Delete
  3. Sharon McnaryJanuary 5, 2011 at 12:54 PM

    I've had difficulty downloading it to my PC. Where do you post system requirements?

    ReplyDelete
  4. CornelFebruary 18, 2011 at 3:26 AM

    Thanks a lot for this awesome tool. 1 day of work => 1 hour. Magic.

    ReplyDelete
  5. BenApril 28, 2011 at 10:29 AM

    Video #3 (on Data Augmentation) is shown as private whenever I try to play. Any chance you can fix that? The first two were helpful, and I'm looking forward to learning more.

    I was also wondering the same thing Tim asked about. Is there any way that Google Refine's functions can be automated?

    ReplyDelete
  6. megmedMay 31, 2011 at 1:25 AM

    Why Movie #3 isn't available anymore?

    ReplyDelete
  7. Steve ChanJune 5, 2011 at 10:20 PM

    Any explanation why Video #3 has been "privatized"?

    ReplyDelete
  8. FrankJune 29, 2011 at 9:38 PM

    Still waiting for an answer to the last three (identical) queries.

    ReplyDelete
  9. FrankJune 29, 2011 at 9:43 PM

    Oh, never mind. Someone left a copy: http://code.google.com/p/google-refine/downloads/detail?name=refine-2.0-data-augmentation.mp4&can=2&q=

    ReplyDelete
  10. BloggerJuly 9, 2011 at 11:49 AM

    Your post is nice.I have liked the way you have written this.I have listed your blog in my blog directory.To check this please visit <a href="http://submitbloggettraffic.blogspot.com”>Submit Blog Get Traffic</a>

    ReplyDelete
  11. BloggerJuly 9, 2011 at 11:50 AM

    Your post is nice.I have liked the way you have written this.I have listed your blog in my blog directory.To check this please visit Submit Blog Get Traffic

    ReplyDelete
  12. AnilDecember 27, 2011 at 4:13 AM

    Not able to see 3rd (Data Augmentation) video Error saying "This video is private"

    ReplyDelete
  13. Paul M. YoungAugust 3, 2012 at 8:34 AM

    Is Google Refine still a live project?

    ReplyDelete

Subscribe to: Post Comments (Atom)