add-memberalign-toparrow-leftarrow-rightbellblockcalendarcamerachatchevron-leftchevron-rightchevron-small-downchevron-upcircle-with-crosscomposecrossfacebookflagfolderglobegoogleimagesinstagramkeylocation-pinmedalmoremuplabelShape 3 + Rectangle 1pagepersonpluspollsImported LayersImported LayersImported LayersshieldstartwitterwinbackClosewinbackCompletewinbackDiscountyahoo

Re: [la-ruby] scrubyt anyone?

From: Alf M.
Sent on: Friday, September 18, 2009 7:16 AM

It looks like scrubyt 0.4.x is just broken.? I uninstalled it and installed scrubyt 0.3.4 and RubyInline 3.6.3 (it won't run with later versions, I had to uninstall 3.8.3), and I was able to get it to run.

You might try having a look at scrAPI instead, if nobody in the scrubyt forums can help you get a later version running.? I haven't used it, but I have heard of it before.? Maybe somebody on the list has a favorite website scraping tool?

You can also just try straight hpricot or nokogiri with data you get back using open-uri or mechanize...


On Wed, Sep 16, 2009 at 2:13 PM, Audrey A Lee <[address removed]> wrote:

Are any of you using scrubyt?

Scrubyt has a forum but it seems near death.

But, this mail-list has a good group of very sharp and knowledgeable rubyists.

I have installed the scrubyt demos:
?- git clone git://

I tried this one:

$ ruby ruby_quiz_189.rb
`download_file': undefined method `include?' for nil:NilClass
? ? ? from /pt/r1/lib/ruby/gems/1.8/gems/scrubyt-0.4.1/lib/scrubyt/core/scraping/filters/download_filter.rb:8:in
? ? ? from /pt/r1/lib/ruby/gems/1.8/gems/scrubyt-0.4.1/lib/scrubyt/core/scraping/pattern.rb:250:in

I'd welcome any hints on how to debug ruby_quiz_189.rb so it will run.

scrubyt depends on some other gems:


Here is what I have:

$ gem list hpricot

*** LOCAL GEMS ***

hpricot [masked])

$ gem list mechanize

*** LOCAL GEMS ***

mechanize (0.9.3)


Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Audrey A Lee ([address removed]) from The Los Angeles Ruby/Rails Meetup Group.
To learn more about Audrey A Lee, visit his/her member profile:
To unsubscribe or to update your mailing list settings, click here:
Meetup Support: [address removed]
632 Broadway, New York, NY 10012 USA

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy