align-toparrow-leftarrow-rightbackbellblockcalendarcamerachatcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-crosscrosseditfacebookglobegoogleimagesinstagramlocation-pinmagnifying-glassmailmoremuplabelShape 3 + Rectangle 1outlookpersonplusImported LayersImported LayersImported Layersshieldstartwitteryahoo

Re: [la-ruby] scrubyt anyone?

From: Alf M.
Sent on: Friday, September 18, 2009 7:16 AM
Audrey,

It looks like scrubyt 0.4.x is just broken.? I uninstalled it and installed scrubyt 0.3.4 and RubyInline 3.6.3 (it won't run with later versions, I had to uninstall 3.8.3), and I was able to get it to run.

You might try having a look at scrAPI instead, if nobody in the scrubyt forums can help you get a later version running.? I haven't used it, but I have heard of it before.? Maybe somebody on the list has a favorite website scraping tool?

You can also just try straight hpricot or nokogiri with data you get back using open-uri or mechanize...

-Alf



On Wed, Sep 16, 2009 at 2:13 PM, Audrey A Lee <[address removed]> wrote:
Hi,

Are any of you using scrubyt?

Scrubyt has a forum but it seems near death.

But, this mail-list has a good group of very sharp and knowledgeable rubyists.

I have installed the scrubyt demos:
?- git clone git://github.com/scrubber/scrubyt_examples.git

I tried this one:

$ ruby ruby_quiz_189.rb
/pt/r1/lib/ruby/gems/1.8/gems/scrubyt-0.4.1/lib/scrubyt/core/scraping/filters/download_filter.rb:19:in
`download_file': undefined method `include?' for nil:NilClass
(NoMethodError)
? ? ? from /pt/r1/lib/ruby/gems/1.8/gems/scrubyt-0.4.1/lib/scrubyt/core/scraping/filters/download_filter.rb:8:in
`evaluate'
? ? ? from /pt/r1/lib/ruby/gems/1.8/gems/scrubyt-0.4.1/lib/scrubyt/core/scraping/pattern.rb:250:in
`evaluate'

I'd welcome any hints on how to debug ruby_quiz_189.rb so it will run.

scrubyt depends on some other gems:

hpricot
mechanize

Here is what I have:

$ gem list hpricot

*** LOCAL GEMS ***

hpricot [masked])

$ gem list mechanize

*** LOCAL GEMS ***

mechanize (0.9.3)

Thanks!




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
http://www.meetup.com/laruby/
This message was sent by Audrey A Lee ([address removed]) from The Los Angeles Ruby/Rails Meetup Group.
To learn more about Audrey A Lee, visit his/her member profile: http://www.meetup.com/laruby/members/10196215/
To unsubscribe or to update your mailing list settings, click here: http://www.meetup.com/account/comm/
Meetup Support: [address removed]
632 Broadway, New York, NY 10012 USA


Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy