« Listings Want to Be Free | Main | Google Classifieds? »

August 10, 2005



I was thinking to write a meta search engine to crawl all your listing, plus some others not indexed by yours.Is it ok? If not, why?


I'm anxious for an answer to the previous comment...oodle?


Sorry for the delayed response. Have been traveling.

Meta searching is fine as long as it's handled appropriately (within the bounds of net-etiquette). Such is the case with other search engines such as Google and Yahoo...


I noticed that the job section has monster, hotjobs, etc. Being a lawyer, I read their TOS and it specifically says that you cannot redisplay or manipulate their data w/o their consent. Do you have their written permission?


Hey Dumb-Dumb,

"We are not an aggregator in that we don't display listings. Our job is to point our users to listings published on other sites."

An aggregator does not display content either. Therefore, you are an aggregator or a scraper.


Do you have their written permission? (
monster, hotjobs)




The only point I was trying to make is that people don't think of Google as an aggregator. We act just like them (showing summaries to help people find the right listing).

That said, if Google is an aggregator to you then please consider us an aggregator.


With respect to the question(s) above -- do we have written relationships with companies like Monster and do we check every terms of use agreement - the answer is no.

There would be no billion page indexes if search engines needed to check every terms of use agreement on every website. Instead, search engines rely on a well established etiquette using robots.txt. We check robots.txt every time we visit a site. We also conform to the net-etiquette around search results lists (display summaries, attribute, etc).


how, in what universe, can it occur to you that oodle does not compete with the content providers for viewers? why would a viewer go to a site that sells 10 widgets when it can select form a site that has 100? can you twist logic enough to answer that?


Dear Craig,

I recently subscribed to your blog, because of your great vertical website. I am also working on my own vertical search engine and I just wanted to say you and your team are all doing a great job at Oodle.com. Keep up the good work!


The comments to this entry are closed.