Improved craigslist.org all city search

April 16, 2005

Due to popular demand one person's request, I added for sale searching to my existing craigslist.org all-city search page. I also made a few other minor improvements:

  • Searching of Jobs or For Sale items
  • Selection of subcategories
  • Age of posts in days is shown as an offset from today
  • Very recent and very old posts are highlighted differently
  • If location is available, it can be mapped via Google maps
  • Minor speed improvements

Try it out! I'm open to any additional feature requests.

Except for an all-cities personals search, because that would be downright freaky. I just don't even want to know.

Posted by Jeff Atwood
45 Comments

Have you seen this one: http://www.paulrademacher.com/housing/

I have no idea how they do it.

Steve Campbell on April 20, 2005 12:23 PM

Yeah, I have, and that one is VERY cool! Unfortunately I don't have complete street addresses to map, only cities.

Jeff Atwood on April 20, 2005 1:36 PM

Love your Craiglist search. Thanks so much for it! Makes my job easier :)

Jess on May 17, 2005 12:09 PM

It ran really fast yesterday, but something's going on tonight for some reason.

I had to make some serious changes.

How'd you get around the block by Craigslist? CLSearch.org had something very similar, but Craigslist said he was crushing their servers and blocked his IP.

The primary difference is that I am not using RSS, but gzipped HTTP requests for the first page of results. This should be a lot less demanding than the full RSS feed.

I'm not trying to get anyone in trouble here, or develop any kind of widely publicized service. It's a utility for me (I needed it for my nationwide job search) that I thought others might find useful too.

If the craigslist.org guys ask me to stop, then I'll stop.

Jeff Atwood on May 17, 2005 1:07 PM

Excellent tool! I do want to ask what's up tonight though. It ran really fast yesterday, but something's going on tonight for some reason.

How'd you get around the block by Craigslist? CLSearch.org had something very similar, but Craigslist said he was crushing their servers and blocked his IP.

JayAnne on May 17, 2005 1:46 PM

This is extremely useful. Thanks for making it available!

JT on May 18, 2005 7:00 AM

I feel so stupid. I figured that out about twenty minutes after I asked the question. That's even better than seeing the date!

AWESOME

mouse on May 22, 2005 10:51 AM

What do the numbers mean next to the results and why are some yellow? I would love to be able to see the date of the posts in your all city search page as part of the results...... because craigslist is always full of old irrelevent and exired job posts and I'd hate to get my hopes up.

Thanks for the cool program. I love it.

mouse on May 22, 2005 12:47 PM

The number to the left is the number of days since that entry was posted.

Jeff Atwood on May 22, 2005 12:59 PM

Hello,
I use your site everday (search all of craigslist engine..., its perhaps the most useful tool i have run into in years, and i want to donate money to your cause, and the project. While i can not afford to donate much, you should realize this will be my first contribution to any freeware/groupware etc ever, so you should be impressed that i am so impressed.

Regards,
Nate - Austin Texas.

Nate DesJardins on May 30, 2005 12:34 PM

That's very kind of you, Nate, but I recommend donating it to Craigslist-- they are ultimately the source of all the data!

Jeff Atwood on May 31, 2005 3:52 AM

Hey Jeff, I've used the search since it first when up. It's been rock solid an amazing, thanks again for writing the code. It seems something has changed in the last two days, either the page won't open due to bad server response or the individual sites come back with "bad server request, the server returned an error (400). I guess I'm wondering if this is a temporary thing or CL is trying to block the search. Thanks again. Jeff Cook

jc on June 1, 2005 7:28 AM

Jeff,

Some cities (varies each time) are coming back with:
couldn't retrieve HTML from 'http://www.craigslist.org/cgi-bin/search?query=%22Telecommuting+is+OK%22areaID=50subAreaID=0cat=ofcaddOne=telecommuting' The remote server returned an error: (400) Bad Request.

It's been happening for a couple days. Just a heads up!

Barb

BarbC on June 1, 2005 10:38 AM

Hey there,
Great site, I use it every day. Thanks. Any chance of adding a "gigs" system-wide search as well?

E on June 1, 2005 1:57 PM

Hi Jeff,

Can you explain to me what the message "FORM or QUERYSTRING variable 'query' was not provided" means? It's been coming up everytime I try to search lately (doesn't seem to matter what I am searching). Thanks, Kippi

Kippi on June 6, 2005 4:35 AM

Kippi, are you doing blank searches? That means you didn't provide a query term. Eg if you just click "search" right after loading the page, you'll get that.

Jeff Atwood on June 6, 2005 6:42 AM

Extremely helpful tool, thanx! hope they don't close it down.

TW on June 16, 2005 6:22 AM

I found your search site today and it's works wonderfully. I did notice that ramdom craigslist sites return this error:

The underlying connection was closed: Unable to connect to the remote server.

Not every city does it every time so it's wierd.

MP on June 17, 2005 4:45 AM

After attempting to contact Jeff with no reply the IP's that this tool uses have been blocked. We appreciate that some find this tool useful but it's in direct violation of our TOU and is implemented in a way that thrashes our search databases.

-Bill (CL Sys Admin)

Bill Swingle on June 22, 2005 3:57 AM

unlucky.

i am curious what the violation is, and whether it could be implemented in a way that would be legitimate. like www.housingmaps.com, it seems clear that this would be a very popular tool.

do the CLs just have a moral bias for local economies?

murphy on June 22, 2005 4:07 AM

There are really two issues here:

1) Craigslist is a *local* tool and we discourage any tool that blurs that distinction

2) The manner in which this tool gets information from our site is all wrong. The reason that we don't mind housingmaps.com traffic is that they pull one RSS feed a day to update their data.

#1 is enough to make us unhappy about this so it doesnt matter if #2 changes or not.

Sorry :(

-Bill

Bill Swingle on June 22, 2005 4:19 AM

thanks for your reply, Bill. I responded on the CL forum, titled pros and cons, here:

a href="http://forums.craigslist.org/?ID=29345737"http://forums.craigslist.org/?ID=29345737/a

j murphy

murphy on June 22, 2005 5:55 AM

I am here, and I got your email, I just haven't had time to disable the service yet. I attended the nVidia 7800 launch event yesterday all day (and I mean literally ALL day, 8am - 12am). I'll disable it when I get home.

Jeff Atwood on June 22, 2005 6:35 AM

Hey, the All Search is down, giving the error in /Craigslist server error, cannot find search.aspx or something to that effect.

Anybody see this yet?

Would be great if you can get it back up, its an excellent tool.

mike on June 23, 2005 3:22 AM

If you have any comments, don't post them here because the cl.org staff are not likely to see them. Post in the cl.org forums instead using the thread that J. Murphy created:

http://forums.craigslist.org/?ID=29345737

Jeff Atwood on June 23, 2005 5:26 AM

There are those of us that want to check for "telecommute" jobs, and since those are not always relevant to what is "local" it makes sense to search the entire collection of sites.

So, for example, since I live in Italy (American) and would like to search telecommute jobs with companies in the US, I have to search each subdomain one by one, its nonsense.

They allow telecommute only jobs but expect only "locals" to be applying and getting those jobs, the logic fails. Their suggestion to subscribe to 70+ RSS feeds and wade through them also fails my comprehension.

Your tool was useful, it saved me time, helped the companies looking for me to find me quicker, which is the whole point behind their reason to post a listing on CL... :(

It was nice while it lasted.

Ciao

Matt on June 23, 2005 6:38 AM

I tried your search with "salesforce.com" and I got a bunch of errors. This would great especially if I could subscribe to something and the results were mailed to me.

Thanks

Mark Bruso on November 18, 2005 8:14 AM

Hello,
I use your site everday (search all of craigslist engine..., its perhaps the most useful tool i have run into in years, and i want to donate money to your cause, and the project. While i can not afford to donate much, you should realize this will be my first contribution to any freeware/groupware etc ever, so you should be impressed that i am so impressed.

Regards,
mitch hoerr-austin texas

mitch hoerr on August 16, 2006 7:06 AM

it's sad that they've disabled your tool

daset on December 4, 2006 3:45 AM

Yep, it's sad that Craigslist will not let you use a nation wide search, but it's typical of them and their ways.

Petz on March 14, 2007 6:57 AM

HI. I am new to craigslist. it seems all of the emails i send always come back to me no matter which email address i use. iT SAYS failure notice. Dont know what i am doing wrong. I just email with my own email back.

Lily on July 11, 2007 11:36 AM

Sorry i did not explain that this is for job opportunities.

Lily on July 11, 2007 11:39 AM

Hi, Guys

I recently made a yahoo widget for craigslist, I call it CLUpdater.

It is an RSS reader for craigslist that features an picture preview window.

It supports both Windows and Mac OS, and it supports all 204 craigslist cities plus 129 categories.

Go check it out. You can search for CLUpdater on yahoo or google to get the link.

or http://widgets.yahoo.com/gallery/view.php?widget=42701

Enjoy!!!

Max on October 21, 2007 7:05 AM

If you need craigslist multiple city search, you can use CLSearch V2.20. It is also free for download.

http://www.craigslistcompanion.com/

Max on October 21, 2007 7:06 AM

I use this tool. It is not free, but finally there is someone who actually made possible to save me hour or two daily. I've try everything, and now use this.

http://www.CraigsPal.com

Justin on December 5, 2007 3:52 AM

Google based implementation

mike on December 5, 2007 7:44 AM

Google based implementation

sorry, here is the link http://craigfind.com

mike on December 5, 2007 7:45 AM

http://www.craigslist-search.com/

this is a new craigslist mashup just came out very recently, very cool and very easy to use to search multiple craigslist city and categories at once.

Craigslist-Search on June 12, 2008 3:06 AM

Just stumbled onto your site. I have been using a href="http://www.searchentirecraigslist.com/"http://www.searchentirecraigslist.com//a which is pretty basic but I like it. I will check yours out tho for sure.

Tom on June 22, 2008 2:21 AM

Try CraigZoom: http://craigzoom.com

chad on November 9, 2008 10:23 AM

Here is a way to search for cars broader than just by cities or regions.
(seven states for now):

http://rprybyslav.mine.nu:8181/craigslistsearch/

ross on December 7, 2008 9:03 AM

We just wrote an full-featured ruby library to scrape listings. Too we packaged it with a useful script to automate daily email reports on new posts. Everything's well documented, and we hope it takes off as the de-facto ruby-craigslist library: Check it out in action here: http://www.derosetechnologies.com/community/libcraigscrape

Chris DeRose on May 6, 2009 2:46 AM

Searching multiple cities or multiple categories simultaneously is always a panic. This free tools may help you to Search all craigslist cities http://www.seekyouritem.com/cl/

Thanks.

Search all craigslist cities on July 19, 2009 3:44 AM

If you're not looking for global results, you can get SMS & TEXT updates with this tool here: http://www.craigspy.net

craigspy.net on August 12, 2009 7:30 AM

Try CraigSpy - it lets you search multiple keywords (including AND/NOT keyword features,) multiple locations, multiple categories, and it also automatically searches for you while you're away from the computer. http://www.craig-spy.com is the site

jason on February 6, 2010 9:29 PM

The comments to this entry are closed.