Planet Perrygeo

February 05, 2010

Paul Ramsey

Chocolate and Peanut Butter?

My two favourite things, ArcView 3 and PostGIS, together at last...



by Paul Ramsey (noreply@blogger.com) at February 05, 2010 08:17 PM

February 03, 2010

Tom Kralidis

Why XML Libraries Rock

msautotest is MapServer’s way of unit testing and sanity checking various features and bug fixes. When testing the addition of AuthorityURL and Identifier support in WMS Capabilities XML, I found an issue with the output being invalid XML, which was tested and fixed. Another fix was then added to ensure valid XML (isn’t open source [...]

by tomkralidis at February 03, 2010 11:46 PM

February 02, 2010

Paul Ramsey

Die legacy, die!

'Tis the season to drive a stake through the heart of old technology apparently. Steve Jobs appears to be taking especial glee in killing off Flash as a video format. And Google is doing their damnedest to run IE6 out of town. It takes a certain amount of self-confidence in yourself to pit your unstoppable force against the immovable object of an entrenched de facto standard, but both Apple and Google seemed positioned to carry it off.



In the case of Google, the sheer number of alternatives, ease of access to those alternatives, and popularity of their products will be enough to pry the final population of IE6 users out of their millennial stupor.



For Jobs, the task requires more balls (right now, his crown jewel iPhone is showing lots of holes in web pages where Flash content should be), but is slightly easier, because he doesn't have convince millions of users to change their software, he only has to convince a handful of web sites to add an HTML5 option. And the HTML5 standard on video embedding is just close enough to "ready" that those sites (YouTube, vimeo, etc) will begin providing HTML5-based alternatives to browsers that can support them (like, the iPad, and Safari, and the iPhone).



I wish godspeed to both Apple and Google in their endeavors, since both Flash video and IE6 can't hit the scrapheap soon enough, in my opinion.

 

by Paul Ramsey (noreply@blogger.com) at February 02, 2010 04:17 AM

February 01, 2010

Chris Schmidt

How KML Succeeds and Fails as a Web Format

KML is linked. It is self-descriptive, and can rely entirely on following of links to obtain more information, whether that is styles or additional data.

However, the most common way of packaging KML is as KMZ — which is sort of like packaging an HTML page inside a zip file with all of its component parts. When this is done, web-based tools — like the Javascript support in browsers — lose all access to the data other than through a server side proxy (and even that isn’t a trivial thing to achieve). Styling information and related parts are not stored as separate resources on the web. The information available in the KML has suddenly become just another application-specific format.

If this were uncommon, it wouldn’t be such a shame; it’s certainly possible to distribute data like this for use cases where it is necessary, including offline use and other use cases. However, this is not a limited situation — in fact, more than 80% of KML made available on the web tends to be primarily available as KMZ. This packaging of KML leaves much to be desired, and limits the use of such data in web-based tools.

The web already has ways to compress data — gzip-based compression is common on many web servers (a tradeoff of CPU time for bandwidth), and works fine in all KML clients I’m aware of (including Google Earth and Google Maps). This lets your data exist on the web of resources and documents, rather than in a zipped up bundle.

My interest in this matter should be obvious: I work with mapping on the web. Ideally, I work with tools that don’t require server-side code — every piece of server side code you have to build is another heavy requirements placed on the users of any software. Browsers, as a common platform across which developers can code, are a worthwhile target, and trapping your data in KMZ hides it from browsers.

Free your KML! Publish on the Web! Don’t use KMZ!

by crschmidt at February 01, 2010 03:46 PM

January 29, 2010

Chris Schmidt

Haiti Crisis Map Effort

One of the most difficult thigns to do in time of disaster is to quickly organize, marshal, and present resources. This applies across all aspects of disaster response — whether it be managing and distributing food, organizing volunteers, or setting up technical resources to assist with the relief effort.

The last is the field I obviously have the most experience/ability to help with, especially with regard to mapping. In past situations, I have put some of my map expertise to work in helping to create a resource for the disaster; the last significant case for me was in 2007, when I managed a ton of imagery made available as part of the efforts with regard to the San Diego wildfires. (That map is still available, though it’s a bit worse for the wear at this point.)

When the Haiti Crisis happened, I let it slide; I figured that someone else would step up to manage the data this time. After a while, though, I saw an increased number of imagery sources, and little coherent organization of the resources by a single party — one of the key things that made the 2007 fires map successful. As a result, and combined with some data that was being more narrowly published, I decided to set up a map. The first day I did any significant work on this was over the weekend of the 15th.

At first, the map wasn’t particularly great; it was primarily just a tool to view a bunch of satellite data that was being made available. This was primarily just a quality control check for users of OSM who needed access to the data to complete the map of Haiti. Over time, more data became available — and more importantly, the OpenStreetMap map data became a primary map for the area and rescue efforts. Suddenly, the Haiti Crisis Map — then just the “UAV map” — was being used more and more.

As more and more data became available, the old map, using a simple OpenLayers layer switcher, became unwieldy; never a user-friendly layout to begin with, adding 20 layers to an OpenLayers map with an unplanned mix of base and overlay layers leaves much to be desired.

By Wednesday, it was clear that the hodge-podge of available disk space attached to the hosting machine wasn’t going to cut it; though we started with just over 4TB available spread over 3 different drives, managing the data was becoming unwieldy at the same rate as the UI. Thankfully, by Wednesday the 20th, John Graham was able to get access to another Sun X4500 and set it up, giving us a clean 16TB drive to put new and old imagery on. (About 6 hours later, the NFS machine to which all of the current data was stored began to fail, most likely due to heavier than normal load on the machine; I spent most of that day moving data off the old drive and onto the new.)

In addition to the data migration, at this time, Aaron Racicot was able to step up and offer his help in building a GeoExt based UI for the map. His efforts turned my hack into a reasonable UI for browsing the map, and it is really only because of that that I was able to keep going.

Over the weekend, at CrisisCamp, I was able to add additional features to support Ushahidi; the code was moved into Github, haitibrowser. In the middle of this week, the code was integrated into APAN, the All Partners Access Network, to support the efforts of SOUTHCOM in maintaining a high quality Central Operating Picture of events in the area.

Over the past two weeks, data has continued to pour in, in the hundreds of gigabytes a day. This is in part thanks to the wonderful availability of imagery thanks to the generosity of the commercial providers, in addition to the data made available by organizations like NOAA, companies like Google, and more. The extremely high quality imagery produced by RIT/ImageCat/WorldBank, for example, is an example of what is possible with the hard work of people with great hardware and a great team.

Using my knowledge — gleaned from my efforts in the earlier days of OpenAerialMap — I have been able to process this data and make it available as tiles and WMS to all consumers, primarily targeted towards OpenStreetMap editors. Over two dozene layers are available via what is now called the Haiti Crisis Map, each one adding a different viewpoint of data. In addition, the map contains links to other files like KML collections from Ushahidi and Sahana, and as recently as yesterday, gained the ability to create your own layers, which you can access in the map and provide as a link to someone else, as well as export as KML.

As part of the process of making the site more readily available, it is now available from haiticrisismap.org.

The most difficult part of this is attempting to manage the large sources of data. Thankfully, the resources that I have available have allowed me to be a bit lax in my conservation of disk space, CPU time, etc. Many thanks to CalIT, SDSU/SDSC, and Telascience for organizing these resources. In addition, a lot of the ‘hard work’ in the UI has been done by Aaron Racicot of Z-Pulley. I’ve done a lot of minor work, but the major UI layout and work has been done by him.

Thankfully, I’ve had the support of a lot of good people in this effort, and a lot of good tools to use. Using GDAL + OSSIM in the background for image processing, MapServer + TileCache for mosaicing and serving, OpenLayers + GeoExt for a UI, and OSM for a base map data layer have all made this effort possible.

The haiticrisismap will continue to see improvements. It shows a lot about what a dedicated small group of people can do with an investment when properly motivated; I can honestly say that because of the resources made available through these efforts, we have saved lives. Whether it is through maps produced through OSM being loaded onto Volunteer GPS systems, or the use of the data to determine an accurate location in a map by Ushahidi volunteers, this tool has been an effective aid to the relief effort in Haiti, and will continue to do so as much as is possible in the coming days and weeks.

by crschmidt at January 29, 2010 10:38 PM

January 26, 2010

Joel Spolsky

Why testers?

My sister got her kids a little puppy, and they’ve been trying to train it. To live with a dog in the house, you need to teach it not to jump on people, not to poop in the house, to sit on command, and to never, ever, ever chew on the iPad. Never. Good girl.

With dogs the main trick to training is that feedback has to be immediate. If you come home to discover that, hours before, the dog tipped over the garbage can in the kitchen, it’s too late for training. You can yell at her but she just won’t get what you’re going on about. Dogs are just not that smart.

For programmers, getting better at what you do requires quick feedback, positive and negative, on what you’ve just done. The faster you get the feedback, the faster you’ll learn. With long-cycle shrinkwrap software, it can take a year or more to hear feedback from customers.

That’s one of the reasons we have testers. A great tester gives programmers immediate feedback on what they did right and what they did wrong. Believe it or not, one of the most valuable features of a tester is providing positive reinforcement. There is no better way to improve a programmer’s morale, happiness, and subjective sense of well-being than a La Marzocco Linea espresso machine to have dedicated testers who get frequent releases from the developers, try them out, and give negative and positive feedback. Otherwise it’s depressing to be a programmer. Here I am, typing away, writing all this awesome code, and nobody cares. Boo hoo.

Who should be a tester? That’s tricky! Software testing is one of those careers that isn’t that well known, so a lot of people who would be great at testing and would probably enjoy it a lot never consider applying for jobs as testers.

Signs of a good tester:

  • Scientific
  • Loves a good puzzle, even the kind that takes days to solve
  • Likes to think about things methodically
  • Generally likes working with software and computers

You don’t have to be a programmer to be a tester. A lot of companies want testers to be programmers who write automated test suites. It seems more efficient that way. This reflects a misunderstanding of what testers are supposed to do, which is evaluate new code, find the good things, find the bad things, and give positive and negative reinforcement to the developers. Sure, automated test suites are a time saver, but testing software covers so much more than that. If you put too much emphasis on those scripts, you won’t notice misaligned text, hostile user interfaces, bad color choices, and inconsistency. Worse, you’ll have a culture of testers frantically working to get their own code working, which crowds out what you need them to do: evaluate someone else’s code.

A particularly terrible idea is to offer testing jobs to the programmers who apply for jobs at your company and aren’t good enough to be programmers. Testers don’t have to be programmers, but if you spend long enough acting like a tester is just an incompetent programmer, eventually you’re building a team of incompetent programmers, not a team of competent testers. Since testing can be taught on the job, but general intelligence can’t, you really need very smart people as testers, even if they don’t have relevant experience. Many of the best testers I’ve worked with didn’t even realize they wanted to be testers until someone offered them the job.

If you:

  • Love software and computers
  • Want to work on a software team, and
  • Don’t particularly like programming

you should consider being a tester. (We’re hiring! What a coincidence!)

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at January 26, 2010 09:04 PM

Paul Ramsey

Happy Jobsmas Eve!

How does your family mark Jobsmas Eve? Do you sing 1,2,3,4 and dance around your AirPort Extreme router, like my family? Or do you have a more relaxed, modern Jobsmas Eve, and just play networked iPod games together?



While, obviously, I am excited about the approach of Jobsmas, I find the hand-wringing and obsession about the physical shape of the Gift to be a bit over the top.



Possible Representation of the Gift



No matter what, it's going to be a glass slab about the size of a hard cover book, OK? Does it really matter if the back is silver or black? What gets my Jobsmas noodles in a knot is ... what is it going to do???



It's all about the software, how is this Gift different from the Gifts that have come before? Will the the new feature be something pointless and pretty like "Cover Flow", or something useful and immediately intuitive like "flick to scroll"? Pointless and pretty would be virtual 3D display via head tracking. Useful and intuitive would be pen-less handwriting.



No matter what, I am looking forward to getting up tomorrow, putting on my black turtleneck and black jeans, and celebrating true spirit of Jobsmas, by oggling the Gift and figuring out how it Changes Everything.

 

by Paul Ramsey (noreply@blogger.com) at January 26, 2010 05:29 PM

January 25, 2010

Joel Spolsky

Rocket Surgery Made Easy

Steve Krug has written a follow up to his usability classic Don’t Make Me Think. The sequel, Rocket Surgery Made Easy, is a terrific, short, concise, fun guide to running simple “hallway” usability tests to improve the usability of your software and websites. Highly recommended.

 

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at January 25, 2010 09:21 PM

January 22, 2010

Joel Spolsky

A little less conversation

“As companies expand, the people within them start to specialize. At such a point, some managers will conclude that they have a ‘keep everyone on the same page’ problem. But often what they actually have is a ‘stop people from meddling when there are already enough smart people working on something’ problem.”

From my latest Inc. column: A Little Less Conversation

 

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at January 22, 2010 08:33 PM

Paul Ramsey

New York Code Sprint 2010

Update: We're expanding from the "C tribe" to the "curly braces tribe" and bringing in some JavaScripters too. Tim Schaub and Andreas Hocevar of OpenLayers/GeoExt will be joining the crew!



Update 2: If you haven't added your name to the wiki and booked your hotel room, you don't exist! GeoExt, OpenLayers folks don't delay!



Update 3: Avencia has joined as a sponsor (and is sending a couple staff to join in the fun). Along with OpenGeo, who are providing us with lovely space and free internet access, that bring our sponsorship docket to LizardTech, Coordinate Solutions, qPublic.net, Farallon Geographics, Avencia and OpenGeo!



Update 4: Other members of the curly braces tribe will be in attendance, in the persons of Justin Deoliveira, Andrea Aime, and Gabriel Roldan from GeoServer. I'm looking forward to working with them on adding PostGIS 1.5 GEOGRAPHY support in GeoServer.



Whoops, it's 2010! How did that happen?



I hope all members of the open source C tribe have gone beyond thinking about attending the New York Code Sprint (February 20 to 23) and moved into the travel planning stage! Don't forget to book your hotel, the room block closes in three weeks.



The list of attendees includes top contributors from MapServer, GDAL, OGR, and LibLAS. I'm feeling a little lonely at the PostGIS table with just Olivier to keep me company. And where are the folks from QGIS, Mapnik and GRASS? We love you guys! Come on, group hug. There you go.



We have four great sponsors now (LizardTech, Coordinate Solutions, qPublic.net, Farallon Geographics) and are looking for a couple more to round out the event. Thanks to our sponsors so far!



Remember to sign up to the mailing list and add yourself to the wiki page so we know you are coming, and you receive all the event notices, it's impossible to plan for you if we don't know you exist. See you soon in the Big Apple!



Thanks to Joel Schlagel for the logo!

 

by Paul Ramsey (noreply@blogger.com) at January 22, 2010 06:29 PM

January 02, 2010

Paul Ramsey

FOSS4G 2010 Savings

FOSS4G 2010If you know you're going to FOSS4G 2010 in Barcelona this year, you can save 20% by taking advantage of the Sooper Dooper Early Registration rates. Rates end January 15, the early bird gets the savings.

by Paul Ramsey (noreply@blogger.com) at January 02, 2010 03:21 AM

December 30, 2009

Joel Spolsky

Secret language

Microsoft Careers: “If you’re looking for a new role where you’ll focus on one of the biggest issues that is top of mind for KT and Steve B in ‘Compete’, build a complete left to right understanding of the subsidiary, have a large amount of executive exposure, build and manage the activities of a v-team of 13 district Linux& Open Office Compete Leads, and develop a broad set of marketing skills and report to a management team committed to development and recognized for high WHI this is the position for you!”

This is ironic, to use the Alanis Morissette meaning of the word [NSFW video].

The whole reason Microsoft even needs a v-team of 13, um, “V DASHES” to compete against Open Office is that they’ve become so insular that their job postings are full of incomprehensible jargon and acronyms which nobody outside the company can understand. With 93,000 employees, nobody ever talks to anyone outside the company, so it's no surprise they've become a bizarre borg of "KT", "Steve B", "v-team", "high WHI," CSI, GM, BG, BMO (bowel movements?) and whatnot.

When I worked at Microsoft almost two decades ago we made fun of IBM for having a different word for everything. Everybody said, "Hard Drive," IBM said "Fixed Disk." Everybody said, "PC," IBM said "Workstation." IBM must have had whole departments of people just to FACT CHECK the pages in their manuals which said, "This page intentionally left blank."

Now when you talk to anyone who has been at Microsoft for more than a week you can’t understand a word they’re saying. Which is OK, you can never understand geeks. But at Microsoft you can’t even understand the marketing people, and, what’s worse, they don’t seem to know that they’re speaking in their own special language, understood only to them.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at December 30, 2009 03:01 PM

December 22, 2009

Paul Ramsey

Deep Thought

If "open" is good at making others loose, and less than free is the model for things outside your core revenue stream, why isn't Microsoft giving away free advertising?

 

by Paul Ramsey (noreply@blogger.com) at December 22, 2009 07:35 PM

December 18, 2009

Aaron Racicot

I am back…

ABeen a while.  But I am back.  Doing alot of Python, Javascript, Geo-Hacking and plan to dump my brain about it all soon.  Stay tuned

by aaronr at December 18, 2009 07:51 AM

December 17, 2009

Matt Perry

Peaksware licensing revisted …

I had previously bitched and moaned about the licensing restrictions on the TrainingPeaks WKO+ software. Truth be told, the reason I was so put off by their crappy licensing scheme was that my cycling training relied so heavily on their software. It was not perfect but it was the best tool available. I’ve since discovered Golden Cheetah which is a viable open-source alternative but it still lags behind WKO+ in many critical features.

Now, fresh in time for the 2010 training season, Peaksware has released a new version 3.0 of WKO+ which, amongst many UI and functionality improvements, has made considerable progress on the licensing front.

We know, our licensing has been a challenge to deal with for our customers in the past, but we’ve always tried to be as helpful as possible getting you back up and running after a hard drive crash or new computer. To remedy this, we’re pleased to announce an all new flexible licensing system. First, with every purchase we now allow you to install WKO+ 3.0 on up to two computers; second, we’ve built an online activation/deactivation system so you are free to move your active licenses from machine to machine. Are you leaving on a 2 week trip? Just de-activate your home computer, activate your laptop, and you’re on your way. When you get home, de-actiavate your laptop, re-activate your desktop and you’re all set.

It ain’t open source (there is still a place in this world for proprietary software if they can push the boundaries and innovate) but the sensitivity to the licensing issue just may have restored my faith in their company.

by perrygeo at December 17, 2009 02:33 AM

December 16, 2009

Paul Ramsey

Abstracterrific!

Dan McKinley takes a look under the covers of a couple Python PostgreSQL abstraction layers:
Database client drivers intended for the same database can do drastically different things. By Python standards, the Postgres driver situation is completely schizo. There are a lot of them available - there are five dedicated Postgres drivers listed on the wiki, as opposed to just one for MySQL. People might choose different drivers for licensing reasons, for religious reasons, randomly (because they never did any analysis like I am about to do), or for completely inscrutable reasons because they are just plain out of their minds. You really would not believe how much blood I have seen spilled over Postgres client drivers.
Read it!

 

by Paul Ramsey (noreply@blogger.com) at December 16, 2009 11:00 PM

Goo Smart by Half

I typed "postgis" into Google this evening, and in addition to the exquisitely organized first entry there were two ads, one relevant (EnterpriseDB, the Postgres company) and one seemingly utterly random, for an English language school.







Has the Google algorithm made a mistake? How is this relevant? Well, the language school is in Victoria, BC, birth-place of PostGIS, but it gets better than that.



Here's a picture of their sign, which I walked past every morning for almost five years, since the school shares a building (1207 Douglas Street) with Refractions Research, birth-company of PostGIS.







But wait, there's more! The name of the school is "GEOS Language Academy", and the GEOS spatial library was also created in Victoria, specifically to bring spatial predicate algorithms to PostGIS!



Poor Google algorithm, you never stood a chance.

 

by Paul Ramsey (noreply@blogger.com) at December 16, 2009 06:31 AM

December 15, 2009

Paul Ramsey

PgPatch!

It's not much, but it's not nothing, my first ever patch to PostgreSQL proper is part of yesterday's 8.4.2 release:
Fix incorrect logic for GiST index page splits, when the split depends on a non-first column of the index (Paul Ramsey)
It was just a minor syntax error I found because I was reading through that section of the code very, very, very closely (it's true, I copy the work of smarter people than I) while implementing the indexes for GEOGRAPHY in PostGIS 1.5.

 

by Paul Ramsey (noreply@blogger.com) at December 15, 2009 09:09 PM

December 14, 2009

Joel Spolsky

Let’s stop talking about “backups”

Is your desktop backed up?

Did you backup that server?

Are your backups on a different machine?

Do you have offsite backups?

All good questions, all best practices.

But let’s stop talking about “backups.” Doing a backup is too low a bar. Any experienced system administrator will tell you that they have a great backup plan, the trouble comes when you have to restore.

And that’s when you discover that:

  • The backed-up files were encrypted with a cryptographically-secure key, the only copy of which was on the machine that was lost
  • The server had enormous amounts of configuration information stored in the IIS metabase which wasn’t backed up
  • The backup files were being copied to a FAT partition and were silently being truncated to 2GB
  • Your backups were on an LTO drive which was lost with the data center, and you can’t get another LTO drive for three days
  • And a million other things that can go wrong even when you “have” “backups.”

The minimum bar for a reliable service is not that you have done a backup, but that you have done a restore. If you’re running a web service, you need to be able to show me that you can build a reasonably recent copy of the entire site, in a reasonable amount of time, on a new server or servers without ever accessing anything that was in the original data center. The bar is that you’ve done a restore.

Let’s stop asking people if they’re doing backups, and start asking if they’re doing restores.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at December 14, 2009 03:30 PM

December 13, 2009

Joel Spolsky

Stack stats

The higher someone’s Stack Overflow reputation, the more likely they are to have submitted a CV to Stack Overflow Careers:

This is not entirely surprising, of course: the more time someone has invested in Stack Overflow, the more likely they are to (a) know about Stack Overflow Careers, (b) be willing to invest $29, after all the hours they’ve already sunk, and (c) have the confidence that their CV is going to impress the kind of employers that are using the site.

Still, the participation rate in Stack Overflow Careers is pretty impressive, and it somewhat confirms the claim we’re making to employers, which is that when you search for CVs on Stack Overflow, you are looking at some pretty gosh darn good programmers.

While I’m rattling on about statistics, here’s a little bit of data about Stack Overflow traffic itself that you may not have seen.

We use Quantcast to measure our traffic. Currently, they’re showing us as the 740th ranked site in the world (of all sites), with 6 million monthly unique visitors, 1.9 million from the US. And the growth is pretty steady, except for a couple of weeks at the end there which reflect the holiday season:

Comparing our traffic to our big competitor is difficult because they don’t use Quantcast, so we have to rely on Alexa, which has a reputation for particularly terrible data, but here’s what that looks like:

Are there any sites out there for programmers with more traffic than Stack Overflow? I haven’t found any, using the available data... even msdn.microsoft.com has less, according to Quantcast, but I find that hard to believe.

In either case, having decided that Stack Overflow was the biggest programming site in the world, I thought, “hey, it should be easier for us to get ads.” I asked our ad guy, Alex “DailyWTF” Papadimoulis, if Microsoft had bought any ads. They’re about to launch Visual Studio 2010, which is probably going to have the biggest marketing campaign (in dollars) in the history of developer tools, and you’d think they’d want to spend something at the biggest programming site in the world. Here’s what he wrote back:

“Microsoft is doing huge spends, but they’re going through McCann for the VS2010 launch (IIRC). Agencies really don’t like us. Now if we go to video units with fly-over… oh they’ll start loving us!”

What he’s referring to is the fact that we don’t accept any kind of animated ads on Stack Overflow, because, well, they’re evil, so we lose a lot of revenue from advertising agencies who are looking for the most aggressive possible ways to get in people’s faces. Whatever. Don’t care. We hate animated ads and I’m pretty sure our users do, too.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at December 13, 2009 10:57 PM

December 12, 2009

Tom Kralidis

Why I Love Linux

$ uptime 21:20:01 up 112 days,  9:06,  1 user,  load average: 0.05, 0.09, 0.18 Written from home: window.onload=function() { var point409 = new GLatLng(43.663194, -79.575653); var map409 = new GMap2(document.getElementById("map409")); [...]

by tomkralidis at December 12, 2009 02:48 AM

December 11, 2009

Paul Ramsey

Code Sprint 2010: New York City

It's official! Following the success of the 2009 Toronto Code Sprint a second event will be taking place in New York City, this winter.







This code sprint will bring together the developers for the MapServer, PostGIS, GDAL, GRASS, OGR, LibLAS, QGIS, Proj4 and other projects that are part of the "C Tribe" of open source software.



Timing: Saturday, February 20 to Tuesday, February 23, 9am to 4pm.



Location: OpenGeo Event Room, 148 Lafayette St, New York, New York



More Information: Wiki Page, Mailing List



Sponsor this event! Last year, sponsorship dollars paid for venue and dinners for the sprinters, who gave up their weekends and more to invest a collective 736 man hours in making their open source project stronger. Thanks again to our 2009 sponsors: Rich Greenwood, OSGIS.nl, Coordinate Solutions, LizardTech, SJ Geophysics, qPublic.net, GDAL! If you want to sponsor this event, and raise your profile with the 2 dozen people who make your software sing, please contact me.



Update: Thanks to our first 2010 sponsors, Coordinate Solutions, LizardTech, and qPublic.net! We are still looking for sponsors for 2010!

 

by Paul Ramsey (noreply@blogger.com) at December 11, 2009 09:46 PM

December 10, 2009

Paul Ramsey

Extra, extra, PostGIS Really Fast!

Because, frankly, I love nothing more than approbation, I am going to quote this comment on "Much Faster Unions in PostGIS" in full:
This is a truly spectacular piece of work. We have often been asked by clients to buffer and merge point datasets with several million points. We attempted this using ArcWhatever (could barely open the points, let along buffer them) and FME, which ran for a week and then gave an out of memory error. So, I do the whole configure, make, make install thing, 4 times, for postgres, goes, proj4 and postgis. After a lot of swearing and running ldconfig a few million times I eventually get postgis to accept that geos really is installed -- MySQL might have more limited spatial functionality, but it sure is a lot easier to build from source. Anyway, I digress. I run a few random queries using the excellent generate series capability in postgres, and manage to create, buffer and merge 100,000 points in a few seconds. Finally, I try this on a real world dataset, namely all of the postal addresses in Wales, 1.4 million or so. With a 200m buffer, this ran on a reasonably pokey 64-bit linux box in 19 minutes. Truly astonishing. Well done. Much as I love MySQL, this was a bit of St. Paul on the road to Damascus moment.
Full credit to Martin Davis, who implemented this technique in JTS. We just borrowed it for database land.

 

by Paul Ramsey (noreply@blogger.com) at December 10, 2009 11:12 PM

Joel Spolsky

When and how to micromanage

“Like most entrepreneurs, Ryan and I are still learning about how to manage people and teams. And we’re both used to hiring very smart and dedicated people who will get things done to a high standard if you give them some general direction and set them free. But on this trip, we started to notice that this style of hands-off management, which works so well with our own staffs, just wasn’t working when we had outside vendors involved.”

From my December column in Inc.: “When and How to Micromanage

 

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at December 10, 2009 01:49 AM

December 04, 2009

Paul Ramsey

Code Sprint 2010: New York City

It's official! Following the success of the 2009 Toronto Code Sprint a second event will be taking place in New York City, this winter.







This code sprint will bring together the developers for the MapServer, PostGIS, GDAL, GRASS, OGR, LibLAS, QGIS, Proj4 and other projects that are part of the "C Tribe" of open source software.



Timing: Saturday, February 20 to Tuesday, February 23, 9am to 4pm.



Location: OpenGeo Event Room, 148 Lafayette St, New York, New York



More Information: Wiki Page, Mailing List



Sponsor this event! Last year, sponsorship dollars paid for venue and dinners for the sprinters, who gave up their weekends and more to invest a collective 736 man hours in making their open source project stronger. Thanks again to our 2009 sponsors: Rich Greenwood, OSGIS.nl, Coordinate Solutions, LizardTech, SJ Geophysics, qPublic.net, GDAL! If you want to sponsor this event, and raise your profile with the 2 dozen people who make your software sing, please contact me.

by Paul Ramsey (noreply@blogger.com) at December 04, 2009 11:26 PM

December 02, 2009

Joel Spolsky

Programmer search engine

For as long as I’ve been in the industry, which is, I think, about 74 years now, the problem I’ve had with hiring programmers was not interviewing them or deciding if they’re smart—it’s been finding them in the first place.

What I’ve dreamed about is a programmer search engine.

The ideal programmer search engine would only include programmers who are actually looking for jobs. If you’ve ever emailed someone based on a resume you found through a traditional search engine, you’ve probably discovered that they’re not actually on the market.

It would only include people willing to work in your neck of the woods.

It would show you CVs right away, and, ideally, it would show you something about their programming skills besides the usual resume blahblah.

Well, OK, that day is here, and I’m like a kid in a candy store. Nom nom. Announcing the other half of careers.stackoverflow.com: the employer’s side!

Right now, there are about 928 candidates on there. That’s a start. What’s more interesting is whether there’s a candidate who meets your needs.

Let’s say you’re searching for a full time Java programmer within 40 miles of Palo Alto. Right now there are 11 candidates listed. All but one are active on StackOverflow... one even has reputation over 4000 points.

Want a bit more choice? Check the box that indicates that you’re willing to relocate. Now there are 80 matches, all of whom have the legal right to work in the states. Candidates have a lot of flexibility indicating where they’re willing to work. Even if you need a Ruby on Rails programmer in Oklahoma City, as long as you’re willing to pay for relocation, you’ve got 7 choices. You’ve got 14 choices in London (with the legal right to work.) If you think that a Python programmer could learn Ruby, you’ve got 51 choices. There are plenty of choices whether you’re hiring in Tel Aviv, Sydney, Silicon Valley, or New York. There are four programmers in Copenhagen right now. No relocation required. All of them highly qualified, actually; any one of them would qualify to interview at Fog Creek.

Stack Overflow Careers is something of a chicken-and-egg business. We have to get a big audience of programmers and a big audience of employers all at the same time, and then it’s like a junior high school dance, with the boys on one side of the gym and the girls on the other side, and for a while you just sit there holding your breath to see if anyone will dance. We invited a few hundred employers as beta testers... these were the companies that have been listing jobs on StackOverflow over the last six months, and so far, they’ve found a few dozen candidates that they liked. Once it gets to that point, we’re out of the loop, so we don’t really know how many people are actually finding jobs, but please email me your success stories and failure stories so we can keep working to make it better.

In the meantime, Jeff and the StackOverflow crew have done something brilliant: they’ve made it possible to do searches and see how many candidates match even before you have to pay. So if you want to try it out but are afraid that there aren’t students looking for OCaml internships in Houston, you can try it, and find that there is, indeed, one. So, try it out right now. There’s no obligation, and we’re happy to give you your money back if you don’t think you got good value.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at December 02, 2009 10:24 PM

Paul Ramsey

Perfect

The New York Times political blog has instant commentary on Obama's Afghanistan speech tonight, and the one-sentence teaser in the RSS feed speaks volumes:
In an address aimed at rank-and-file Americans, Mr. Obama did not call for sacrifices.
 

by Paul Ramsey (noreply@blogger.com) at December 02, 2009 03:58 AM

December 01, 2009

Paul Ramsey

Is "Good Enough" Good Enough?

The gift that keeps on giving, for me, is performance work. Users love it, and it tickles my cerebral cortex in a way other work just cannot touch. Some of my first substantive patches to MapServer were performance patches, and I've also taken that tack into PostGIS.



One of the things that surprised me while investigating the MapServer QIX index structure was how little a badly built tree impacted real world performance. The QIX file, when built on point files, tends to build in far more depth than it needs, strictly speaking. The extra depth adds theoretical time to traverse the tree for searches and yet... even when I tested quite huge shape files the performance was fine.



Recently I've been looking again at internally indexing geometries for high performance testing of things like distance and intersections. We already have some of this for PostGIS, using the GEOS "PreparedGeometry" construction, but I'd like a native implementation, and something that doesn't necessarily depend on a cached implementation.



There is already a form of internally indexed testing in PostGIS, in the point-in-polygon case, and while reading it over I was struck by the elegance of the underlying assumption: rather than pre-sort the geometry edges, and then build the tree, the implementation simply scans the point array from start to finish and builds parent nodes from each successive pair of nodes. The result is not a perfect tree, by any stretch of the imagination, but... it's good enough. Because the edges are spatially auto-correlated, the parent nodes end up having good locality.



The beauty of this approach to index building is that since there is no sorting step and no re-balancing of the tree or any of that fancy stuff, you can actually build an "index" in O(n) time. A brute force intersection test is O(nm) time. But if you can build your indexes in O(n) time the cost of doing an intersection starts to get closer to O(n+m) time! (Note, I am not a computer scientist and the O() term for the actual tree-on-tree intersection test is beyond my powers.)



Now, since no sorting is being applied in the building of these "indexes" they could theoretically be terrible indexes. But since we're indexing GIS data, and the edges have this wonderful autocorrelation, they are actually "good enough", and obtainable in very little time.



The same tricks apply to building indexes for intersection and distance in geodetic space, which I predict will be in hot demand once people experience just how computationally expensive operations on the new PostGIS 1.5 geography type are!

 

by Paul Ramsey (noreply@blogger.com) at December 01, 2009 02:46 AM

November 24, 2009

Paul Ramsey

You get more than what you pay for!

Entchev reflexively repeats one of the most foolish canards ever hurled against collaborative knowledge building (open source, open data, open knowledge)
You get what you pay for.
Was there ever a putdown more easily falsifiable?



You pay nothing for PostGIS. Is the value to you nothing? You pay nothing for Wikipedia. Is the value to you nothing? You pay nothing for Open Street Map, is the value to you... nothing? Clearly, you, and everyone, gets more than what they pay for.



Now, there are many arguments to be made and beers to be drunk over whether what you get is enough for all possible purposes of all possible people. Some think that the trend in open knowledge is so strong that even that goal is within reach. Me, not so much.



But clearly, everyone has access to these resources, for free, and what they get in return is more than what they paid.

 

by Paul Ramsey (noreply@blogger.com) at November 24, 2009 03:30 AM

November 14, 2009

Paul Ramsey

The First Rule of Fight Club...

Who knew that ESRI was so hip? From James Fee's blog:
Note: If you post any specific 9.4 Beta information (such as quoting forums posts on the Beta forums), expect ESRI to personally contact you. They appear to be monitoring this blog post. You’ve been warned.


 

by Paul Ramsey (noreply@blogger.com) at November 14, 2009 03:07 AM

November 13, 2009

Paul Ramsey

Palanterra X3

James Fee has a nice rant on mapping interfaces today, but the part the piqued my interest was embedded in the screen shot of the National Map. It said "The National Map Viewer BETA: Powered by Palanterra X3"



Interesting! Who or what is this Palanterra X3 who have managed to get a top-of-the-fold "Powered by" on a major USGS site? Oddly, the Google is unusually terse about this topic. Looks like it's an NGA project, and yet it's "Palanterra (TM)". Intra-governmental entrepreneurship at its finest, a carefully imagined brand name that appears only in meeting agendas and powerpoints.

 

by Paul Ramsey (noreply@blogger.com) at November 13, 2009 05:00 PM

November 12, 2009

Paul Ramsey

FOSS4G hearts SoTM

A quiet bit of byplay is going on in the world of extreme geogeekery, as the State of the Map conference, the annual gathering of the OpenStreetMap community, decides where to host their 2010 event. The twist for this year is that an intrepid member of their spanish community has suggested hosting the event in Barcelona, to align with the FOSS4G 2010 event (either right before or right after). The OSM community decides on their site in early December – I'll add my non-binding "ooooooooh, I hopehopehopehopehope they choose Barcelona!"

 

by Paul Ramsey (noreply@blogger.com) at November 12, 2009 01:11 AM

November 06, 2009

Paul Ramsey

PostGIS gets Spherical (Directors Cut)

Update: Installation instructions have changed slightly since this post was written.



For a business oriented discussion of the new GEOGRAPHY type, see my post on the OpenGeo blog.



So you want to try the new GEOGRAPHY type and see what it can do? Alright then!



If you are running Windows, please follow the directions on the Windows experimental binaries download page on the PostGIS site. Note that these builds might not be the absolute latest versions available.



If you are running Linux, fetch the latest code from SVN (svn checkout http://svn.osgeo.org/postgis/trunk postgis-svn) and then follow the install instructions.



After installing, you should find the usual postgis.sql file which contains the old geometry and now the new geography features too. Install PostGIS and spatial reference information as usual:



createdb mydb

psql -d mydb -f postgis.sql

psql -d mydb -f spatial_ref_sys.sql




I find it useful for testing to load a shape file in the usual way, then add a geography column to it.



shp2pgsql -s 26910 -g geom taxlots.shp taxlots | psql mydb

psql mydb




Once you have a table to play with, it's time to add a geography column, and build indexes. You have to transform the geometry into EPSG:4326 before casting to geography. When you build the index on the geography column, it builds a special index over the sphere which respects the poles and dateline.



alter table taxlots add column geog geography;

update taxlots set geog = geography(st_transform(tgeom,4326));

create index roads_geom_idx on taxlots using gist (geom);

create index roads_geog_idx on taxlots using gist (geog);




How does this magic index work? The "trick" is to be as lazy as possible. I didn't want to write a whole new indexing scheme, and I already had a serviceable R-Tree index. What I needed to do was convert the lat/lon coordinates to a domain where the problems of the singularities at the poles and dateline would go away. The answer is to convert from spherical coordinates (lat/lon) relative to Greenwich into geocentric coordinates (x/y/z) relative to the center of earth. It's easy then to build a 3D R-Tree on the geocentric bounds of the features. Calculating the bounds in 3D is tricky, because the curvature of the features over the spherical surface must be respected, but once that is done, the index performs admirably.



Now you can compare properties calculated on the plane and on the spheroid.



select st_area(geom) as geomarea, st_area(geog) as geogarea from taxlots limit 10;



Note that the units returned by the geography functions are metric. Square meters for area and linear meters for distances and lengths.



How about a quick spatial self-join, to test the indexes?



\timing

-- geography test

select sum(st_area(geog)) from taxlots a, taxlots b where st_dwithin(a.geog, b.geog, 100.0) and b.gid = 1;

-- geometry test

select sum(st_area(geom)) from taxlots a, taxlots b where st_dwithin(a.geom, b.geom, 100.0) and b.gid = 1;




In testing, I have been finding the geography index slightly faster than the geometry index, which is perhaps because I was able to write the geography index binding from scratch, trying to apply the lessons I have taken from reviewing the existing geometry index. In PostGIS 1.5 (coming Christmastime or sooner) the geography and geometry types will coexist, but use different disk serializations and index bindings. In PostGIS 2.0 (fall 2010) the geometry will also be swapped over to a new serialization and index binding and should become as fast (faster) than the geography index.



Finally, try out the transparent integration of the ST_Buffer() function from geometry with the geography type.



select st_area(st_buffer(geog, 2.0)) from taxlots limit 1;



By carefully transforming geometries out to appropriate planar spatial reference systems, you can use the functions built for geometry to provide operations on geographies. The definition for ST_Buffer(geography, double) looks like this:



CREATE OR REPLACE FUNCTION ST_Buffer(geography, float8)

RETURNS geography

AS 'SELECT geography(ST_Transform(ST_Buffer(ST_Transform(geometry($1), _ST_BestSRID($1)), $2), 4326))'

LANGUAGE 'SQL' IMMUTABLE STRICT;




Note that ST_Transform() appears twice, once to transform from geographics to a planar system and again to transform back after the buffer operation is complete. Also note the _ST_BestSRID() function, which analyzes the geography and provides a best guess planar system suitable for carrying out the operation. Right now the system picks an appropriate UTM zone, or a polar stereographic, or falls back to a mercator if there is no good choice.



Acknowledgements: Of course, top billing goes to the funder, who has chosen to remain anonymous. Also, it would have been impossible for me to build the ST_Area() or ST_Distance() functions on the sphere and spheroid without the contributions of David Skea (if you check the PostGIS source code, you'll find he has contributed mathematical magic in the past also). And finally, Regina Obe who has been testing and documenting my work as it is committed, resulting in very effective on-the-spot debugging and fixing of issues as they occur. Thanks everyone!

 

by Paul Ramsey (noreply@blogger.com) at November 06, 2009 09:47 PM

November 05, 2009

Paul Ramsey

State of PostGIS

I gave a 30 minute talk about the past present and future of PostGIS at FOSS4G two weeks ago, and thanks to the efforts of the folks at FOSSLC it's now online as a video.

 

by Paul Ramsey (noreply@blogger.com) at November 05, 2009 03:00 PM

Joel Spolsky

Upgrade your career

Do you like your job?

Do you enjoy the people you work with?

Would you want to have lunch with them? Every day? Alex Papadimoulis thinks that Fog

Tyler Griffin Hicks-Wright
Creek’s free lunches are “cultish,” but everyone at Fog Creek loves them. Maybe it’s the mandatory brain implant we install in each new worker, but I like to think that we just enjoy eating together because we genuinely like each other and like spending time together. If you can’t imagine eating lunch every day with your coworkers, I hate to break it to you: you might not like them. Is it OK to spend most of your waking hours with people you don’t like?

Do you actually enjoy doing your job? If you wake up an hour early in the morning, do you think, “Yay! I can go in early and get another hour of work in!” Or does that sound ridiculous to you?

Are you learning? When was the last time you had to learn a new skill? Is this year kind of like last year, or are you doing something new, stretching yourself, challenging yourself to be better?

At one of the recent DevDays events, I asked the audience (almost 100% programmers) how many of them were incredibly satisfied with their job, found it fulfilling, and were treated well by their employers. Only about 25% of the hands went up. I asked how many people either hated their job and couldn’t wait to find something better, or were actually actively on the job market. Again, about 25%. The rest were somewhere in the middle: maybe they can tolerate their job, but they’re keeping an eye open for something better.

Who is this DevDays audience? They’re the elite of the elite of the best programmers out there. They’re the people who participate in Stack Overflow, the people who read, the people who are constantly trying to learn more about programming and software development. More than half of them paid their own money to attend a one day conference. They’re the most desirable software developers on the planet. And 75% of them are not delighted with their job.

That’s unacceptable. I’ve been saying for ten years that the top developers have a choice of where to work, and the top employers need to work harder to attract them, because the top developers get ten times as much work done as the average developers.

And yet, I still keep meeting ridiculously productive developers working in shitholes.

We’re going to fix this, right now. Thus, Stack Overflow Careers.

We’re going to completely turn the job market upside down, for the best software developers and the best companies.

This is a talent market. Developers are not even remotely interchangeable. Therefore, recruiting should work like Hollywood, not like union hiring halls of the last century.

In a union hiring hall, downtrodden workers line up like cogs, hoping to make it to the front of the line in time to get a few bucks for dinner.

In Hollywood, studios who need talent browse through portfolios, find two or three possible candidates, and make them great offers. And then they all try to outdo each other providing plush work environments and great benefits.

Here’s how Stack Overflow Careers will work. Instead of job seekers browsing through job listings, the employers will browse through the CVs of experienced developers.

Instead of deciding you hate your job and going out to find a better one, you’ll just keep your CV on file at Stack Overflow and you’ll get contacted by employers.

Instead of submitting a resume, you’ll fill out a CV, which links back to your Stack Overflow account, so that you can demonstrate your reputation in the community and show us all how smart you really are. To a hiring manager, the fact that you took the time to help a fellow programmer with a detailed answer in some obscure corner of programming knowledge, and demonstrated mastery, is a lot more relevant than the Latin Club you joined in school.

Employers can see how good you are at communicating, how well you explain things, how well you understand the tools that you’re using, and generally, if you’re a great developer or not. And they can see your peer reputation, so all that hard work you’ve been putting into helping people on Stack Overflow can karmically come back and help you upgrade your job to the latest, state-of-the-art, great place to work.

Stack Overflow has grown incredibly fast. After a year in business, it gets over a million page views most weekdays and currently stands as the 817th largest site on the Internet, according to Quantcast. It reaches 5.2 million people a month. But Stack Overflow Careers doesn’t have to be massive. It’s not for the 5.2 million people who visit Stack Overflow; it’s for the top 25,000 developers who participate actively. It’s not for every employer; it’s for the few that treat developers well and offer a place to work that’s genuinely fulfilling.

Read the FAQ, then go file your CV now, and upgrade your career.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at November 05, 2009 01:34 PM

November 04, 2009

Paul Ramsey

Geography and MapServer

Can you use the new PostGIS GEOGRAPHY type with MapServer? Yes! Just make sure your LAYER declares a geographic projection (e.g. "init=epsg:4326", or "proj=lonlat") so the correct coordinates are passed in. For simple DATA definitions(e.g. DATA "thegeog from thetable"), that's all you have to do. I haven't tested out more complex DATA statements yet, but I am pretty sure they should work fine.

 

by Paul Ramsey (noreply@blogger.com) at November 04, 2009 11:36 PM

Joel Spolsky

Does Slow Growth Equal Slow Death?

My new Inc. column is up. “For a guy who wrote a book on how to hire great programmers, it’s mortifying how incompetent I’ve been at enlarging the sales team, which, right now, consists of one terrific account executive and a dog. (I’m just kidding. There’s no dog.)”

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at November 04, 2009 12:50 AM

November 01, 2009

Joel Spolsky

Figuring out what your company is all about

What is your company about?

Recently I got inspired by Kathy Sierra, whose blog Creating Passionate Users and Head First series of books revolutionized developer education. She kept saying the same thing again and again: help your users be awesome.

Kathy taught me that if you can’t explain your mission in the form, “We help $TYPE_OF_PERSON be awesome at $THING,” you are not going to have passionate users. What’s your tagline? Can you fit it into that template?

It took us nine years, but we finally worked out what Fog Creek Software is all about, which I’ll tell you in a moment, but first, some backstory.

In the early days, we were all about making a great place to be a software developer in New York City.

Yep, that was all there was to it. Almost every software job in the city was terrible. You had a choice of which kind of terrible. Want to wear a suit and work long hours under crummy conditions? Take a job at a bank. Want to report to a manic-depressive creative who demands that you stretch HTML in ways that would have you put to death, in certain countries? Take a job at a media company. Want to work 24/7 in a basement with water pipes dripping on your head and get paid in worthless stock options? Take your pick of the revenue-free dotcom startups.

Why New York, then? There are lots of great product companies where software developers are treated very well in Redmond, Washington. But I was sick of trying to live in lesser cities. Sure, the Seattle area is beautiful, and green, and clean, and possesses great coffee, and I understand that there are even a couple of grocery stores open late now. But I’m staying in New York, because it’s the greatest city in the world.

I gave up the search, and decided to start a company with my buddy Michael Pryor. Making a nice place to work was our primary objective. We had private offices, flew first class, worked 40 hour weeks, and bought people lunch, Aeron chairs, and top of the line computers. We shared our ingenious formula with the world:

The tagline was “building the company where the best software developers want to work.” It was, to say the least, awkward. It didn’t make for a good elevator pitch. It didn’t really have the right format. “Abercrombie and Fitch: building the apparel store where the hottest teenagers will want to work.” Who cares? Not the hot teenagers, I’ll tell you that.

Anyway we accomplished that goal. Cross it off the list. What’s next? We needed a new mission statement.

And it has to be something of the form, “We help $TYPE_OF_PERSON be awesome at $THING.”

Bells went off. Everything we’ve done successfully has one thing in common: It’s all about helping software developers be awesome at making software.

That includes Joel on Software, Stack Overflow, all the books I’ve been writing, the conferences like DevDays and Business of Software, the Jobs Board and Stack Overflow Careers.

It includes our flagship product, FogBugz, which is all about giving developers tools that gently guide them from good to great. It’s the software implementation of the philosophy I’ve been writing about for a decade, lacking only one thing: the feature to replace exceptions with return values, while adding Hungarian prefixes to all variable names. THAT IS A JOKE, PEEPLE. Put DOWN the bazooka.

Helping you make more awesome software is why I write endlessly about what we’re doing at Fog Creek, despite the fact that people accuse me of shilling. I’m not writing to promote our products. You don’t have to buy our products to get the benefit of reading about my experience designing them and building them and selling them. I’m writing to share some of my experiences in case they can help you make better software.

Our focus on helping developers explains why one of our early products, CityDesk, flopped: it had nothing to do with software developers. And it explains why another of our products, Fog Creek Copilot, only found a market in the niche of software developers doing tech support.

So, here you go, the new tagline: “We help the world’s best developers make better software.”

Going through this exercise made it easy to figure out what belongs in future versions of FogBugz and what doesn’t. In particular, we’re adding source control and code review features to FogBugz, using Mercurial, the best open-source distributed version control system. Everything that helps developers make better software belongs in FogBugz: project planning, project management, bug tracking, and customer service.

It took almost ten years, but I think we finally got the mission for the next ten nailed.


Optional Advertainment: If you’ve got a moment, check out this 4½ minute trailer for Make Better Software, a new video training series we’ve been working on for more than a year. It’s the video edition of Joel on Software and fits perfectly with our agenda of helping developers make great software.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at November 01, 2009 09:51 PM

Adam Bosworth on standards

Adam Bosworth: “All successful standards are as simple as possible, not as hard as possible.” Required reading.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at November 01, 2009 04:50 AM

October 29, 2009

Paul Ramsey

Googalytics

If you haven't read Paul Bissett's take on the Goog's entrance into the data collection and LBS businesses, you must, he's nailing it. Start with "GOOG = BORG, and I Mean That in the Nicest Way", and then do "Google Will Open Source National Parcel Map".





 

by Paul Ramsey (noreply@blogger.com) at October 29, 2009 04:31 PM

October 27, 2009

Joel Spolsky

Capstone projects and time management

It is amazing how easy it is to sail through a Computer Science degree from a top university without ever learning the basic tools of software developers, without ever working on a team, and without ever taking a course for which you don’t get an automatic F for collaborating. Many CS departments are trapped in the 1980s, teaching the same old curriculum that has by now become completely divorced from the reality of modern software development.

Where are students supposed to learn about version control, bug tracking, working on teams, scheduling, estimating, debugging, usability testing, and documentation? Where do they learn to write a program longer than 20 lines?

Many universities have managed to convince themselves that the more irrelevant the curriculum is to the real world, the more elite they are. It’s the liberal arts way. Leave it to the technical vocational institutes, the red-brick universities, and the lesser schools endowed with many compass points (“University of Northern Southwest Florida”) to actually produce programmers. The Ivy Leagues of the world want to teach linear algebra and theories of computation and Haskell programming, and all the striver CS departments trying to raise their standards are doing so by eliminating anything practical from the curriculum in favor of more theory.

Now, don’t get me wrong, this isn’t necessarily a bad thing. At least they’re replacing Java with Scheme, if only because “that’s what MIT does.” (Too late!) And they are teaching students to think a certain way. And given how much the average CS professor knows about real-world software engineering, I think I’d rather have kids learn that stuff at an internship at Fog Creek.

Greg Wilson, an assistant professor at the University of Toronto, gave a talk at the StackOverflow DevDay conference in Toronto, which was entertaining, informative, and generally just a huge hit. We got to talking, and he told me about his latest brainchild, UCOSP, which stands for “All The Good Names Are Taken.”

It’s a consortium of 15 universities, mostly in Canada, which are organizing joint senior-year capstone projects. They’re setting up teams of a half-dozen undergraduates from assorted universities to collaborate on contributing to an open source project, for credit and for a grade. As soon as I heard about the program I volunteered to sponsor a team to make a contribution to Mercurial. Sponsoring a team consists of offering to pay for a trip to Toronto for all the undergrads to get organized, and providing a programmer to mentor the team.

Browsing around the UCOSP blog, I was reminded of why student projects, while laudatory, frequently fail to deliver anything useful. “One of the points of this course is to give you a chance to find out what it’s like to set and then meet your own goals,” Greg wrote. “The net result is pretty clear at this point: in many cases, students are doing less per week on this course than they would on a more structured course that had exactly the same content.”

College students in their final year have about 16 years of experience doing short projects and leaving everything until the last minute. Until you’re a senior in college, you’re very unlikely to have ever encountered an assignment that can’t be done by staying up all night.

The typical CS assignment expects students to write the “interesting” part of the code (in the academic sense of the word). The other 90% of the work that it takes to bring code up to the level of “useful, real-world code” is never expected from undergrads, because it’s not “interesting” to fix bugs and deal with real-world conditions, and because most CS faculty have never worked in the real world and have almost no idea what it takes to create software that can survive an encounter with users.

Time management is usually to blame. In a group of four students, even if one or two of the students are enterprising enough to try to start early in the term, the other students are likely to drag their heels, because they have more urgent projects from other classes that are due tomorrow. The enterprising student(s) will then have to choose between starting first and doing more than their fair share of the work, or waiting with everyone else until the night before, and guess which wins.

Students have exactly zero experience with long term, team-based schedules. Therefore, they almost always do crappy work when given a term-length project and told to manage their time themselves.

If anything productive is to come out of these kinds of projects, you have to have weekly deadlines, and you have to recognize that ALL the work for the project will be done the night before the weekly deadline. It appears to be a permanent part of the human condition that long term deadlines without short term milestones are rarely met.

This might be a neat opportunity to use Scrum. Once a week, the team gets together, in person or virtually, and reviews the previous week’s work. Then they decide which features and tasks to do over the next week. FogBugz would work great for tracking this: if you’re doing a capstone project and need access to FogBugz, please let us know and we’ll be happy to set you up for free. We can also set you up with beta access to kiln, our hosted version of Mercurial, which includes a code review feature.

I’ve been blaming students, here, for lacking the discipline to do term-length projects throughout the term, instead of procrastinating, but of course, the problem is endemic among non-students as well. It’s taken me a while, but I finally learned that long-term deadlines (or no deadlines at all) just don’t work with professional programmers, either: you need a schedule of regular, frequent deliverables to be productive over the long term. The only reason the real world gets this right where all-student college teams fail is because in the real world there are managers, who can set deadlines, which a team of students who are all peers can’t pull off.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at October 27, 2009 12:36 AM

October 25, 2009

Paul Ramsey

Climate @ FOSS4G 2009

I found the keynote by climate scientist Andy Pitman at FOSS4G very interesting, on a couple levels.



Firstly on the climate level, he started off with a graph of some of the predictions from 1990, when it was becoming clear that climate change was something that policy makers needed to Do Something About. At that time, the scientists put together a range of scenarios, places we would be based on different policy responses, ranging from radical changes in energy production and efficiency to doing SFA. And amazingly, we have managed to do worse than the worst-case scenario envisioned in 1990. With the polar ice on the way out, and glacial (hah hah) progress in getting policy change China and the USA (the only two that matter, if they lead the world will follow), it was very sobering to see just how poorly we are doing at averting the very predictable end of our civilization.



Secondly on the open source level, he was very clear that open source technology (C, Java, etc) and open source programmers (knowing nothing about climate science) probably couldn't be directly useful to the modelling effort. But he did think that the modellers should aspire to a more open source ethic in their science. Most of the models are closed source, and there is little of the open source ethic of communications going on. My main concern about an open source climate model is that the politicization of the whole discussion would destroy any efforts at community building. One of the things projects have to occasionally deal with is "poisonous people", and an open climate model would have to deal with orders of magnitude more of those. It's draining and distracting from the real business at hand.



I hope the climate modellers can figure out how to square the circle of more openness without poisonous people, but in my mind modelling is icing on the cake at this point. We know we need to de-carbonize, it's obvious that changing the chemical balance of our environment, whether locally with things like PCBs or DDT or globally with CO2 is a dangerous crapshoot. At this point, we need the force of will to do it.



(BTW, I think we should be taxing carbon at the source, not taxing emissions (too many tailpipes) but extraction. It's not carbon per se that is the problem, it's extra carbon, the kind we dig and pump out of the ground, that is baking us. Fewer points of taxation and control, easier to enforce and manage, let's tax oil and coal and natural gas at the point of production (or, if exporting jurisdictions refuse to do so, at our borders.)

 

by Paul Ramsey (noreply@blogger.com) at October 25, 2009 10:53 PM

October 23, 2009

Paul Ramsey

FOSS4G 2009 Keynote

Lots of people here have been asking if my keynote is going to be posted online. So, here it is (31MB). Be forewarned, it's a big file. There is also a handheld video available on YouTube. There was a professional video shot too, and hopefully that will go online at the conference site in the next month or so.

 

by Paul Ramsey (noreply@blogger.com) at October 23, 2009 03:35 AM

October 12, 2009

Paul Ramsey

Slashdot Explains Sexism in Open Source

In the spirit of beer commercials and sports highlight shows, Slashdot's editors blithely follow a post about sexism in open source with, just 45 minutes later, a post on a Marge Simpson spread in Playboy.



Slashdot Effect



Let no one say Slashdot does not know its audience. At least, the audience they have, not the one they're missing out on.

 

by Paul Ramsey (noreply@blogger.com) at October 12, 2009 09:04 PM

Elephants Ahead!

Matt Asay (the most prolifically correct person writing on open source today) takes a look at PostgreSQL in his posting today (Is it Postgres' Time to Shine?):
Postgres [could be positioned] to take a bigger share of the enterprise Java database market – not because it's cheaper than Oracle or more open than MySQL but because it's a great database in its own right.
Hear hear! But Matt is too kind: PostgreSQL usership will grow strongly over the next couple years and much of the growth will trace directly back to its competitors weakness. MySQL's continuing community turmoil after the Sun/Oracle acquisition, and Oracle's continuing pricing problems (in that, they keep going up and up and up, I have yet to meet an Oracle customer who didn't start our conversation by gasping at ever increasing maintenance costs).



Being an excellent, superior, database is a good start, but having your competitors self-destructing never hurts.

 

by Paul Ramsey (noreply@blogger.com) at October 12, 2009 04:52 PM

October 09, 2009

Joel Spolsky

The “WiFi At Conferences” Problem

Why does WiFi work so poorly at tech conferences?



Marcus Griep
I assume that WiFi wasn’t really designed to handle a big ballroom with 2000 people, all trying to connect with their laptops and cell phones at the same time. Sometimes I feel like I’m lucky if it works in my apartment. So I never thought it was even possible to get it to work at a large, technically-savvy conference. At Stack Overflow DevDays, yesterday in Boston, the bandwidth seemed OK but the DHCP server ran out of addresses. This didn’t seem to be something that anyone could fix. The conference organizers (er, me and Greg) were incredibly busy trying to, you know, organize the conference, so spending time tracking down the mysterious ISP and making them fix their router was impossible.

It’s almost getting boring to read the conference reports complaining about this. Almost every conference, even the ones put on by fancy tech companies, has trouble. I never assume WiFi is going to work whenever I’m in a room with that many techies.

At the smaller conferences, the ones with, say, 300-1000 people, the trouble is that internet access is something of a black box. If you’re a conference organizer, your first priority is finding a space—any space—because there usually aren’t a lot of options. For example if you want to put on an event for 500 people in Seattle, there are probably 20 hotels that can accomodate you and maybe 10 other non-hotel venues. For the date you want, 3/4s of them are booked. You end up choosing between three options, if you’re really lucky. The venue with the best Internet access would be nice, but there are so many other considerations that you don’t really think about this when you’re booking the space. Besides, all the venues tell you they have fantastic, soo-perb A-number-1 internet access. When you try to ask complicated questions and explain that your conference has a lot of techies, they say, yes, we understand, we have A-number-1 internet access, no problem very good. When you say, “Yeah, but have you configured your DHCP server so that it has more than the default 254 IP addresses available to hand out,” they have no idea what on earth you’re talking about, and of course it turns out that they had some vendor, a company you’ve never heard of, provide their internet access. And half the time, that vendor installed a DSL line from the local telco and hooked it up to a LinkSys WRT54g they got at Costco, then installed some kind of crappola welcome-screen software just to make it even worse, and then disappeared.



Marcus Griep
There are steps that can be taken. Here’s an interesting study [PDF] done by Intel about making WiFi work at large conferences. The best idea I got from that was that there should be as many hardwired network access points as possible, to get the heavy users off the air, because ethernet has way more bandwidth. There are companies that specialize in making WiFi systems that will support large conferences: one that I found is called Meraki; I don’t know much about them but their website sure makes it seem like they understand the issues at least.

At the very least, though, a venue should be able to tell you how many access points they actually have (if it’s just one, you’ve got problems), whether they are managed access points or not, whether dedicated ports with higher priority can be provided for the speakers and for journalists that do not share bandwidth with the audience, how many IP addresses the DHCP server can provide, the total number of people that can be online at once, and the amount of bandwidth available to the entire site. If you can’t get good answers to these questions before the conference begins, you have to assume that they’ll be running a single, consumer router connected to a DSL line and that’s about all you get.

What are some of the best practices for conference organizers? What questions should they ask the conference venue or ISP to know, in advance, if the WiFi is going to work? What are the most common causes of crappy WiFi at conferences? Are they avoidable, or is WiFi simply not an adequate technology for large conferences? I thought I’d ask on ServerFault, so if you have any ideas, have at it!

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at October 09, 2009 02:20 AM

October 07, 2009

Tyler Mitchell

Install Skype on AMD64 Debian/Sidux

I switched to running the Sidux distribution not too long ago, at the same time I upgraded to a 64 bit AMD machine. It's my first foray into Debian based distros and has been pretty nice until I went to install Skype. I won't regurgitate the other message boards, but in a nutshell here was my solution:

  • Add Medibuntu repository to my apt sources. I had to manually select the hardy.list file to download since there were no sid.list files.

read more

by Tyler Mitchell at October 07, 2009 12:15 AM

September 28, 2009

Paul Ramsey

Why I Don't Like Silverlight (and Flex)

It's this guy. Whenever I go to some "new supercool, rich web thing" I am immediately greeted with this guy.







We spend all this effort to tune web sites, to make them faster, to get those page load times down down down, why do we do that? Because that's the optimum web experience – your click is my command! So every time I get dumped into one of these Silverlight/Flex things, and the loading bar is creeping along, my visceral response, usually around 68% is, "man, this is taking way too long, I'm going to go do something else".



It's not fair, but it's true.

 

by Paul Ramsey (noreply@blogger.com) at September 28, 2009 04:56 PM

September 25, 2009

Tyler Mitchell

Meet me in Sydney

The biggest annual event for me and OSGeo is fast approaching. The FOSS4G conference event, held this year in Sydney, Australia, will be held in October. I'd love to meet you there if you would like to chat about open source, GIS, cartography, programming and all such related topics. Attend a workshop to learn to make maps or run web mapping sites. Or just come to hear talks from leaders in the open source geospatial community.

read more

by Tyler Mitchell at September 25, 2009 06:42 PM

Paul Ramsey

Dropbox

In the spirit of promoting those products that really make a difference in your work life, let me give a loud shout-out to Dropbox. I'm a road warrior, kinda, in that I migrate between my home office and a bunch of coffee shops, so I'm always mixing my work environment between my laptop and desktop workstation. Some things I work on, like source code in SVN already naturally has a model of disconnected work with a synchronization step. But other things (things I'm doing right now), like talks and presentations, workshops, general writing do not. How to get the benefit of disconnected editing with connected synchronization?



Enter Dropbox! Dropbox sets of a folder on each machine you install it on, and you attach that folder to your Dropbox account. Anything you save in that folder gets replicated up to an "in the cloud" copy regularly while you're internet connected. And when you're not, it's just like any other local copy. You can also share Dropbox folders with others, which is really handy for collaborating on things like PPTs. No more shipping around the latest copy of that Word document.



Functionally, it's nothing that hasn't been done before, but it's been done really well, it's part of my work-life now, and for small folders (<1Gb) it's free. For anyone who works on more than one machine regularly and with disconnection, it's a real time-saver.

 

by Paul Ramsey (noreply@blogger.com) at September 25, 2009 04:35 PM

September 24, 2009

Joel Spolsky

The Duct Tape Programmer

Jamie Zawinski is what I would call a duct-tape programmer. And I say that with a great deal of respect. He is the kind of programmer who is hard at work building the future, and making useful things so that people can do stuff. He is the guy you want on your team building go-carts, because he has two favorite tools: duct tape and WD-40. And he will wield them elegantly even as your go-cart is careening down the hill at a mile a minute. This will happen while other programmers are still at the starting line arguing over whether to use titanium or some kind of space-age composite material that Boeing is using in the 787 Dreamliner.

When you are done, you might have a messy go-cart, but it’ll sure as hell fly.

I just read an interview with Jamie in the book Coders at Work, by Peter Seibel. Go buy it now. It’s a terrific set of interviews with some great programmers, including Peter Norvig, Guy Steele, and Donald Knuth. This book is so interesting I did 60 minutes on the treadmill yesterday instead of the usual 30 because I couldn’t stop reading. Like I said, go buy it.

Go! I’ll wait.

Here is why I like duct tape programmers. Sometimes, you’re on a team, and you’re busy banging out the code, and somebody comes up to your desk, coffee mug in hand, and starts rattling on about how if you use multi-threaded COM apartments, your app will be 34% sparklier, and it’s not even that hard, because he’s written a bunch of templates, and all you have to do is multiply-inherit from 17 of his templates, each taking an average of 4 arguments, and you barely even have to write the body of the function. It’s just a gigantic list of multiple-inheritance from different classes and hey, presto, multi-apartment threaded COM. And your eyes are swimming, and you have no friggin’ idea what this frigtard is talking about, but he just won’t go away, and even if he does go away, he’s just going back into his office to write more of his clever classes constructed entirely from multiple inheritance from templates, without a single implementation body at all, and it’s going to crash like crazy and you’re going to get paged at night to come in and try to figure it out because he’ll be at some goddamn “Design Patterns” meetup.

And the duct-tape programmer is not afraid to say, “multiple inheritance sucks. Stop it. Just stop.”

You see, everybody else is too afraid of looking stupid because they just can’t keep enough facts in their head at once to make multiple inheritance, or templates, or COM, or multithreading, or any of that stuff work. So they sheepishly go along with whatever faddish programming craziness has come down from the architecture astronauts who speak at conferences and write books and articles and are so much smarter than us that they don’t realize that the stuff that they’re promoting is too hard for us.

Here’s what Zawinski says about Netscape: “It was decisions like not using C++ and not using threads that made us ship the product on time.”

Later, he wrote an email client at Netscape, but the team that was responsible for actually displaying the message never shipped their component. “There was just this big blank rectangle in the middle of the window where we could only display plain text. They were being extremely academic about their project. They were trying to approach it from the DOM/DTD side of things. ‘Oh, well, what we need to do is add another abstraction layer here, and have a delegate for this delegate for this delegate. And eventually a character will show up on the screen.’”

Peter asked Zawinski, “Overengineering seems to be a pet peeve of yours.”

“Yeah,” he says, “At the end of the day, ship the fucking thing! It’s great to rewrite your code and make it cleaner and by the third time it’ll actually be pretty. But that’s not the point—you’re not here to write code; you’re here to ship products.”

My hero.

Zawinski didn’t do many unit tests. They “sound great in principle. Given a leisurely development pace, that’s certainly the way to go. But when you’re looking at, ‘We’ve got to go from zero to done in six weeks,’ well, I can’t do that unless I cut something out. And what I’m going to cut out is the stuff that’s not absolutely critical. And unit tests are not critical. If there’s no unit test the customer isn’t going to complain about that.”

Remember, before you freak out, that Zawinski was at Netscape when they were changing the world. They thought that they only had a few months before someone else came along and ate their lunch. A lot of important code is like that.

Duct tape programmers are pragmatic. Zawinski popularized Richard Gabriel’s precept of Worse is Better. A 50%-good solution that people actually have solves more problems and survives longer than a 99% solution that nobody has because it’s in your lab where you’re endlessly polishing the damn thing. Shipping is a feature. A really important feature. Your product must have it.

One principle duct tape programmers understand well is that any kind of coding technique that’s even slightly complicated is going to doom your project. Duct tape programmers tend to avoid C++, templates, multiple inheritance, multithreading, COM, CORBA, and a host of other technologies that are all totally reasonable, when you think long and hard about them, but are, honestly, just a little bit too hard for the human brain.

Sure, there’s nothing officially wrong with trying to write multithreaded code in C++ on Windows using COM. But it’s prone to disastrous bugs, the kind of bugs that only happen under very specific timing scenarios, because our brains are not, honestly, good enough to write this kind of code. Mediocre programmers are, frankly, defensive about this, and they don’t want to admit that they’re not able to write this super-complicated code, so they let the bullies on their team plow away with some godforsaken template architecture in C++ because otherwise they’d have to admit that they just don’t feel smart enough to use what would otherwise be a perfectly good programming technique FOR SPOCK. Duct tape programmers don’t give a shit what you think about them. They stick to simple basic and easy to use tools and use the extra brainpower that these tools leave them to write more useful features for their customers.

One thing you have to be careful about, though, is that duct tape programmers are the software world equivalent of pretty boys... those breathtakingly good-looking young men who can roll out of bed, without shaving, without combing their hair, and without brushing their teeth, and get on the subway in yesterday’s dirty clothes and look beautiful, because that’s who they are. You, my friend, cannot go out in public without combing your hair. It will frighten the children. Because you’re just not that pretty. Duct tape programmers have to have a lot of talent to pull off this shtick. They have to be good enough programmers to ship code, and we’ll forgive them if they never write a unit test, or if they xor the “next” and “prev” pointers of their linked list into a single DWORD to save 32 bits, because they’re pretty enough, and smart enough, to pull it off.

Did you buy Coders at Work yet? Go! This was just the first chapter!

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at September 24, 2009 01:58 AM

September 20, 2009

Paul Ramsey

Ellison and Balmer

If you haven't had a gander at these videos at All Points Blog showing Larry Ellison (Oracle) and Steve Balmer (Microsoft) opining on the "cloud" take five minutes and have a look. Larry's still at stage one but Steve appears to have moved on to stage two.

 

by Paul Ramsey (noreply@blogger.com) at September 20, 2009 07:37 PM

September 16, 2009

Tyler Mitchell

Open Source Car Needs Open Source Navigation

I recently came across the 40fires.org project - "a forum to develop energy-efficient cars using an open source approach.".

While waiting for more information from them, I did some thinking about what parts of this kind of project would interest me or how OSGeo or other geospatial projects could help them out.

read more

by Tyler Mitchell at September 16, 2009 03:59 PM

Paul Ramsey

PostGIS Down Under

If you've been putting off registering for FOSS4G and are planning to attend the PostGIS workshop, better delay no longer – a little birdy tells me that the workshops program in general and PostGIS in particular are almost full.

 

by Paul Ramsey (noreply@blogger.com) at September 16, 2009 03:11 PM

Tom Kralidis

Python, KML and Parishes

When looking for phone numbers for various churches, I thought wouldn’t it be neat to put the locations on a map? Python to the rescue.  After some scraping to generate a CSV listing, I geocoded the addresses, then I used the OGR to convert into a KML document, using the same approach I previously blogged about.  [...]

by tomkralidis at September 16, 2009 01:51 PM

September 11, 2009

Paul Ramsey

Snow Leopard

Being a colossal Apple fanboi now, immediately upon returning home from vacation I ordered the latest version of OS/X, "Snow Leopard" and promptly installed it on both my laptop and workstation. Without testing on one first. Whoops.



It looks like the new version of XCode is producing output that can't link to libraries compiled with the old version, so this morning I'm re-compiling everything I ever installed from code on both machines.



On the bright side, the performance claims seem to be bearing out. Apps are starting faster and boot-up in general is quicker.

 

by Paul Ramsey (noreply@blogger.com) at September 11, 2009 03:16 PM

September 08, 2009

Joel Spolsky

Countdown challenge

This month we’re starting to get organized for StackOverflow DevDays, a series of one-day, mini conferences in ten different cities. Because of the packed schedule, keeping on time is very important, so I want to have a full-screen countdown application that we can run during intermissions warning people when we’re going to resume. We’ll put this up on the main screen and hopefully that will encourage people to sit down and be quiet on time. I thought this would be a great opportunity to showcase the StackOverflow community’s programming talent, so I posted a little contest over on meta.

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at September 08, 2009 03:56 PM

September 03, 2009

Joel Spolsky

Upcoming startup workshop in San Francisco

I’m organizing a half-day startup workshop in San Francisco. This would be a terrific event to attend if you’ve recently started a software company and feel dazed, confused, or just want to bounce ideas off of someone who’s been there.

We’ll keep it small so everybody gets a chance to be heard. Space is extremely limited.

It’s a bonus supplement to the Business of Software conference, which is Nov. 9-11 in San Francisco.

Although the startup workshop itself is free, you do have to pay for for that conference, which is not free, in fact, it’s kind of expensive (but totally worth every penny!) I know it’s kind of expensive for very early stage startups, but trust me on this, it’s worth it.

Here’s what happens. After the main conference finishes up on Wednesday, we’ll divide up into three groups. Each group will do three 90 minute workshops, moderated by:

  1. Neil Davidson and Simon Galbraith, the founders of Red Gate Software. Red Gate is a software company in Cambridge, England, founded in 1999, which has now grown to about 160 people. It was founded with no VC and little debt. In 2006 it was Cambridge News business of the year and has been in the Sunday Times top 100 places to work for the last three years running. They’ve recently launched Springboard, an amazing startup incubator that provides advice, office space, free lunch, and pocket money, and takes no equity in return.
  2. Joel Spolsky (oh wait that’s me) and Michael Pryor, the founders of Fog Creek Software.
  3. Dharmesh Shah, founder of HubSpot, a software platform for internet marketing. Previously he founded Pyramid Digital Solutions, a bootstrapped company acquired by SunGard. Most of you know him from his blog OnStartups.com or from the terrific talk [video] he gave at last year’s conference.

The format is very open. It’s a chance to chat, bounce ideas around, ask questions, solve specific problems, get feedback, and learn from each other.

After the workshops we’ll regroup with Jason Calacanis, who will do a live broadcast of his podcast This Week in Startups and take your questions live. Jason is on his third startup. The first, Silicon Alley Reporter, was the flagship magazine of New York City’s short-lived dot com boom; after the crash of 2000 it closed down. His second startup was Weblogs Inc, the first really serious commercial blog network, which sold to AOL for an undisclosed sum (let’s call it $25 million, shall we?) After turning netscape.com into a Digg clone, Jason spent some time at a fancy-pants VC firm, Sequoia Capital, where he hatched the idea for his current startup, Mahalo, which they funded. Anyway now he’s got this terrific podcast and he’ll be doing it live and we’ll be his audience, so you’ll have a rare chance to ask Jason questions in person and hear him pontificate.

Here’s how to sign up.

If you haven’t registered for BOS2009 yet, go do that. During the registration process, you’ll see a checkbox that says “I'd like to come to Joel's startup bootcamp”. It’s not a bootcamp, really. You won’t have to do pushups or work very hard. But check that box anyway.

If you already registered for BOS2009, follow this link. Click on “Already Registered.” Log on, and look for the link that says Event Fees. Why does it say that? I don’t know. After you click on that link you’ll be able to check the box that says “I'd like to come to Joel's startup bootcamp”. It’s still not a bootcamp. Really. Bootcamp is where you run around in circles for 20 weeks without getting more than four hours of sleep a night while drill sergeants barely a year older than you foam at the mouth and berate you endlessly like that time Tom Hanks flips out at Bitty Schram in A League of Their Own. “There’s no crying in baseball!” Anyway, NOT THAT AT ALL. This will be more of a friendly conversation with successful software startup founders. Not bootcamp.

Space is extremely limited: there will be three groups of 24 founders each. No more than two attendees per startup, please. See you in San Francisco!

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at September 03, 2009 12:54 AM

September 02, 2009

Joel Spolsky

Being Number One

At last year’s Business of Software conference, I gave a talk about designing products that are more than just adequate. How do you make a product that becomes a category-killer, number one, super hit? What is it that gives the Apple iPod 90% market share?

Neil Davidson has the video of my talk online (it’s about 46 minutes).

This year’s conference is going to be great. There are still a few tickets available. It’s November 9th-11th in San Francisco. This is a conference that’s all about terrific speakers: Geoffrey Moore, Don Norman, Paul Graham, Heidi Roizen, Jennifer Aaker, Michael Lopp (“Rands”), Ryan Carson, Paul Kenny, Dharmesh Shah, Kathy Sierra, Mat Clayton, and The Cranky Product Manager are all confirmed speakers. Register now before it’s too late!

Need to hire a really great programmer? Want a job that doesn't drive you crazy? Visit the Joel on Software Job Board: Great software jobs, great people.

by Joel Spolsky at September 02, 2009 02:13 AM

August 16, 2009

Paul Ramsey

Off to GeoWeb

Tomorrow Steven Citron-Pousty and I will be teaching a workshop on building a geostack using open source components: PostGIS, GeoServer, OpenLayers, QGIS, GeoWebCache! After that, I will be around all week taking in the interesting geoparty that is GeoWeb. Last year was my first GeoWeb, and while I found the talks a bit dry (perhaps I am not ready for the brave new world of building modeling), I found the calibre of the attendees bracing – it was a great place to meet movers and shakers in the (corporate) geoworld. "Where 2.0 for grown-ups" indeed (for varying definitions of the term "grown-up").



Update: The workshop is available online now, for your self-guided learning pleasure.

 

by Paul Ramsey (noreply@blogger.com) at August 16, 2009 03:01 AM