I knocked up a quick plugin to display all the categories and display all the posts in each of them. Currently it displays posts multiple times in each of the categories it belongs to. I had to jump through hoops a bit to get the categories ordered alphabetically.
Update: version 1.2 just out adds the ability to set the ordering of the posts.
The idea originated with my friend Linda at herselfswebtools.com.