B'z Net Party did something similar (twice, IIRC)... everyone posted their top 5 B'z songs and talked a little bit about why they picked those five. Then they tallied them up & put the top 20 on a special page. It was alot of fun and really interesting to see everyone's choices and why they chose them.
I'm all for this, I think it'd be interesting