Mainly it's the increased storage, new form factor, newer software, more gaming options, and addition of the accelerometer for the same price.

http://www.apple.com/ipodnano/features.html

I have the 3G "fatty" and see no need to upgrade, but if I didn't have an iPhone, I would get the Nano 4G anyway just for the motion-based games.