Categories

What is the difference between tags and categories? Not a whole lot it seems at times. There should generally be fewer categories...