Caricatures are also an art, like any other. Unless you have a sharp wit, a good eye and a steady hand you can not make one.
I love them to form the same reason you listed because they are funny and I can sincerely laugh at them.
The central theme of any caricature is to over-impose some traits, and everybody has something that is special, but also funny in a way.