It's not actually legal to openly carry guns in public everywhere here in the U.S. It depends on the state. To answer your question, it's because of how the U.S. was founded. It is also because many Americans are paranoid about the government and each other, and because the National Rifle Association is the second most powerful lobbying group in the country.