Gold is actually slightly larger than all the physical notes and coins of all major currencies combined.

Scroll down this page a bit, it will give you an idea how big the various markets are:
http://money.visualcapitalist.com/worlds-money-markets-one-visualization-2017/