Yes, all this can be used with video.
The simplest in this case is a macro lens. It can easily be put or removed even in water (placed outside the underwater box).
I have friends who shoot macro under water. The same sea-horses and nudibranchs.