GreatOdds
Did some digging through the source. It seems the collisions shapes seen in debug mode are not the same as the editor gizmos. Instead, the collision object gets the debug mesh of the collision shape and adds it to the scene if 'Visible Collision Shapes' is set and the game is not running in the editor.
Seems like I'll have to include the debugging mesh/code with my game object.