I found it more convenient to switch layouts by hiding and showing panels, which support all the views. That way, display is instant between layouts.
Before displaying a layout, I test if the panel has been intialized, and if not, then I add the layout to activity.
That worked just fine, until...