I did a quick minimal test - tried to use case switch start etc:
Even when component gets executed first so that the second config node is in inactive, it still shows up immediately in the config dialogue:
So this means I think it is not possible to do this via Configuration Nodes.
If it is an option to use Widgets and make the user configure everything in a composite view, it may work something like what is discussed and shared in this topic: