After changing the NIC from a virtual machine to another network, vCenter (vSphere 5) showed both networks – the old and the new one in the summary tab:

I double checked the .vmx configuration, tried to remove and re-add the NIC, closed and reopened vCenter client,… nothing has helped.

The solution ultimately was very easy… there was an open Snapshot.
Deleting the snapshot removed the ghost network.