You have to completely delete all existing dashboard configurations for all users so they are re-initialized the next time they log in. There is no standard functionality for this. I typically use the JavaScript console addon to do this. Recently I had to remove some obsolete dashlets and reset the theme in the dashboard of a few sites. A similar script would need to be written to delete all the user dashboard.xml files and the associated dashlet componets.
