If you want to remove a Dashboard Notification, click the "x" in the top right of the notification. Some notifications may reappear later due to the importance of the action.