In the Scripts Explorer, to delete a folder, you must first un-check the recurse subsets box so that the displayed scripts on the right only belong to the currently selected folder.