You can delete the Folder tool from a scene in the following way.

If you have the authorization, you can find the 'Delete folder' menu on the left. 

If you want to delete the tool, click on this button and in the appearing window check the 'Yes I would like to delete' checkbox, and click OK.