You can use the mouse right click if you want to perform any of these three functions;
Make a New Folder
Rename Folder
Cut Folder
Paste Folder
Delete Folder
See image reference below: