Are you sure the folder it is installed in is not marked Read Only, or have you tried running Toribash as an administrator (not that you should do so, but if it helps that gives us a few clues).
If it's not in Program Files though, most of the potential issues are avoided. Program Files has some UAC-related permissions things that Toribash generally won't handle gracefully.