HI Jeff
The Viper will be controlling a brushed motor with two wires from the ESC to the motor. Brushless have three wires, sorry should have mentioned that, sorry.
The Viper usually sets up automatically but the settings ca be adjusted to taste by use of a small button on the ESC. When you switch on the small switch attached to the ESC the red and green lights flash and if you press the button whilst flashing you can then set the max forward speed by moving the transmitter control stick to the up position , then move the stick to the central position, the red light will be solid so move the TX control stick to the down position this will set the reverse speed, finally move the stick to the neatral position and the set up is complete. The ESC will retain this info unless you choose to press the button again at switch on, so there is no need to set up more than once.
The details are at
http://www.mtroniks.net/resources/VIPERInstructionsheet_2.pdf.
It's possible that you have an earlier version or possibly a forward only ESC - not sure about this but it's on their web site. Did you see the vendor running the motor both ways Ie fwd/rev?
You mentioned very fast and if you have a speed boat this may be the case or the previous owner has set up the ESC to give more forward speed by adjusting the neutral point.
I suggest you try adjusting the ESC in accordance with the Mtronic instructions in the link and see if you can get control.
Please let me know if you are still having problems and I will do my best to help further. 😀