The following video shows how to create an admin account on your Ventrilo server. This will allow you to connect as admin without the need to use your rcon password on each connection.
http://www.youtube.com/watch?v=sa-TWhuX0tk
Ventrilo's User Access Rights are very robust. More information about how to setup various privilege levels can be found here: http://www.ventrilo.com/uar.php