I actually think it would be easier for you to simply tell your "buddies" the password to the room, rather than setting the password and wondering as to if they saw it or not, etc.
Just whisper the people you want to talk to (/wh [user]), then tell them the password so they can join.
You don't have to tell everyone the password on Game Chat, you know.