I do an evening office cleaning job and they actually have a policy on this.  The one on the right is how they say it should be done.

I've noticed that as the bathrooms are upgraded they are changing the holders to the type where the roll is side-on and enclosed, no need to touch anything that the user doesn't intend to use.