The alteration one picks a random room on the floor to change, and some floors have rooms that have a chest in every corner but balance it by being stuffed to the brim with enemies, if the pomander picks that one... yeah
Granted, the one time I saw that happen to me, they were all korrigans, which made my party very, very happy