I actually start with a color scheme or theme I want. For example, my monk's predominant color scheme is 'blue,' so she uses t14 LFR and Rayne's Scarf, along with one of the monk-quest belts that has a blue buckle, and my warrior's predominant theme is 'Argent Crusade,' so she alternates between the Insurgent Heroism-recycle set or t4 and an Argent Dawn tabard, and Righteous Armor with a Crusader's Tabard.
Weapons, I try to match up with the character's personality less so than the armor set--my monk's fist weapons are transmogged into the invisible handwraps from Peak of Serenity and her staves/polearms into the Spear of Xuen, and my warrior's weapons are usually transmogged into either the Sha axe from Terrace, or the 2h sword from Ghostlands questing.