Originally Posted by
Wrecktangle
My biggest issue with WoW currently isn't the balance per-se (I did just get butchered pretty bad), but it's the obvious lack of testing controls. I am 87% sure they have no manual internal testing processes. I think their entire testing is done via automation and PTR. They have a wealth of free testing players, but the feedback is ignored, so I'm not actually sure of its value to them, since they don't do anything with the data in house anyway.
They nerfed DPS legendaries (rightfully so), but then retuned new ones to exceed the performance of outgoing ones. That to me is one bit of proof. The second was when they released a trinket that was incredibly powerful for most classes, but especially on mine, they nerfed it by 70%, the day of. I don't care that they nerfed it. I care that it went live like that in the first place. That is another example to me that screams we designed something and never tested its functionality.
FF14 has its balance issues for sure, but it definitely seems like their tuning is a lot tighter because I think they do a good bit of it in house. I think they're approaches are sometimes sub-optimal but you can definitely feel that their heart is in the right place.
Automation is great in a lot of aspects, but there are reasons some processes are manual and its because they provide insight few automated tools could ever replicate without an abundance of assumptions that muddy the quality anyway.