Yeah, this is why I really am disliking the instant replay officiating, especially when their New York officiating office stops the game to reexamine plays. In the end, everything is subjective and things like "what is a catch?" get so overly complicated to where they have to stop the game for extended periods of time because it's overly complicated. Picking and choosing to review calls on an arbitrary bases, especially when they won't review non-calls that are blatant with extensive instant replay evidence, just sours the entire experience for fans and teams.
As you mentioned in the part I snipped out, consistency goes a long way towards the players and the fans trusting the integrity of the game when it comes to officiating. Unfortunately, there's been a lot of cases in the playoffs and superbowl that hilighted how inconsistent the refs (both on the the ground and in the New York booth) really are. This middle ground situation where calls that get scrutinized down to frame-by-frame replay are decided arbitrarily and non-calls just are let go feels like the worst option. Personally, I'd rather go back to just the refs on the ground making the calls and that's it. No New York booth, no challenge flags, just call it as they see it. Will they get it right all the time? No, of course not, but it's better than arbitrarily letting things go or overanalyzing/overcomplicating things. If anything, you can use all the instant replay and AI tech to judge how the refs were after the game, so you can make decisions about their quality as refs and for anti-cheating/scandal analysis.