I've got 4 RH so, if I eliminate all but one, Traz rogue production (I have over 500) won't be affected?
Based on the rest of your post, no.
The amount of Rogues will be reduced.
4 RH + 2 ordinance, 1 tank, 1 sniper buildings plus 1 champ = 9 total Barracks so you average 4 of 9 units being Rogues.
Getting rid of 3 RH means only 1 of 6 Barracks being Rogue, so only 1 in 6 troops produced by Traz will ne Rogues instead of 4 of 9. That's a reduction from 44% to 17%.
Traz Tip. If you can't research a Barracks of your new Era the day you move up in Era, Champ's Retreat + Traz can get you new Era Troops. The day you move up in Era wait to collect your Traz until after moving up in Era and using 1 Up or RK on your Champ's Retreat. Instant Current Era Army.