I built 35K rogues in my 1st city, never again, I choose how many other units based on how much I use them. With more rogues it's not as necessary to build the numbers you mention, it's a personal choice I'd suppose. 20K seems a bit much of 1 unit, other than rogues, imo and that's a lot...