Points have nothing to do with what kind of army one has. If you and I are both LMA, we will both have (left over from HMA) access to Heavy Infantry, Trebuchet's and the like, and we will both be earning Great Sword Warriors, Heavy Knights and Cannons. If I'm busy battling the map and the PvP tower and you don't, then I will have more points than you. But I will not get any troops that you don't also get - our armies will be the same type.
Points come for two reasons - battling and building. If you battle, you get points which raise your rank. But you ALSO get points for upgrading your city and for collecting more resources and coins.
I'm floored by the number of cities I visit that are crowded with oudated buildings from earlier eras - you can tell what era a person is in by their Town Hall. An HMA town hall and all they've got for army is spear fighter barracks. Upgrade your army as soon as you can. Upgrade your other buildings also - it improves your coin and resource production and improves your points. But make no mistake - if you and I are both at the end of LMA, we both have access to the same troops. If you choose to not upgrade your army ... then yes, I will beat you.
Click on your global rank at the top of the screen. You'll see a list of all players in your world. Visit the cities of some of the folks at the very top - VERY few of them are holding on to old, outdated buildings (with the exception of special buildings won in events). Their houses and resource buildings are current and i can assure you that their armies are current (although some have previous armies for GvG) Their elevated rank comes from playing for a long time and earning points through battle and upgrading their city.
I struggled in the beginning 'cause I HATE being at the bottom of anything (yeah, I've got an ego problem but that's another conversation). I went to the global ranking list and I started sending out friend invitations to dozens of the top players. Some ignored me, some accepted. The ones that accepted became a TERRIFIC resource - I asked them how they became successful. I adopted what some of them did and ignored what I didn't like (I've plundered only THREE times and all 3 were because they plundered me first, so I retaliated). So I don't plunder. I also don't attack people in lower ages. BUT - the best advice they gave me was to STOP EXPECTING other people to follow my rules.
So I don't. You don't want to battle at all or even have an army? Ok, fine by me. You want to plunder all your neighbors? That's fine too - I'm going to do whatever I have to do to protect my stuff. I usually time my production every 24 hours and no, I'm not going to tell you what time of day that is
I fully expect to periodically get plundered ... and I do. But in the last 5 months, all I've lost is some coins from houses. Doesn't make me thrilled, but it's the cost of playing the game.
Plunder is part of FOE. Expect it. Do what you can to minimize it's negative effect on you. And then get on with building and working your way through the game.
Or not.