NPC weapon proficiencies

Hi! Can I stop NPCs from automatically progressing in levels if I pick them up say at level one and then dismiss them a little later? I would like to play the beginning of the game with only a party of 2-3, but I don't like the way many of the NPC "screw" with their proficiencies if I pick them up at later levels.