Do you always play with a full 6?

Are you one of those people who's a 'few characters short of a party'?
That's not slang for 'not all right in the head'. I mean do you prefer 4 rather than 6 party members? Or less.