Perks to suppress your innate attributes?

So I have a rather unique issue. I want to jump Add Digit (and some other gamer system jumps as well) but do not want my luck and charisma to eventually become ridiculous to the point everything just always go my way without trying or that I can't have normal interactions with anyone. I know there are perks to limit your powers or perks but does anyone know a way to limit your attributes such as luck and charisma?