If your opponents don't have any problems with you using them, then it would seem you're already being fair.
If you really want a point increase, the only basis I can think of to use is 12 points per inch, rounded to avoid wonky remainders. 35 points for 3 inches and 60 points for 5 inches.