You probably didn't take punting high enough initially. At level 41, you probably want it to be over 90 natural at least.
Its still not too bad a build though. As your confidence and vision increase, you should be kicking over 40 yards a punt in the next few seasons.