I think the way it works is that If you are using the putter from somewhere other than on a green, it's not a putt, and the hit will be deducted from your ball durability.
I've never played a putting only CTTH, so I don't know how that works, but I would not worry if each putt was deducted from the ball durability.