Would need to see the scorecard really, but remember there is a hit the green bonus and inside 10 feet bonus that gets bigger after each consecutive hole that you do it on.
So if you can hit inside 10 feet on every hole, by the time you get to the 8th and 9th hole you are getting some pretty big bonuses. He could hit to 9.5 feet and you to 2.0 ft but his bonuses are bigger then he would be getting bigger scores
If he was literally getting 150K on every hole while you were getting and 10k and 20k then yes there was problem