I'm guessing that it has a lot to do w/ how long the ball is in the air per yard of travel.
The driver of longer distance is moving the ball faster, I'm guessing, than the weaker, shorter distance driver.(like a sling shot can toss a rock 20 feet, a bullet goes almost a mile, the bullet is going faster = more feet traveled per second)
Since the driver usually is hitting out, and fast, and like a line-drive, it's spending less time in the air per yard traveled,
Compared to an iron like a 8 i that is lofting up and at a slower speed per foot so its arc makes it stays in the air longer, therefore, more time getting blown by the wind per distance calculation, and the total yardage spent rolling on the green or FW (no longer in the air) is short, and a small amount of its calculated total yardage
A Drive will touch the ground, have less air affecting it as it rolls on the ground for a bigger percentage of the total yardage & power hit.
This may be why a punch shot, which has lower trajectory, is sometimes chosen in a windy condition to keep the ball out of the air longer per distance traveled.
The punch (like the drive) in comparison to a full shot of the same distance may spend less time in the air, move faster than the higher, lofted full shot, and spend more time rolling on the ground rather than in the air being affected by the wind.
But I'm just guessing.