It's an option to play Challenge or not. It would still be an option. In real golf, players often play partners in a money match. Of course you know who you are playing. If you"re prone to just "join" a game with strangers for creds well maybe you deserve to get hustled.
But why not make it an option--I repeat option. No one is forced to play a challenge.
Same as skins--I have been invited to join a skins game with a group I am not familiar with but I chose to play with my friends.
Just a suggestion to make it available. Not being crammed down your throats like CC Clashes.