I really don't mind playing with any Tier, have learn quite a bit from the Legends I have played with, and try to impart some of that knowledge on others of lower tiers I may come across.
However, it is indeed about the pace of the game. It is rather annoying when playing with a Hack, putting your approach shot in birdie range, then waiting for what feels like an eternity while said Hack sinks their putt, or at least gets it closer than me. So yeah, won't always want to play lower tiers, but doesn't mean I NEVER want to.
MSVB