The flag doesn't affect your putt from the green but will from everywhere else. Basically, it's invisible when you putt from the green. Putts from the fringe will hit it and bounce away more times than not.
Lip outs usually mean you're putting too fast. If the speed is right they will drop. GL