Does it aggravate you when Cowell gets interrupted?

Why is it that Randy or Paula (mostly Paula) will never let Simon have his say when judgement time comes---they're always interrupting or disagreeing with him and taking away his commenting time, after he has patiently sat there and listened to Paula take 15 minutes to string a sentence together. The guy may be a little bit of a pain in the neck, but he is the one I most look forward to hearing comment. It gets on my nerves that he gets cut off by those two (mainly Paula).