2 sets of components up front?

Just wondering if two sets of components up front is a bad idea? I currently have a pair of 5.25 Polk MM component sets in my Q logix Kick Panels(tweeter located in kick panel) and a set of 6.5 Infinity Kappa Components in the  doors(tweeter mounted on door panel close to window).

From a sound quality (blending) perspective, isn't it better to just have one set of speakers in the front instead of two?

My observations below:

Playing ONLY Polk Audio MM from kick panels - Sounds crisp and clean.

Playing ONLY Infinity Kappa from door panels - Sounds crisp and clean.

Playing BOTH sets - Sounds very loud but not as Clean/Smooth as playing individual sets.

Any suggestions? Maybe disabling the Infinity tweeter so I dont have 2 sources of high frequencies coming from 2 different locations? Maybe adjusting my Clarion MCD-360 crossover such that I set each component at a different Cut Off frequency?

Thanks in advance.

In general yes, from a sound quality perspective it is always best to have only one source for each channel.  The only real reason to use more than one set of main speakers is for SPL, or because you think it looks cool.  The likely reason you don't think it sounds as good when using two sets is due to time alignment distortion and phase-related frequency cancellation due to lobing.Support the12volt.com

I'll play around with tuning frequencies and/or gain settings and see if the sound fits my liking, otherwise I'll just go with the single kick panel set.

Thanks for the helpful information.