GPt models have a people-pleasing bias and positivity bias. If you want factual information, you have to modify your prompt. I imagine you would get very different results if you asked "are Jeeps more reliable than Toyotas", or "how do Jeeps compare to the median car in terms of reliability"
My impression is that different llms are more or less people pleasing. I found grok is more willing to tell me something is a bad idea.
I wouldn't be surprised if the training was weighted to favor text it learned from more "reliable" or "professional" resources, which in the case of products, would be official sales listings that talk about how great their product is.
It is more subtle than that. It is trained on "everything" so the specific adjectives and words you use in your prompt will cause it to generate very different responses. The fine tuning causes it to prefer by default more reliable/professional responses ... but that is not because the training data is weighted toward them as such. If you mention specific publications, or forums, it will give you responses more likely to come from those.
Looking at the reasoning traces for for the new reasoning models you can actually see how fine tuning is moving toward having models list the assumptions around data sources, which should be trusted, list multiple perspectives and then summarize, resulting in better answers. You can do that today with non-reasoning models, but you need to prompt engineer it to ask for that explicitly. This process of identifying not just extant content, but teaching systems how to approach problem analysis (instruction tuning, reasoning traces, etc ...) will be key to influencing how the models work and increasingly how they are differentiated.
I don't think that's a big part of it, although it may be included.
In general, the models lean towards being Yes-Men on just about every topic, including things without official sources. I think this is a byproduct of them being trained to be friendly and agreeable. Nobody wants a product that's rude or contrarian, and this puts a huge finger on the scale. I imagine an a model unfiltered for safety and attitude and political correctness would have less of this bias (but perhaps more of other biases)
Do people really prefer Yes-Men models? It appears that you are right but I find it surprising.
I very much prefer more disagreeable, critical models. GPT 4o and o3-mini will sometimes not tell you that you, e.g., didn't attach a file you asked to be analyzed and will instead hallucinate its contents, presumably not to upset you. Of course, their hallucinations are way more annoying.
My impression is that different llms are more or less people pleasing. I found grok is more willing to tell me something is a bad idea.