Why does summarization look great but Q&A looks terrible for the same model?

https://www.bookmark-step.win/web-retrieval-claims-vs-reality-why-the-73-86-reduction-in-hallucinations-number-breaks-down

I’ve spent 12 years watching stakeholders get blinded by "headline numbers