If your counterparty is compromised, that still only leaks your communication with that counterparty, but not other, unrelated conversations.