Apple Intelligence will index all of your messages, app data, etc. into a queryable index. That will also obviously reside on disk somewhere, encrypted. And it could be just as exfiltratable as your hypothetical. (Because both cases require compromising the host computer)