Maybe it's not a technological problem or a sheer-numbers problem of why we haven't been "visited". Maybe, after billions of years, aliens have gotten so weary and emotionally drained from watching primitive species (some with potential) torture and kill one another into extinction, and now they just are not even looking. "Call us if you grow up".