Rust does do this. The unit of compilation is the whole crate and the compiler creates appropriately sized chunks of LLVM IR to balance duplicate work and incrementality.

Rust is generally faster to compile on a per-sourceline basis than c++. But rust projects compile all their dependencies as well.