Yeah, but sshfs has been working pretty slow to me.

There is actually this neat hack you can use(if you use VIM) with rsync.

https://github.com/IvRRimum/rsync-vim

I know it's kind of Hacky, but the performance improvement is worth it IMO.