In virt-manager, you should* be able to go to file -> add connection.

Select Hypervisor "Custom URL", and enter: qemu+ssh://root@<host>/system

And Bob's your uncle.

It works great for me! This means it likely won't work for you until you've paid the proper penance to the computer god.