You can either transport the .Xauthority key to the app-running-hosts, or you can start the X server on TC such that anyone can connect (add a firewall, or only run in a trusted network).
To let anyone connect, add the -ac option to Xvesa (before the -I option) in .xsession.