By default TakeControl sets TeamViewer to work with terminal servers allowing you to connect to multiple users with the proper TV ID. This does not work with TakeControl because the password is not known. To allow direct support of the single connected user to the HVD, uncheck the "Enable enhanced multi user support (for Terminal Server)" in the TeamViewer options under Advanced.