This unlisted video looks like it’s working, right?
The video field uses the URL to get the information from the Vimeo Oembed. So I think that if you use the full URL of the unlisted video everything should work as expected. Would that be good for you?