Not out-of-the-box. You would have to do some customization work to make that possible.
Here is an old screencast that shows a light Explorer customization that detects when a video has been moved out of Alfresco to another server (Kaltura, in this case) and switches the preview appropriately to embed a media player that streams the video from the third-party server.
