Visit the video edit page and select the Video tab.

Then select the desired frame in the video player and select the thumbnail by clicking the button.

Here is a video with details for how to set custom thumbnails