Visit the video edit page and select the Video Tab.

Then select multiple videos to play in the drop down forms.

Here is a video describing the why and how to use a playlist