If a video has chapters, you will see small blue circles located in the video's play bar which delineate them. Hovering your cursor over these circles will preview the title of that chapter, and clicking on the circle will begin playing the video from that point.

Note: Not all videos have chapters, although most do