What you're seeing is entirely normal presentation Natasha. The Begin button remains regardless whether you start each lesson by clicking on the Next Lesson hotlink which appears in the completed lesson video window or clicking on the Begin button.

Even when the green progress bar indicates100% complete for each individual lesson, including throughout the entire chapter, the selectable Begin button will remain on the right hand side in perpetuity. (PC/Win10).