Some themes show a side panel on the right-hand side of new pages.

Example: 

To remove the sidebar from a Page, change the Template setting in ‘Page Attributes’ to ‘Full-width’.

(Note not all themes will show a side-bar by default)