You can remove breakpoints by dragging them from the gutter. To configure this option, open settings by pressing &shortcut:ShowSettings;, go to Build, Execution, Deployment | Debugger, and select Drag to the editor or click with middle mouse button.

When you click a breakpoint, you toggle the breakpoint status (enabled or disabled).