To delete points use Remove point annotation command. A dialog will appear with a list of points in the current image.

Each point has a unique number that is identifying him in the project.

In order to remove all points in an image, use Remove all point annotations from the Regression menu.

TIP:  If you wish to remove points in several images, simply select the images (holding shift for continuous selection or Ctrl for arbitrary selection) and use the same command.