To delete an existing Link Category checkmark the box to the left hand side and select the red trashcan icon:
