By default, when you delete an attachment, this will delete all versions of the attachment. To do that, you need the 'Delete Attachments' permission. See Space permissions.
If you want to delete a specific version of an attachment, you need to be a space administrator.