You can delete a duplicate, but the best approach is to merge duplicates so that related records get moved to the record that remains.