You have the option of either changing their access level (i.e. no longer be able to make purchases, but can still make account changes), or remove them all together. To remove them, click on the “Remove” link underneather the Save button, and then confirm your action on the next window.