Shop members added before payment

I'm finding that when a user fills out their details to complete a purchase they are added as a member before they have made payment. This is meaning that there can be a lot of members added who actually haven't made any purchases...for example if they start to check out then change their mind. How can I make this happen after the payment is successful?