Does the user get created properly and emails go out?
By default it should return the user to the current page. You can modify the web part settings to redirect to a different page though. If you're getting a login page, that would tell me that whatever page you're actually getting directed to is either not available
anonymous, or contains content (image, etc..) that's not available anonymously.