Is there a way to configure the password length that is automatically generated?
The built in password generator is the standard one provided by Microsoft. I'm not sure what it uses to determine the max length of the password generated, but the min length is set through the membership provider options in your web.config/machine.config.