Restricted Access for Site Owners

Is it possible to restrict access to Site owners. What I want is that the site owner should be able add/modify/remove users but he should not be able to do site configuration.
Let me know if that can be done.
Not at the moment. Currently you need to be a site collection administrator to add/modify/remove users. There are plans to do this in a future version:

https://sharepoint2013fba.codeplex.com/workitem/25