Sites with large userbases should turn off 'Allow individual user permissions' in the configuration. You can also change this setting manually by editing /administrator/components/com_docman/docman.config.php and changing this line:
var $individual_perm = '1';
to:
var $individual_perm = '0';