If you have a custom field that uses the user list; only current users on a project are available. If that field needs to be set after the user has been removed from project, they are no longer available as a selection item.