I was looking for this under the "settings" section but apparently, this can be set for each category/subcategory separately (which is great!) under the "Manage" section...
it can be reached:
Manage > Categories > (then from 3 dots click "Edit" for the category you want to edit)
default number is "10"