How can I change the font or font size for all of the text labels in my plot?

Use the Select All command to select the labels and then use the submenus available from the Text tool on the toolbox to change the font and/or font size.

To set the defaults for the text labels, use the Text Options command (Plot menu).