Windows, MacOS and most Linux distros come with a pretty wide variety of fonts. The ones shipped with the operating systems tend to be of pretty good quality. One gotcha is that older imagesetting equipment may not play nicely with truetype or opentype fonts, and not many Type 1 fonts come with Windows these days. However to run into this sort of compatibility issue you're looking at kit going back to the first half of the 1990s or before.
One good way to get a cheap set of decent fonts is to buy an older version of Corel Draw off Ebay, even back to really old ones like version 7 (I got a copy for NZD40 once). This comes with something like 1,000 Bitstream fonts in Type 1 and Truetype.