I think it depends on the degree of precision you require for what you are doing at hand. If you're doing typography or designing a logo, it can be very beneficial to use points. I also believe it's used more often in magazine and newsprint where it's important or required to set certain spacing for letters, columns, margins, etc. in more precise and smaller units of measurement.
If you're doing more general printing (posters, brochures, postcards, business cards, etc), you're not going to see many printers discuss document setups in terms of "points" or "picas." They'll talk to you in inches. They'll give you templates setup in inches.
There's no wrong way to go on about it, though. If you choose to not work in inches, just be prepared to convert to inches in certain situations though.