I have encountered a few nicely designed foreign language fonts like for Devanagari, but doing a search for "beautiful foreign language typography designs" doesn't bring up anything. I know about Google Noto which is very nice, but I'm wondering if there's anything else out there, any other good resources.
You should search fonts for different writing systems. For ex. Devanagari is the native writing system for popular Indian and Himalayan languages. Learn at first something about writing systems and then search fonts for them. Start from this: https://en.wikipedia.org/wiki/List_of_writing_systems
BTW. Beautiful is an opinion which depend on context, tradition and personal attitude. What's beautiful for you, others cannot decide it.