Well, this isnt at all a simple problem. The manual way which takes considerably less time than a hour, which would also have done the first step for free, is as follows:
Open in inkscape or illustrator
For each area:
select text and polygon, and group it (hit ctrl+g; same in all apps)
Text and polygon is not next to eachother in a shared group.