Water the soil around the stumps really well, then get a straight rock bar (basically a long, heavy steel rod, can get them at the box stores) and start stabbing it under the surface roots. Once you get it under a root, give the rod a good push upward - the leverage should pull the root out. More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.