You can use the apostrophe immediately after the s of minutes but need not add an extra s. That would be incorrect. "Ten minutes' walk" is fine. "Ten minutes's walk" is incorrect. Because it is a plural, adding another "s" is not correct. So the answer is: several minutes' walk to the building... More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.