With point of contact, if you have more than one, it is 'points' that you have multiples of, so the plural is points of contact. On top of this, in this use 'contact' is uncountable and cannot be plural. Yet you found hits for point of contacts on Google. More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.