Chirrut Imwe was a Guardian of the Temple of the Whills, so he was a devotee of the religion of the Force and it would make sense that he would recite their mantras. Baze specifically points out that Chirrut is still devoted to the religion (in contrast to Baze's own apparently jaded opinion of it). More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.