The components of a rank-2 tensor can be written in a matrix. The tensor is not that matrix, because different types of tensors can correspond to the same matrix. The differences between those tensor types are uncovered by the basis transformations (hence the physicist's definition: "A tensor is what transforms like a tensor"). More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.