For all intents and purposes, the constructions "xxx was impressed with yyy" and "xxx was impressed by yyy" are interchangeable. With/by is not an uncommon choice of preposition. You can say for example "pay by cash" or "pay with cash", "activated by electricity" or "activated with electricity". More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.