You can say on second thoughts or on second thought when you suddenly change your mind about something that you are saying or something that you have decided to do. More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.