Your question could be positive or negative, and "speak to soon" covers both. Speak too soon is usually taken to mean the OPPOSITE of expectation, like you describe in your example. You tell someone you have no work - oops, you spoke to soon and now you have too much work, for example. More @Wikipedia
Hover over any link to get a description of the article. Please note that search keywords are sometimes hidden within the full article and don't appear in the description or title.