This article is part of The D.C. Brief, TIME’s politics newsletter. Sign up here to get stories like this sent to your inbox. Roughly a year before the 2004 campaign hit its frenzied stride, former House Speaker Newt Gingrich huddled in a private room at a French restaurant just a few blocks from the White House.