It’s tempting to imagine Nicholson Baker’s agent, upon reading the manuscript of “House of Holes,” nervously saying, “It’s very funny and original, Nick, but how are they going to review it when they’ll barely be allowed to quote from it?” This consistently raunchy novel is, among other things, a test for critics — and for readers.