Investigative journalist Philip Weiss' "The Affairs of Men," his treatise on the difficulty that many middle-aged men (and women, though they're mostly ignored) like hooker connoisseur Eliot Spitzer have with maintaining monogamy in marriage, has thus far generated 314 comments on the New York magazine website, the vast majority of which take Weiss to task for intellectualizing a problem that could more simply be described as "Horny Dude Syndrome." Weiss appeared on Colbert Report last night to defend his position, but pretty much ended up being called a scumbag by Colbert. "Maybe we shouldn't be shaming all these people who seem to be not able to control themselves every once in a while," Weiss argued after Colbert asked him about his claim that the hunger for sexual variety is an "irresistible impulse." At the end of the interview, Colbert asks Weiss the question most women who read the story probably have for him: "Isn't there any chance that this is a sophisticated rationalization for being a complete asshole?" Weiss chuckled but was clearly agitated, and seemed ready to snap at Colbert before cutting himself off mid-retort. Full clip above.