No Lust Tonight by Don Elliott aka Robert Silverberg (Midnight Reader #429, 1962)

This one reads more like a Loren Beauchamp than a Don Elliott, if that is even possible, being both are Silverberg, but the Beauchamps always seemed to have a bit of a darker overtone than the Elliotts,

This one opens with a burglary in the house of the Lamsons, a fairly well to do couple. The burglar ties the husband up and forces him to watch the rape of his wife, Moira. But there is something odd: the burglar resembles Lamson in body sizem hair, etc., and it almsot seems like Moira knows who her rapist is…she does go frigid and starts to see a psychiarist…and the shrink violates all codes of medical ethics by telling the husband what the wife says in the sessions. (Reminds me of soemthing from the TV show Mad Men where the main guy pays a shrink to make his wife believe there is something wrong with her.)

The shrink also suspects Moira knows her rapist, that he is a man from her past, a guy who “got away” and she only married Lamson because he resembles this guy. This turns out to be true,  the guy is an ex-boxer turned small time crook and pimp of Greenwich Village bar hookers. Moira had dated him but would not sleep with him unless they married, so he jilted her.

Lamson sets the guy up for a fall and…

You can read the book for what happens. Not a bad read, as always with Silverberg,