Their groaning is intentional as it plants the seed that he's the unreasonable one even though he's the one that is making, probably, the most sense.