Rumors: At least you're spreading something besides your legs. You only got pregnant so your lazy ass could stay at home and claim benefits.
Walk away and watch out! If a person's conversation aims to tear another down, chances are they have already (and will soon be) trying to tear you down as well! Who cares what negative people say.