It was an off-hand remark by another mum, but one that gave me plenty of guilt and changed my life forever.