Members of both parties want the three-term congressman, who exchanged racy texts with an aide who later died, to step down. He has denied an affair.