Eliot Spitzer on Friday declined to call for Anthony Weiner to drop out of the New York mayor's race, saying voters will decide Weiner's fate.

The former New York governor, like Weiner, is attempting a political comeback this year in the New York municipal elections. Spitzer is running in the Democratic primary for comptroller, while Weiner is a Democratic candidate for mayor.

"Look: I think it's going to be for voters to decide. And obviously, I'm in a unique position on this," Spitzer said on HBO's "Real Time with Bill Maher." "There are some voters who say he actually has contributed. I'm agnostic on that. I have enough going on in my race for the comptroller's office, not to sort of weigh in on that. But I think -- the editorial pages have spoken, but I think the voters, at the end of the day will make that decision."

Both men have scandals to their names -- Spitzer resigned in 2008 amid a prostitution scandal -- Weiner in recent days has acknowledged that he continued to engage in online relationships with women who aren't his wife even after his resignation from Congress in 2011.

Another scandal-tarred former politician who appeared on the show with Spitzer, former Ohio Republican congressman Bob Ney, agreed. Ney resigned in 2006 amid an influence-peddling scandal; he resigned shortly after pleading guilty.

"Let the voters decide, and they'll make that call," Ney said.