Several lawmakers from Pakistan Prime Minister Imran Khan’s ruling party withdrew their support for him on Thursday ahead of a no-confidence vote, stoking more uncertainty over whether the former cricketer can hang on to power.

The development came a day after a key ally said Khan was in danger of losing his coalition partners, flagging a “tilt” by his partners in government towards their opponents.

The Opposition blames Khan for mismanaging the country, economy and foreign policy. No Pakistani Prime Minister has ever completed his term in office.

The threat of political turmoil in the nuclear-armed nation is growing as the Opposition looks to oust Khan in a vote that could come as soon as this month after a no-confidence motion was unveiled in parliament last week.

“We have differences with the Prime Minister,” one of his lawmakers, Raja Riaz, told local Geo News TV. “We will vote according to our conscience,” he said, claiming there were more than 20 defectors. Three more lawmakers endorsed Riaz and TV showed recorded footage of several ruling party members at an office of the opposition Pakistan People’s Party (PPP) in Islamabad.

“We are clear that we will not get into any blackmailing to save our government,” information minister Fawad Chaudhry told a news conference. “We reject this culture of turncoats.”

Without the coalition partners and the dissidents, Khan’s party, which has 155 seats in the lower house, would fall short of the 172 needed to retain power. The joint Opposition consists of major parties such as the Pakistan Muslim League-Nawaz and the PPP.