President Carter is expected to announce today that the United States will pull out of the International Labor Organization, a specialized United Nations agency that has come increasingly under Soviet and Third World domination in recent years.

Administration sources said yesterday that Carter - buffeted by conflicting advice from his Cabinet - has decided not to extent the Nov. 5 deadline for the government's threatened withdrawal from the 58-year-old international group.

Former Secretary of State Henry A. Kissinger, angered at the ILO granting of observer status to the Palestine Liberation Organization and at other political actions by the agency, served notice in 1975 that the United States would pull out in two years if the ILO did not mend its ways.

THe action had the backing of the AFL-CIO and U.S. Chamber of Commerce, which serve as labor and industry representatives of the country in the tripartite ILO and has also been threatening to withdraw - even if the government didn't.

But at least 30 foreign governments with friendly relations with the United States - and assorted individuals including Pope Paul VI - lobbied heavily to keep the United States from quitting the organization it helped found nearly 60 years ago as part of the League of Nations.

Carter reiterated Kissinger's warning earler this year, and set up a Cabinet-level committee to help him decide whether to pull out or stay.

The advisers split, with Secretary of State Cyrus R. Vance and National Security Affairs Adviser Zbigniew Brzezinski advocating continued membership and Labor Secretary Ray Marshall opposing it. Commerce Secretary Juanita M. Kreps once favored quitting but was described as closer to a middle-ground position after the committee's last meeting, which resulted in two sets of recommendations to the White House.

Vance and Brzezinski reportedly favored continued membership for another year to give the ILO more time to meet American objections, a course opposed by pullout advocates and some of those who favored continued membership.

The United States currently pays about $20 million a year to support the ILO, a quarter of the agency's annual budget.

Both the AFL-CIO and the Chamber of Commerce have until next spring to decide whether to withdraw but are expected to follow the government's example, having argued this position during the Cabinet deliberations.

A source said Carter made up his mind over the last couple of days and began disclosing his decision yesterday to a select few people. It was not immediately known whether there would be any qualifiers to the decision. One source said the announcement would involve a "very intricate" explanation.

Carter met yesterday at the White House with George Meany and the federation's secretary-treasurer, Lane Kirkland, but neither of them had any comment after the meeting.