In an action, related to the Iranian crisis, the State Department yesterday revoked the U.S. passport of CIA critic Phillip Agee on grounds that he might otherwise cause "serious damage to U.S national security and foreign policy."

The State Department took the unusal action after receiving reports that Agee might be invited by Iranian authorities to participate in an "international tribunal" to judge American actions in Iran and that he might be asked by student militants to help develop their case that American diplomats are acting as spies.

Speaking by telphone from his current home, in Hamburg, Germany, Agee said he has been invited to Tehran by the hostage-takers at the U.S. Embassy there He said, however, that he has refused to become involved in identifying Central Intelligence Agency personnel or analyzing files at the embassy until all the U.S. hostages are released.

Agee also said he has proposed to Iranian authorities and the student militants that complete CIA files on the agency's operations in Iran since, 1950 be exchanged for the 50 American hostages. His proposal has not been accepted by any part so far, he added.

The former CIA official, who has published the names and activities of many of his former colleagues, called the revocation of his passport "illegal" and said he will take legal counteraction. State Department spokesman David Passage said Agee has been informed of his right to a hearing, but that any effort to use the revoked passport now would be a violation of U.S. law.