Harvey Schiller, the new executive director of the United States Olympic Committee, is considering whether to step down after just two weeks in the position, and may try to return to his previous job as commissioner of the Southeastern Conference, SEC and USOC sources said yesterday.

Schiller, who was named to replace Gen. George Miller on Oct. 24 and took up his post on Jan. 4, will decide within the next 24 hours whether to remain with the organization, a USOC source said. The USOC is in the midst of final efforts for the Winter Games in Calgary, which will begin Feb. 13, and Schiller's decision could complicate preparations.

SEC sources said Schiller has contacted presidents of conference universities over the past few days about the possibility of returning to the prominent athletic conference. He served as SEC commissioner for 15 months, departing after the New Year's Day football bowl games.

The 10-member conference is run by the school presidents and chancellors, who would have to vote on any such proposal, and they have already interviewed a number of candidates to replace Schiller.

"He's calling all the presidents in the league and wanting his job back," one SEC athletic director said.

Schiller was scheduled to fly today from New York to Geneva, Switzerland, where he was to meet with USOC President Robert Helmick on preparations for the Winter Olympics, but canceled his trip while he contemplated his decision, sources said.

In a brief, noncommittal interview yesterday, Schiller acknowledged he still has mixed feelings about his departure from intercollegiate athletics, but said he currently was employed by the USOC.

"Obviously, it was a tough decision," he said. "I've been in higher education and intercollegiate athletics a long time . . . I'm still with the Olympic Committee."

University of Kentucky President Dr. David Roselle said he spoke with Schiller two days ago about Schiller's mixed feelings concerning the USOC. Roselle said he did not know how a return by Schiller would be received by the other presidents, but that the former commissioner was well-liked and respected.

"I talked to him two days ago and, at that time, there was nothing definite about his feelings," Roselle said. "We talked about the status of the SEC and his status. But there was nothing definite.

"I think the sense is that Harvey did a very good job while he was here, and that they {the presidents} would want to consider the possibility of his returning. But that doesn't mean they could get everything together."

USOC officials could not be reached for comment. However, the loss of Schiller would be a considerable blow to the organization, which suffered one abrupt resignation in August when Miller chose to depart. That move left the USOC leaderless during important short- and long-range preparations for the Olympics. On Monday in Atlanta, the USOC executive board authorized Schiller to begin executing contracts for new and improved Olympic training center facilities in Lake Placid, N.Y.

Schiller, 48, who has an array of credentials in both intercollegiate athletics and Olympic areas, was a unanimous choice to take over the $150,000-a-year job as USOC executive director. He was a runner-up in the recent search for an NCAA executive director before Dick Schultz was named. He served for the previous five years as a director of U.S. Amateur Boxing Federation and is a longtime Olympic volunteer.

He also is a retired Air Force colonel, decorated combat pilot and was a chemistry professor at the Air Force Academy before becoming SEC commissioner in September 1986.