James Whitley Fosburgh, 67, an artist, art historian and collector who painted the late president John F. Kennedy's portrait and advised on art acquisitions for the White House, died Sunday in a New York hospital. He had suffered from cancer.

Mr. Fosburgh was named by President Kennedy to head a committee to collect American art for the White House. Under the late president Lyndon Johnson, he was a member of the Committee for the Preservation of the White House.

His painting s are in the collections of the Hirshhorn Gallery in Washington, the Metropolitan Museum of Art in New York, the Philadelphia Museum of Art, and Yale and Harvard universities.

Mr. Fosburgh was born in New York City and graduated from Yale. He later studied art at the University of Rome and then returned to Yale to earn a master's degree in art history. For many years he gave Sunday lectures on art history at the Frick Collection in New York.

He served as a glider pilot in the Army during World War II and saw action with the 101st Airborne Division in Europe.

In 1953, Mr. Fosburgh married Mary Astor Cushing. They became noted for their art collection.

Besides his wife, of the home in New York, survivors include a sister, Mrs. Evan Wilson, of Washingt on.