James H. Harvey, 52, a former executive director of the Metropolitan Washington Housing and Planning Association who later became an associate executive secretary of the American Friends Service Committee in Philadelphia, died May 14 in a hospital in Philadelphia of histoplasmosis, an infectious disorder that affects the lungs. He lived in Edgewater Park, N.J.

Mr. Harvey moved to the Washington area in 1963 and went to work for the AFSC's Metropolitan Washington Housing Program. He returned to Philadelphia in 1966 and became a national representative of the organization's housing and urban affairs program.

In 1969, he came back to Washington and joined what became the Housing and Planning Association, where he frequently spoke out against racial discrimination in housing. He left the association in 1983 and moved back to Philadelphia, where he worked for the AFSC until his death.

Mr. Harvey was born in Moorestown, N.J. He attended Albany State College in Georgia and Temple University in Philadelphia. He served in the Army from 1955 to 1958, then worked briefly for the Army Department as a civilian before moving to Washington.

He was a past vice president of the National Association of Intergroup Relations Officials and a member of the National Committee Against Discrimination in Housing.

In 1976, Mr. Harvey received an award for outstanding service from the City Wide Citizens Assembly in Washington. He also received a meritorious service award from the Arlington County Fair Housing Board.

Survivors include his wife, Marie Gray Harvey of Edgewater Park; three children, Valerie Shockey of Warren, Ohio, Lisa Harvey of Edgewater Park, and Keith, of Boston; two brothers, William E. Harvey of Moorestown and B. Clarence Harvey of Mt. Laurel, N.J.; three sisters, Roslyn Harvey and Laurel Frienzley of Mentor, Ohio, and Evelyn Bailey of Edgewater Park, and three grandchildren.