The Rev. Grayson J. Kelsh, 57, who was pastor of Alleyne AME Zion Church in Alexandria and shipping manager of Harrison Bros. plumbing supplies firm in Rockville, died of congestive heart failure Friday at the Veterans Administration Hospital in Washington.

Mr. Kelsh had served as pastor of the church for the last six years. Earlier, he was pastor of Brentwood Chapel AME Zion Church in Brentwood for 14 years.

Before joining Harrison Bros. in 1967, he had been a warehouse manager for 17 years.

Mr. Kelsh was born in Philipsburg, Pa. He attended Howard and American universities, and served in the Army during World War II.

Mr. Kelsh was a former member and associate minister of Trinity AME Zion Church in Washington. He belonged to the Ministers Alliance Association and the Black Clergy Associations of Prince George's County and Alexandria.

He and his wife, the former Winifred Scott, who had eloped with him 40 years ago, recently renewed their wedding vows in a ceremony at Trinity AME that included their five dauthters as maids of honor, their grandchildren as ring bearer and flower girl, and their foster son, who escorted them.

Besides his wife, of Washington, survivors include their daughters, Nancy P. K. Moss, Deborah G., Kathy G., Jay G., and Gina M., all of Washington; a foster son, Ted J. Williams, of Kansas City, Mo.; his mother, Esther Pollack Kelsh, of Portsmouth, Va; two sisters, Margarite Doleman of Hagerstown, Md., and Sylvia Grant of New York City, and two grandchildren.