Audrey Glenn Warren, 56, a retired congressional aide and a resident of the Washington area for most of her life, died of cancer Saturday at George Washington University Hospital.

Mrs. Warren, who lived in Clinton, was clerk of the roads subcommittee of the House Public Works Committee from 1964 until her retirement in 1970 after 20 years of service on Capitol Hill.

She began her career with Congress in 1950 as an aide to former Rep. Frank D. Smith (D-Miss.). She became his administrative assistant and was coauthor with him of a book, "Mississippians All." She also was Smith's research assistant while he was editing a five-volume history, "Conservation in the United States."

From 1960 until she became clerk of the roads committee, Mrs. Warren was an assistant to the late Rep. John Kluczynski (D-Ill.).

Mrs. Warren was born in Pittsburgh and grew up in Suitland. She was a graduate of Anacostia High School and attended Duke University.

Survivors include her husband, Jack D., of Clinton; two daughters, Martha Warren MacDonald of Waldorf and Mary Lynne Warren of Clinton; one son, Jack D. Jr., also of Clinton; one sister, June Clendening of Forestville, and one brother, Edwin Glenn of Charleston, W.Va.

The family suggests that expressions of sympathy be in the form of contributions to the Chesapeake Bay Foundation Inc., Prince George St., Annapolis, Md., or to the American Cancer Society.