Dr. Robert J. Drake, 96, a retired physician with the Veterans Administration who was an infantry officer in World War I and a medical officer in World War II, died Tuesday at his home in McLean after a stroke.

Dr. Drake, who was born in Severance, Kan., graduated from the University of Nebraska. He was commissioned in the Army in World War I. He earned his medical degree at Creighton University in Omaha, Neb.

He was in private practice in Kansas and Nebraska until 1941, when he joined the Veterans Adminsitration in Northport, N.Y. During World War II, he was an officer in the Army Medical Corps. He later worked for the VA in Augusta, Ga., and Nashville, Tenn. He moved to McLean to be near his sons following his retirement from the government in 1967.

Dr. Drake was a Mason and a Shriner and a member of the Wesley United Methodist Church in Chevy Chase.

His wife, the former Helen Lucille Young, died in 1967.

Survivors include two sons, James E. and Jack, both of McLean, eight grandchildren and two great-grandchildren.

The family suggests that expressions of sympathy be in the form of contributions to the Wesley United Methodist Church, Chevy Chase, Md.