The Fairfax County Board of Supervisors voted yesterday to deny a permit to conduct bingo games and raffles to the Annandale Boys Club -- a group considered responsible for the state's bingo control law.

The board's action against the boys club, and a similar action against another charitable organization operating in the county, marked the first time the board has denied a bingo permit.

The action will prohibit the Boys Club and the Loyal Order of Moose, Arlington Lodge No. 1315, from conducting any bingo games or raffles after Dec. 31, the date their current bingo licenses expire.

The board cast its vote after citing a staff report that criticized the two organizations' bookkeeping and other alleged practices.

The board said, however, that it may reconsider its action at a Feb. 8 public hearing if the two organizations improve the bookkeeping and the filing procedures that led to yesterday's permit denial.

Officials of the Moose lodge could not be reached for comment yesterday.

The boys club lawyer, Hugh Shafer , called the board's decision "a typical bureaucratic snafu." He said that the differences between the organization and the county over the way financial information is kept stems from a lack of communications.

"We want to get along with the county, and our first goal is to meet any reasonable requirements they have," Shafer said.

The county's staff report said that the boys club, which had gross receipts of $880,000 in 1980, failed to keep adequate financial records, illegally posted signs advertising the games and served alcoholic beverages. Shafer also denied these allegations.

The Moose Lodge, which runs a bingo game on Scoville Street near Baileys Cross Roads, was cited in the county report for filing financial reports as late as 17 months after they were due. The report also said the lodge kept a higher percentage of money than allowed.

Richard A. King, deputy county executive for public safety, said the main problem with the boys club bookkeeping is that the group failed to keep a record of bingo prize winners, their addresses and the amount of their winnings, as required by county law.

"There was no way to determine where all the money went or what their net receipts was," King said.

Four years ago, the Annandale Boys Club came under investigation by the Fairfax County commonwealth's attorney's office for allegedly making illegal payments to bingo workers. State law prohibits such payments.

"It was really difficult to tell what the money was being used for," said Fairfax Commonwealth's Attorney Robert F. Horan Jr., who headed the 1977 county inquiry.

No officials of the club were prosecuted as a result of the investigation but the financial reporting requirements of Virginia's bingo law were made more stringent.

Complaints by legislators that the club spent relatively little of its bingo proceeds on its youth soccer program prompted enactment of the bingo control law in the mid-1970s.