Leaders of the Freedom Caucus met with House Speaker Paul D. Ryan (R-Wis.) on Wednesday to candidly express their frustrations with his leadership and his handling of the Republican legislative agenda, according to two people familiar with the discussion.

The exchange comes as former White House chief strategist Stephen K. Bannon is having conversations with hard-line GOP lawmakers about how they should exert greater influence in the fall’s political fights and pressure congressional Republican leaders.

Ryan heard out three members of the influential conservative group: Reps. Mark Meadows (R-N.C.), Jim Jordan (R-Ohio), and Scott Perry (R-Pa.), the people said. Meadows is the chairman of the Freedom Caucus, which counts about three dozen members, and he has been a friend and ally of Bannon for years.

While the trio personally like Ryan, who remains popular throughout the House, one of the people familiar with the discussion said the three members were “frank” about their mounting concerns and warned Ryan that they and others in the House Republican conference could desert him in the coming months if the leadership fails to enact conservative policies.

Several people close to Bannon and Meadows said on Wednesday that the two men, who met on Monday on Capitol Hill, have begun to discuss who could replace Ryan as speaker, should conservatives rebel against him. But they stressed that those discussions remain speculative and informal, with no plan yet for action.

House Speaker Paul D. Ryan (R-Wis.) said he shares President Trump's frustration with Freedom Caucus members who blocked the Republican health-care bill. (Reuters)

Meadows led the effort in 2015 to unseat then speaker John A. Boehner (R-Ohio). Boehner stepped down months later.

Wednesday’s meeting with Ryan, which took place at the Capitol, is the latest example of the agitation within the House Freedom Caucus about the speaker’s approach to pending matters such as extending the federal borrowing limit, passing a federal budget, and crafting tax-reform legislation.

Allies of Ryan shrugged off the Freedom Caucus huddle as just another example of how he is listening to his members and engaging with his critics on strategy and policy, which they said is a routine practice for him.

One Republican lawmaker who is close to Ryan said upon hearing of the meeting that “those guys are always unhappy. God bless Paul for sitting there and listening to them.”

Ashlee Strong, Ryan’s spokeswoman, said in a statement that, “Every single day the speaker talks to members about their concerns, ideas, and anything else they’d like to discuss. Being accessible to members is part of the job and one he makes a priority.”

A spokesperson for the House Freedom Caucus declined to comment.

But a conservative lawmaker who is close to the Freedom Caucus did provide a statement to The Washington Post.

“I’ve talked to countless Americans who are fed up with Congress’s inability to get anything done. They see Mitch McConnell and Speaker Ryan as the biggest impediments to enacting President Trump’s agenda,” wrote the lawmaker, who requested anonymity due to sensitivity about directly speaking out against Ryan. “If things don’t change — and fast — the American people will demand new leadership in Congress.”