A member of Britain's House of Lords has quit the Labour Party days before he was due to face a hearing over allegations he made anti-Semitic remarks in a television interview.

Nazir Ahmed was suspended from the Labour Party in March following a report that he blamed a Jewish conspiracy for his 2009 prison sentence for dangerous driving.

Ahmed had insisted he did not recall making the alleged comments to an Urdu-language broadcaster in Pakistan, but was due to appear before Labour's National Executive Committee on Wednesday about the accusations.

His lawyer Stephen Smith said he did not think Ahmed would have received a "fair trial" from the Labour panel, and the party confirmed Monday that Ahmed had resigned. He remains a member of the House of Lords.