I never heard it sound like a lemon.

It's more Lam-'nt with the emphasis on the first syllable and is normally said quickly.

Of course we once had a Tory Chancellor of the Exchequer who pronounced it La Mont as in Danny La Rue