Those knobs are near impossible to remove without ruining them. I usually unbolt the entire lever and leave the knobs on when possible. If that isn't possible, plan on buying new knobs. You might try using a heat gun on the knobs to soften and expand them, but it seems that after they come off, they won't stay tight after you put them back on.
