I played with mine a bit more and got down to 0.04 mm, but my micrometer only has a resolution of 0.01 so not sure how accurate that is.
On the other hand I found my plane sole isn't anywhere near flat, so I threw it on belt sander and made it a bit better, but it's just too much pain to grind so I'll live with it.