If you are planning a visit to Japan, short or long term, and intend to drive, then yes you will need an international driving permit. Even if you don't plan to, if you just want to be able to drive should the chance arise, you will need it and the low cost versus the convenience means it's worth getting.