Each time I had to deal with designing a hole in which something had to be inserted I was struggling about how much tolerance I needed to use for the grip I wanted to give to the whole thing.

The solution is this board where all variations are available. Each row represents a millimeter in the diameter of an hole and each column an increment in the order of a decimal of millimeter on the base diameter of that row, with the first column on the left having no increment.

I understand that the first row at the bottom (from 0.0mm to 0.9mm) is mostly unusable, but it's a good reference to understand the capabilities of your printer and the effects of the expansion of material.

This can be printed multicolor by both using an AMS, a filament change at layer or even a pause at layer; or in single color where the numbers will still be visible since they're above the surface.