Hard to tell without a pic or description of the bug. I would do what I call a wash. Take the plant and rinse it completely with luke warm water. This can be difficult to do though if it is sensitive to repot right now. You would have to wash and then resoil to eliminate the possibility of insects breeding in the soil.