I wouldn’t worry about using NB here at all, honestly.
To deal with class imbalance, check out this thread (and the threads linked within it) that give you several options: