Everyone else's advice on licenses is spot on...check with a small business development center (SBDC), SCORE, or the Small business administration for your area. They should be able to walk you through that process.
As far as insurance and bonds, if you go without at first, it is a risk. But...