Will my milk supply increase?

Yes, being able to nurse your baby will help your supply especially if you're nursing on demand ( frequently nursing your baby signals to your body that he needs more milk) . also babies are much more effective at emptying your then a pump is. In the meantime continue pumping to maintain your supply. Best wishes