Determine your boundaries and set them clearly, or watch them be quickly defied. You have every right to protect your space. But this means you absolutely must communicate, respectfully and thoroughly, to others what your comfort level is during this tender stage of healing and transition.
If you don't want visitors in recovery or in the early weeks at home, politely refuse them. If you don't like something someone does or says around you or your baby, tell them. If you perceive that someone is being intrusive, overbearing, or dismissive of your requests, be clear in expressing what is troubling you. Otherwise, they may have no idea that they are upsetting you. And if they did know but opted to defy your boundaries anyway, you have every right to firmly and clearly state what you will and will not tolerate going forward.