What they didn't tell you about baby-wearing:
#2 - You cannot do everything while wearing your baby.  
After four Blossoms, I've mastered nursing while wearing baby.  I use
the bathroom while wearing baby.  I eat while wearing baby.  I've
given another Blossom a necessary piggy back ride while wearing baby. 
I've climbed ladders while wearing baby.  (I don't recommend it, but we
managed to escape unharmed.)  There ARE some things you can't do - things
like weeding the garden, looking in the far recesses of a lower back corner
cupboard, deep-frying food etc.  Realize your limitations and find some
other work to do.