Absolutely, I totally agree! Everyone should have a limit & I'm totally up to mine. The eight indoor bunnies I live with came from all over the place (rescues, found, surrendered) but with a well oiled routine, everything has been falling into place (fortunately!).
The last bunny I found on the side of the road (injured, wet & scared) and she happened to be pregnant & within four days at our place had seven little ones!! We doubled our numbers overnight and since then we've had one of the babies with EC & another with a stomach blockage. Vet bills are creeping up on us constantly so I would totally recommend anyone thinking of taking on so many animals to realise there are huge costs involved (BTW - our little Lily with EC has made a full recovery as has her brother Sammy & his tummy problem - they were the smallest of the litter so we figure they may be weaker than the rest).
I would love to see some of my guys romping around outdoors but without somewhere safe cordoned off for them to run, we'd lose them in a second (our garden's a bit too large & we don't have good fences). I did used to take our first bunny out for a run on a harness but she doesn't like to be picked up so I think she'd be more scared of leaving the house now than staying indoors.