I have both blue and horsetail rush in the pond. I have blue rush in the margins - it's a bit of a spreader, but by seed more than plant growth I find. I cut off all the seed heads to try to keep it from showing up other places. And I've learned to recognize it when it starts growing and pull it out before it gets a chance to get established.
And I would never trust horsetail rush anywhere that it could spread - it's so invasive. I have some planted in the pool at the top of our waterfall and keep a careful eye on it. Every other year I yank the whole thing out and keep a small piece of it and let it start over. I've seen videos of entire ponds taken over by the stuff. And it will run up on land, too.
Like
@addy1 said I find rushes much harder to get rid of, but I do love the look of them. I have another one that I like - it's kind of wavy and variegated. Not sure what it's called. I'll see if I can find the name!