The torch might get used to it. My clowns lived in zoa's for 2 years and now host in a mushroom patch. In the beginning both the zoa's and mushrooms where staying retracted all the time, obviously irritated. The clowns also where rough for the first bit, they where nearly black from the stings.
Now, I still have 2 happy clowns with very few black spots. After a month the zoa's actually got used to the clowns and no longer retracted when the clowns went inside. Now it's the same with the mushrooms, they've gotten used to the clowns.
I'd say let them get used to it, do an internet search for clowns actually killing torch/hammer/frogspawn/duncan's and you'll see it rarely happens. It just takes time for things to adjust. here's another thread on it:
Not a RC link...