From experience, superglue doesn't work well with rubbery or elastic materials, because superglue isn't flexible while the rubber is, so by moving it around the superglue can break the rubber in pieces.
I'd advise using a glue that stays elastic when dried (e.g. universal rubber glue by Loctite).