You should only upgrade if you don't have a *hax entry point. Basically if you don't have a way to get into Homebrew. But if you did upgrade, you should make sure there isn't a 10.4 Version out yet. Nintendo could have it released any moment and you don't want to ruin your chances with an update.