If you're talking about the bomb bag, you keep it. It's only the bombs that disappear but if you have the bag they'll occasionally drop from enemies and bushes.
As chartube12 said, you can also loot the silver rupee chest in termina on every "reset", play the lottery once you found the numbers...