Wasps in the Attic

Early May I noticed a small wasp nest in the attic. We used to have wasps before, so I asked my mum about it. She said that it was from previously and all the wasps are gone. I asked my mum why they didn't get rid of and she just shrugged her shoulders. Okay I thought. Fast forward to late May, I had to go into the attic again and the nest had grew and I saw wasps flying around the lights. Since I absolutely hate flying bugs I complained to my mum and aunt about the problem and they said they would sort it. Fast forward again to today, I went into the attic to get a fan since the climate was increasing and we were all sweating like pigs. Guess what I find? The wasp nest; but bigger. You can see them flying around it and going inside and stuff. I immediately ran out. (or climbed out hastily, whichever way you want to put it) I complained to my mum again and she said it wasn't anything to worry about; "Just wait until autumn comes and they'll die out". I told her that the nest was right above her room and that they got in there through a crack above her window because you can constantly see them flying around there. She was unfazed by this and gave her usual; "If you leave them alone, they won't sting you". I find that even if you do leave them alone, they'll still fly near you and sting you if they get the chance. But fair enough point but I still keep thinking that it's going to keep growing and growing to the point where I won't be able to go into my attic.
Maybe I'm just being childish about this and it's not really a big problem...

TL;DR Wasp nest in attic, I'm scared shitless