There was a guy in a FB group someday that used an cellphone battery instead, with a piece of eraser to hold it in place , said that worked even better than actuall GBAsp battery
If you wanna try it, just check the polarity , the voltage and amperage of the new battery if matches the GBAsp one