That is one small part of the way it affects men, but again, if it affects the economy and working conditions in general, it affects everybody. Millennials and gen Z are largely choosing not to reproduce, and this decision allows the state to override that choice.
It remains a human right and a necessity in any developed country. Besides, banning it won't mean the end of abortions, it'll only mean the end of safe abortions. I suppose that's the point though: to make women who don't want to go into poverty for the sake of the economy suffer.