My RAM usage (from Yuzu) is between 5 and 7GB during my XC3 games. Have you set some Virtual Memory on your Windows? if not, you should, it prevents lot of crashes with Yuzu.
https://www.windowscentral.com/how-change-virtual-memory-size-windows-10#change_virtual_memory_settings_windows10...