Are there any options to increase the maximum memory limit that the software can use? There might be a setting or there could be a registry entry you could edit. You might have to ask the software owner.

I'm only saying this because even with gigabytes of RAM operating systems still expect programs to politely ask for a certain amount and if they very suddenly try to take more than their allocation, the system panics because it thinks its under attack from malware. CPUs and OSs have this built in now and they'll just kill the process or processes that flood over into unallocated RAM. Sometimes the whole system might just 'stop' to prevent any damage, or sometimes the program will just close. Segmentation faults may be reported too.