If I read that right, the terminal invocation of ACE used just 1.4GB. That is the default limit. If you want ace to use more you have to tell it to, with —max-chart-megabytes=99000 and —max-unpack-megabytes=100000, or something similar.
If you weren’t including those in the -a part of your art invocation then I am surprised that you reached 102GB somehow. What log said that?
The fact that there are loopy rules might indeed be what is leading to the surprising frozen edge still in the chart at unpack time. These are expected to be packed into edged that theoretically must be found further down the search, but when loops are present ACE cuts the search to prevent infinite time and memory usage. I’m not sure there’s much to do about that, but it does look like there’s a formatting issue with that error message that lead to art not processing the item correctly, so that at least goes on the todo list!