This reminds me of the financial crisis where there was a similar issue that the financial sector did not understand their financial dealings. Each organisation understood their part - what they were selling and buying, but not the whole picture. At some point, I assume, we will have AI that can understand such a complex system, but until then it seems to me, we should not be replying on systems we can't understand.