Original Post
I struggle to fight against this trend of burning I/O and melting down the core. Have anyone ever care to quantify the ineffieciency of SerDeses, waste of energy, and introduced latencies? The massive compute topology went from meshes and lattices into these odd lonely islands connected with data highways. Writing scalable code for such architecture is not only a mess, and doesn't scale, but a waste of time and resources. Driver? Nvidia, of course, commoditizing V100 like if these were barrels of oil. We all know the oil companies still resist green energy change. And so Nvidia.