Nvidia won the AI training race, but inference is still anyone's game

When it's all abstracted by an API endpoint, do you even care what's behind the curtain?
Comment With the exception of custom cloud silicon, like Google's TPUs or Amazon's Trainium ASICs, the vast majority of AI training clusters being built today are powered by Nvidia GPUs. But while Nvidia may have won the AI training battle, the inference fight is far from decided.…