Generative AI training is a relatively new workload that behaves quite differently to conventional enterprise IT. Infrastructure used for training is either fully engaged or completely idle — and cannot be repurposed for any task other than AI inference. The specialist hardware is costly and needs to be used effectively to justify the expense.
It is not an interactive workload, so the latency of external networks is irrelevant; training can be hosted in remote locations, far away from the model's eventual end-users.
Apply for a four-week evaluation of Uptime Intelligence; the leading source of research, insight and data-driven analysis focused on digital infrastructure.
Already have access? Log in here