Apple collaborates with Nvidia to speed up token generation

Magnificent Seven titans Apple (NASDAQ:AAPL) and Nvidia (NASDAQ:NVDA) have collaborated to accelerate large language model inferencing for Nvidia GPUs through an approach known as Recurrent Drafter, or ReDrafter, the companies announced today.

ReDrafter uses a recurrent neural network, or RNN, draft model and “combines beam