OpenAI does this all the time. For example, all the models they offer for free users (like o1-mini or 3.5-turbo) are distilled models. The DeepSeek R1 is impressive because it’s not a distilled model in the technical sense, but still has the cost benefits of distillation.
OpenAI does this all the time. For example, all the models they offer for free users (like o1-mini or 3.5-turbo) are distilled models. The DeepSeek R1 is impressive because it’s not a distilled model in the technical sense, but still has the cost benefits of distillation.