News

Tiny but mighty: The Phi-3 small language models with big potential

Date: 25-Apr-2024

|

Source: https://news.microsoft.com/

Tiny but mighty: The Phi-3 small language models with big potential

Sometimes the best way to solve a complex problem is to take a page from a children’s book. That’s the lesson Microsoft researchers learned by figuring out how to pack more punch into a much smaller package.

Last year, after spending his workday thinking through potential solutions to machine learning riddles, Microsoft’s Ronen Eldan was reading bedtime stories to his daughter when he thought to himself, “how did she learn this word? How does she know how to connect these words?” 

Enquiry