Create

Sign in to ReadmeX

or

How we handle your data: Privacy Policy

ReadmeX

Your AI reading companion

What would you like to catch up on?

Pick a briefing, or ask your own question.

Your community and people briefings stay personal to you.

Story

Microsoft Research's AI Frontiers is reorganized into Microsoft AI

AI summary

John Langford said Microsoft Research’s roughly 50-person AI Frontiers group, formed in 2023, was reorganized into Microsoft AI in early September before he left the company. He credited the group with work on AutoGen, Fara, Next Latent, Dion3, and the Full Bandwidth Transformer, while saying compute constraints and a scaling-focused approach hindered its research agenda. Microsoft had not commented on the reorganization or the end of AI Frontiers.

In-depth insight

The change marks the end of a focused Microsoft Research organization and its founder’s departure, with claims about its projects and research philosophy still relying largely on Langford’s account.

In 2023 after the ChatGPT release, it was clear to me that research needed to be more organized to succeed than was typical within Microsoft Research. The amount of support and focus which other research groups were applying was great enough that even with a clever idea pursued by one person it was likely to arrive late and unconvincing because one person could not move fast enough and the baselines which one person could assemble just were not strong enough to really show that an idea was worth taking flight. Several other folks thought similarly and we organized to create the AI Frontiers sub-organization within MSR.

In AI Frontiers, we actively tried to organize coherent research efforts. This was not precisely “top down” or “bottom up”, but rather mostly somewhere in the messy middle. There were disagreements of course, and resolving them was sometimes quite challenging. Compute availability was also an often-severe bottleneck. But at a high level I was under the general impression that the organization was succeeding in doing pioneering things, particularly given the small size of AIF (~50 people) and relative to what we could do previously. Much of the work of AIF was figuring out how to make agents work, for example the Autogen orchestration framework and the Fara computer use agent. In NYC however, several of us were interested in developing new fundamental capabilities such as the Next Latent objective which enables extrapolation, Dion3 which creates an optimized/improved Muon, or the Full Bandwidth Transformer which efficiently makes models function substantially more powerfully via recursion.

#Microsoft Research#AI Frontiers#Microsoft AI#AutoGen#Fara#Next Latent#Dion3#Full Bandwidth Transformer

Original · 4 min readRead the original
Group chat

No comments yet. Start the conversation.