How Microsoft’s developers are using AI

Microsoft is pitching a future where AI controls everything on your PC and agents go and do work for you in the background. But before the company gets there, it has to build the tools to make these systems work and convince its own developers that AI is actually capable of achieving these big promises.

Microsoft CEO Satya Nadella revealed earlier this year that up to 30 percent of the code of “some of our projects” is written by AI, and I’ve been eager to learn exactly how Microsoft’s developers are using the technology ever since. I’ve been speaking to sources and company execs to get a better idea of how AI is being used by Microsoft developers. Some employees have told me they’re skeptical that AI agents will be able to fully replace the work of humans, leaving developers to fix the mistakes of automated agents.

When I ask the company for more specifics, though, Microsoft touts its early success in deploying AI internally.

“We want to really look at where there’s developer toil, where we have inefficiencies,” says Amanda Silver, a CVP in Microsoft’s CoreAI team who leads product for the company’s Apps & Agents platform, in an interview with Notepad. “Part of what we’re looking at is both how we can apply [AI] and where we can apply it.”

There are over 100,000 code repositories inside Microsoft, from brand new projects to legacy codebases that are more than 20 years old and still up and running. “We have pretty much every programming language, architecture, and lifecycle stage that you can imagine, and this really reflects a lot of our customers,” says Silver. That’s a lot of code for AI to potentially touch, especially as Microsoft pushes beyond simple code completion towards more automation with AI agents.

In May, Microsoft embedded a coding agent directly into GitHub Copilot, letting developers assign it work to do. The agent then goes off and creates its own development environment, runs in the background, and creates draft pull requests. “What we see is that developers save on average 30 minutes on simple tasks, over a half day on medium tasks, and two weeks on complex tasks,” says Silver. Microsoft’s developers are using it for time-consuming and monotonous tasks like fixing bugs and improving documentation for apps and services.

Microsoft looks at developer hours saved, incidents mitigated, or estimated hours saved for tasks to get to these numbers. “Additionally, we look at the actions completed by the agentic capabilities, such as the number of pull-requests it contributes to,” says Silver.

Measuring the impact of AI on developer productivity is something that I hear Microsoft is obsessing about internally, even if some studies show AI can make experienced developers slower. Some employees, who wish to remain anonymous, feel that Microsoft executives aren’t happy with how often developers use AI right now. There’s a push internally to get developers to use AI first for everything, but I hear that adoption isn’t always organic.

“It does require a little bit of intentional engagement to allow the mindset shift to click in,” admits Silver. While Microsoft’s developers could ignore GitHub Copilot Chat because it was in a separate window, the agentic mode and coding agent are right in the context of how developers work. “It becomes habit forming and changes behavior,” says Silver.

Microsoft says 91 percent of its engineering teams use GitHub Copilot, but sources have shared data that suggests, in some parts of the company, overall AI tool adoption is much lower – closer to the 51 percent of developers who told Stack Overflow they’re now using AI tools professionally every day.

Silver rattles off a list of teams that have sped up their work with AI. The Xbox team used Copilot’s app modernization agent to upgrade their core Xbox service from .NET 6 to .NET 8 recently. “They saw an 88 percent reduction in manual migration effort,” she says, taking “months of work and compressing it down into days.” Microsoft’s discovery and quantum team used the Copilot agent to migrate a Java app to the latest version, and saw a similar “reduction in the effort that was needed, thanks to the AI agent auto detecting deprecated APIs, suggesting fixes, and identifying security vulnerabilities.” The company’s “ES Chat” agent, which can answer questions about Microsoft’s engineering systems, has saved engineers “46 minutes per task compared to traditional search methods.” Microsoft is also using AI agents to help Site Reliability Engineers (SRE) respond to outages of systems and apps. There, the company has already saved over “10,000 hours of operational time.”

All of these time savings mean that Microsoft’s code is increasingly being built by AI instead of just humans, but Silver won’t put a number on how much of Microsoft’s code is being built by AI. She argues it’s too hard to track everything as AI is embedded in code generation, review processes, test generations, and deployment pipelines. “The agents really become a core part of the engineering system itself,” says Silver. “This is one of the reasons why it’s so hard to pin a precise number on the number of lines of code that the AI is contributing.” I also get a sense that promoting a number that’s either too high or too low would be counterproductive to Microsoft’s marketing efforts, both internally and externally.

Still, I don’t doubt the complexity of the task. A human engineer could submit code while Copilot is running inside their editor, or the engineer could copy and paste AI code into their editor. It’s fair to say that AI is prevalent in some parts of Microsoft’s developer output. You only need to look at the codebases of Aspire, Typescript Go, and Microsoft’s Agent Framework to see that Copilot is a major contributor to all of them.

The AI systems also aren’t perfect. Silver says engineers review their work. And a source at Microsoft told me that some of the tools aren’t all they’re cracked up to be. “ES Chat saves me time in that I don’t use it,” the person joked.

Microsoft’s aggressive push towards AI agents coding for developers has also got some employees inside the company concerned about the future. I’ve spoken to engineers in Microsoft’s CoreAI division that are worried about the use of autonomous AI agents, particularly as they pick up the types of projects that junior developers could be assigned. There’s a real fear in the industry, and inside Microsoft, that junior developer roles are disappearing, leaving experienced devs having to babysit the output of AI tools.

With Nadella’s goal of overhauling Microsoft into a company that’s focused on AI agents doing work, this all sounds like less humans involved in coding in the future. Silver is taking the optimistic view that AI will simply allow developers to offload the boring tasks and focus on creativity instead.

“No developer got into the industry because they wanted to be assigned a months-long code maintenance migration effort,” says Silver. “They want to be at the cutting edge, they want to create, they want to innovate. These are the kinds of things they want to offload to AI so they can get back to the process of creation.”

I’m always keen to hear from readers, so please drop a comment here, or you can reach me at notepad@theverge.com if you want to discuss anything else. If you’ve heard about any of Microsoft’s secret projects, you can reach me via email at notepad@theverge.com or speak to me confidentially on the Signal messaging app, where I’m tomwarren.01. I’m also tomwarren on Telegram, if you’d prefer to chat there.

Thanks for subscribing to Notepad.