Microsoft’s artificial intelligence (AI) assistant, Copilot for Microsoft 365, has been under scrutiny by testers for over six months, with reviews reportedly a mix of negative and positive.
Last November, the company widely released the corporate version of its AI assistant – called M365 Copilot — to large customers, then began offering it to small businesses two months later.
While the AI upgrade has been praised for its usefulness in enhancing productivity and streamlining tasks, many users have expressed concerns about its high price point and perceived limitations in functionality.
Copilot for Microsoft 365 integrates with Microsoft software like Word, Outlook and Teams, using the same technology as OpenAI’s ChatGPT, according to the report. It can summarise emails, generate text and create documents based on natural language prompts.
Initial enthusiasm was reported by companies involved in testing, with employees eager to try the tool, the report said. However, some testers have expressed doubts about its cost and occasional mistakes made by Copilot.
Some testers stated that they are not willing to spend $30 per user for every employee in the company, per the report. Microsoft has not disclosed specific sign-up details, but it said that early demand has been unprecedented.
While some AI upgrades from Microsoft, like GitHub Copilot, have seen success, others, like the AI-powered chatbot in Bing search, have struggled to make an impact
Bing has gained less than 1 percentage point of market share, falling short of Microsoft’s expectations to gain ground against Google.
Early testers have reported efficiency gains, with meeting summaries saving about 30 minutes per meeting and AI-assisted writing saving six minutes on first drafts
While some testers have found the AI add-ons to be useful, others have encountered shortcomings, per the report.
Copilot has occasionally provided fabricated responses or made mistakes in meeting summaries. Additionally, Excel users have been less likely to utilise the AI assistant due to occasional errors in number crunching.
Microsoft acknowledges these issues and plans to address the drop-off in usage by incorporating more alerts and tips to guide users, the report said.
The company reported in January that Copilot is being adopted across industries, with the AI assistant and Microsoft’s other AI offerings driving the company to a record quarter during the three months ended Dec. 31.
“A growing body of evidence makes clear the role AI will play in transforming work,” Microsoft Chairman and CEO Satya Nadella said Jan. 30 during the company’s quarterly earnings call.
Meanwhile, companies are slowly learning what information to feed into the software. Give it too little to chew on, and Copilot is essentially a very expensive email drafting tool. Give it too much, and an office worker might call up a colleague’s salary or peek at projects unrelated to their job.
