Microsoft has confirmed its plans to upgrade its AI chatbot, known as Bing Chat and recently renamed to ‘Copilot,' by implementing the advanced GPT-4 Turbo model, a collaborative integration with OpenAI. The new model is anticipated to significantly enhance the chat service's features.
Expanding User Interaction with Increased Context Window
The distinct advantage of the GPT-4 Turbo over its predecessor is its expanded context window that supports up to 128k, equivalent to around 300 pages of text prompts. This enhancement aligns with the feedback from users who seek to extend the current chat limitations beyond the present 5,000 character threshold. Mikhail Parakhin, the head of Microsoft's Advertising and Web Services and leader of the Windows and Web Experiences Team, confirms that with the introduction of GPT-4 Turbo, the character limit is expected to increase, although exact details are pending.
It beats vanilla GPT-4 on "perceived intelligence" – our internal metric of how smart the system feels when you talk to it, but we still need to iron out a few kinks in Math and Coding. It has higher throughput, so you can have more users or run DCs less "hot", improving latency.
— Mikhail Parakhin (@MParakhin) November 24, 2023
Perceived Intelligence and Performance: The GPT-4 Turbo Edge
In conversations with users on X (formerly known as Twitter), Parakhin emphasized the superiority of GPT-4 Turbo compared to the standard GPT-4 model. He underscores improvements in the ‘perceived intelligence' metric, which assesses the AI's effectiveness in interactions, despite noting that the team is still refining aspects related to mathematical and coding responses. Furthermore, GPT-4 Turbo promises higher throughput, allowing for more simultaneous users and reduced latency by lessening the load on data centers (DCs).
As for the much-anticipated support for third-party plugins, Parakhin mentioned the gradual rollout process that is not tied to specific locations but determined by a random user selection across the globe. With these forthcoming advancements, Microsoft fortifies its position within the competitive landscape of AI-driven chat services, striving to create a seamless and more intelligent experience for its users. The full potential of the new GPT-4 Turbo model within Microsoft's Copilot service remains eagerly awaited by both the tech community and the chatbot's user base.
