Microsoft has spent the last three months mainstreaming artificial intelligence (AI) across its ecosystem. The company has tapped into OpenAI's GPT-4 to bring ChatGPT-like capabilities to Bing Chat, Bing Image Creator, Microsoft 365 Copilot, Azure OpenAI Service, and GitHub Copilot X. Next, Microsoft democratize AI with a new tool known as DeepSpeed-Chat.
According to Microsoft, DeepSpeed Chat is a new open source solution that aims to provide more affordable and easier access to conversational AI for developers. It is based on the DeepSpeed optimization library that Microsoft developed to train massive language models like MT-530B and BLOOM.
DeepSpeed Chat uses a new training technique called Reinforcement Learning with Human Feedback (RLHF), which was first introduced in the InstructGPT paper. RLHF allows the model to learn from human feedback and improve its conversational skills over time. The tool also supports data blending, which enables the model to learn from multiple data sources and generate diverse responses.
Microsoft points out that DeepSpeed Chat is able to train up to 13 billion parameters on one GPU, or for $300 when leveraging Azure Cloud. The tool also supports larger models up to hundreds of billions of parameters using DeepSpeed's memory optimization strategies such as ZeRO and LoRA.
Other benefits of the solution include 15 times faster throughput compared to state-of-the-art methods, while also supporting model sizes that are up to 7.5 times larger on the same hardware. Developers also access a training model and interface that provides simple functionality to help build ChatGPT-style AI models.
For example, DeepSpeed Chat can use a pre-trained Huggingface model and put it through InstructGPT via DeepSpeed-RLHF. This will result in a custom conversational AI.
Ongoing Development Despite Rising Concerns
Microsoft is going full steam ahead with its AI developments despite recent pushback against large language models such as ChatGPT. Yesterday I reported on the US Treasury Department seeking to create regulations and laws to govern AI. This move comes after Italy has already blocked ChatGPT and Germany is exploring doing the same.
The Italian Data Protection Authority has ordered OpenAI to stop providing the chatbot in the country. Germany is also reportedly considering banning ChatGPT and it is likely other countries will follow suit. OpenAI co-founder Elon Musk is also leading the FutureOfLife initiative, a project that wants to place more controls on AI development over concerns about the emergence of artificial general intelligence (AGI).
The group, which also includes Apple co-founder Steve Wozniak, wrote an open letter that calls for ceasing of AI development for six months.
Tip of the day: With a single registry tweak, it's possible to add a ‘Take Ownership' button to the right-click context menu that performs all of the necessary actions for you. You'll gain full access to all possible actions, including deletion, renaming, and more. All files and subfolders will also be under your name.
The Take Ownership context menu will set the currently active user as the owner of the files, though they must also be an administrator. They can then enter the folder or modify the file as they usually would.
Last Updated on April 27, 2023 10:31 am CEST by Markus Kasanmascheff
