Microsoft launches Windows 11 24H2 with a series of new AI features

On September 24, 2024, Microsoft officially released the Windows 11 24H2 update, bringing a series of new features powered by artificial intelligence (AI), most of which work locally without an internet connection. Here are the highlights of this update.

Windows 11 24H2.

Windows Copilot Runtime: The AI ​​Heart of Windows 11

Windows Copilot Runtime is considered the core AI platform in Windows 11 24H2, operating as a separate processing layer, deeply integrated into the operating system. It is capable of connecting and coordinating the operations of more than 40 different AI models right on the device, allowing it to run directly without accessing the cloud. Notably, Phi Silica, a small language model (SLM) developed by Microsoft, brings many similar features to large language models (LLM). In addition, other models such as Screen Region Detector, Optical Character Recognizer, and Image Encoder are also integrated to enhance the AI ​​experience on the operating system.

Windows Copilot Runtime.

The Windows Copilot Runtime also provides the Windows Copilot Library API, making it easy for developers to integrate AI into their applications. While some features, like Copilot, require a cloud connection, many AI features can work offline, ensuring information security and improving the user experience.

Windows Recall: Smart Memory Assistant

Windows Recall is a new feature in Windows 11 24H2, which allows users to remember their activities by taking continuous screenshots and using AI to analyze and remember the content. From there, users can search for information based on the context. However, due to mixed feedback, Microsoft decided to test this feature in the Windows Insider program before releasing it widely.

Windows Recall.

Windows Studio Effects: Optimize webcam and microphone

Windows Studio Effects has been around for a while, but it’s only with version 24H2 that it’s becoming more widely available on more devices. Using the power of the AI ​​processing unit (NPU), Windows Studio Effects lets users blur backgrounds, auto-align frames, keep eyes on the camera, and remove background noise during video conferencing.

Live Captions: Real-time captions powered by AILive Captions on Windows 11 24H2 is a powerful upgrade powered by AI, allowing for direct recognition and translation of audio sources into other languages. This allows hearing-impaired people or users who want to access content in other languages ​​to follow and understand audio content from multiple sources such as YouTube videos , voice calls, or online conferences.

Voice Clarity: Smart noise filtering

Voice Clarity is a new feature that uses AI to remove noise in real-time during calls or recordings. Originally exclusive to Surface devices, the feature is now expanding to more devices in Windows 11 24H2.

Auto Super Resolution: Enhance your gaming experience

Auto Super Resolution (Auto SR) is a highly anticipated feature in Windows 11 24H2, promising to upgrade graphics in games with AI. Auto SR helps to make images sharper and frame rates smoother without requiring high hardware configuration. The special feature of Auto SR is that it is processed on the NPU instead of the GPU, helping to save energy and extend battery life. However, the number of games supporting Auto SR is currently limited, but Microsoft is actively cooperating with major graphics companies to develop more.

Auto Super Resolution.

Restyle Image and Image Creator: Creative AI in the Photos app

The Photos app on Windows 11 24H2 has been updated with two new AI features. Restyle Image lets you change the style of a photo based on a text description, while Image Creator uses Copilot AI technology to create images from text.

Restyle Image and Image Creator.

Cocreator: AI-powered creativity in Paint

Paint is also not out of the AI ​​trend when it added Cocreator - a tool that supports users to create from hand sketches and descriptive text, allowing AI to complete the artwork as desired.

Copilot App: Standalone AI Assistant

In Windows 11 24H2, Copilot has been moved from the sidebar to a standalone app, with a ChatGPT-like interface and support for text, image, audio, and video input. The new Copilot uses GPT-4o and will be available to all Windows 11 users, not just limited to the Copilot+ line.

Copilot App.

Copilot Suggestions: Smart suggestions based on context

The “Copilot suggestions” feature provides personalized suggestions based on the context in which you’re working. For example, when you hover over an image in File Explorer, Copilot might suggest removing the background, resizing it, or creating a different image.

Source: https://www.congluan.vn/microsoft-ra-mat-windows-11-24h2-voi-hang-loat-tinh-nang-ai-moi-post313504.html