Microsoft launches Windows 11 24H2 with a series of new AI features

On September 24, 2024, Microsoft officially released the Windows 11 24H2 update, bringing a series of new features powered by artificial intelligence (AI), most of which work locally without an internet connection. Below are the highlights of this update.

Windows 11 24H2.

Windows Copilot Runtime: The AI ​​Heart of Windows 11

Windows Copilot Runtime is considered the core AI platform in Windows 11 24H2, acting as a separate processing layer, deeply integrated into the operating system. It is capable of connecting and coordinating the activities of more than 40 different AI models right on the device, allowing it to run directly without accessing the cloud. Notably, Phi Silica, a small language model (SLM) developed by Microsoft, brings many similar features to large language models (LLM). In addition, other models such as Screen Region Detector, Optical Character Recognizer, and Image Encoder are also integrated to enhance the AI ​​experience on the operating system.

Windows Copilot Runtime.

The Windows Copilot Runtime also provides a set of Windows Copilot Library APIs, making it easy for developers to integrate AI into their applications. While some features, like Copilot, require cloud connectivity, many AI features can work offline, ensuring information security and improving the user experience.

Windows Recall: Smart Memory Assistant

Windows Recall is a new feature in Windows 11 24H2, which allows users to remember their activities by taking continuous screenshots and using AI to analyze and remember the content. From there, users can search for information based on the context. However, due to mixed feedback, Microsoft decided to test this feature in the Windows Insider program before releasing it widely.

Windows Recall.

Windows Studio Effects: Optimize webcam and microphone

Windows Studio Effects has been around for a while, but it’s only now that the 24H2 release has made it available to more devices. Using the power of the AI ​​processing unit (NPU), Windows Studio Effects allows users to blur backgrounds, auto-align frames, maintain eye contact with the camera, and remove background noise during video conferencing.

Live Captions: Real-time captions powered by AIThe Live Captions feature on Windows 11 24H2 is powerfully upgraded with AI, allowing direct recognition and translation of audio sources into other languages. Thanks to that, hearing-impaired people or users who want to access content in other languages ​​can follow and understand audio content from many sources such as YouTube videos , voice calls or online conferences.

Voice Clarity: Smart noise filtering

Voice Clarity is a new feature that uses AI to remove noise in real time during calls or recordings. Originally exclusive to Surface devices, the feature is now expanding to more devices in Windows 11 24H2.

Auto Super Resolution: Enhance your gaming experience

Auto Super Resolution (Auto SR) is a much-anticipated feature in Windows 11 24H2, promising to improve graphics in games thanks to AI. Auto SR makes images sharper and frame rates smoother without requiring high hardware configuration. The special feature of Auto SR is that it is processed on NPU instead of GPU, helping to save energy and extend battery life. However, the number of games that support Auto SR is currently limited, but Microsoft is actively cooperating with major graphics companies to develop more.

Auto Super Resolution.

Restyle Image and Image Creator: Creative AI in the Photos app

The Photos app on Windows 11 24H2 has been updated with two new AI features. Restyle Image lets you change the style of a photo based on a text description, while Image Creator uses Copilot AI technology to create images from text.

Restyle Image and Image Creator.

Cocreator: AI-powered creativity in Paint

Paint is also not out of the AI ​​trend when it added Cocreator - a tool that supports users to create from hand sketches and descriptive text, allowing AI to complete the artwork as desired.

Copilot App: Independent AI Assistant

In Windows 11 24H2, Copilot has been moved from the sidebar to a standalone application, with a ChatGPT-like interface and support for text, image, audio, and video input. The new Copilot uses GPT-4o and will be available to all Windows 11 users, not limited to the Copilot+ line.

Copilot app.

Copilot Suggestions: Smart suggestions based on context

The “Copilot suggestions” feature provides personalized suggestions based on the context in which you’re working. For example, when you hover over an image in File Explorer, Copilot might suggest removing the background, resizing it, or creating a different image.

Source: https://www.congluan.vn/microsoft-ra-mat-windows-11-24h2-voi-hang-loat-tinh-nang-ai-moi-post313504.html