AIPC WWDC24: Apple partners with OpenAI, launches Apple Intelligence, and integrates the GPT4o model into iOS 18.

On June 11, the Apple Developer Conference opened in California, with artificial intelligence technology once again becoming a central theme. On the first day of the conference, Apple released the iPadOS 18 preview and introduced Apple Intelligence technology for the first time, showcasing a number of innovative features.

https://v.douyin.com/ijbR1dMR/

Apple and OpenAI have reached a partnership, allowing users to directly invoke the ChatGPT-4o model without needing to register an account. Let’s see what features Apple Intelligence brings.

New Features in iPadOS 18
iPadOS 18 introduces several new features, especially with notable improvements in education and productivity tools. Among them, the MathNotes calculator is one of the highlights. Users can draw mathematical formulas on iPad with Apple Pencil and receive accurate answers in real time. This feature supports not only basic math calculations but also complex formulas, greatly simplifying the math learning and calculation process.

In addition, after users enter mathematical formulas in the MathNotes calculator, they can directly view the solutions and even assign values to variables, with function curves changing accordingly. The addition of this feature will revolutionize traditional ways of learning math, making math learning more intuitive and interactive.

SmartScript is another important update. It can automatically recognize and refine Apple Pencil handwriting to ensure clarity. SmartScript also makes it easy to edit handwritten text; users can add spaces with Apple Pencil and even paste embedded text into handwritten text, with paragraphs automatically adjusting to the added content. This feature provides users with a more efficient note-taking and text-editing experience.

Apple Intelligence System
At this developer conference, Apple released its first AI system, Apple Intelligence. The system uses a unique approach to combine generative AI with personal usage scenarios, thereby simplifying and speeding up daily task flows.

Among its features, Writing Tools supports article rewriting and intelligent summarization. Users can select specific sections to summarize and create charts, greatly improving document processing efficiency. Smart Reply helps users quickly reply to emails, identifies all questions in an email, and ensures all are answered.

The latest Notes and Phone features allow users to record audio and transcribe it into text. After a call ends, Apple Intelligence generates a summary to help users review the key points. In addition, Image Playground is an image-generation tool that supports three image styles, is built into the device, and can generate unlimited images. Users only need to combine multiple tags to complete image generation, without entering complex prompts.

Image Playground also supports generating original emoji stickers through text prompts or image-to-image, adding fun to chats. The Cleanup tool can intelligently remove unwanted people and objects from images, enabling intelligent image editing. With the addition of Apple Intelligence, Siri’s understanding has also improved significantly, effectively simplifying daily workflows.

Integration of iOS 18 with ChatGPT
It is certain that iOS 18 will integrate the GPT-4 model with visual capabilities. Users can invoke ChatGPT through the Siri assistant to complete document reading and image interaction. Users can directly use the GPT-4 model without registration, which will bring them a brand-new experience. The partnership between Apple and OpenAI enables users to generate text and images on Apple devices, further enhancing the intelligence level of the devices.

AI-Powered Experience on iPhone
With the addition of Apple Intelligence features, the iOS 18 system will bring more disruptive experiences to iPhone. Users can customize the position, size, color, and appearance of home screen icons. The Carousel view can recommend images to users and intelligently categorize them based on photo content. Users can also invoke Writing Tools in Mail, Notes, and third-party apps to complete content summarization and rewriting.

Apple Vision Pro Goes on Full Sale
Apple announced that Apple Vision Pro will go on sale in China and multiple countries and regions in the Asia-Pacific starting June 14, and users can preorder on Apple’s official website.

macOS Sequoia System
Apple released the latest desktop operating system, macOS Sequoia. The new system not only supports iPhone Mirroring but also brings users more major game titles. macOS Sequoia allows users to directly access and fully control iPhone from Mac, supports drag-and-drop files between iPhone and Mac, and replying to iPhone messages on Mac. Safari adds a Highlights feature, providing users with content summaries and Picture in Picture. In addition, Sequoia supports more AAA game titles, bringing users a new gaming experience.

Apple Intelligence based on ChatGPT will also be integrated into macOS Sequoia to improve writing efficiency. Although the iOS 18 system brought many surprises, Apple’s stock performed flat that day. Nvidia, as the biggest beneficiary of the AI technology wave, saw its stock hit a new record high, with its market capitalization having surpassed Apple’s. Apple said that OpenAI is only one partner, and later it will consider adding multiple large language models, including Gemini, to give users more choices.

This Apple Developer Conference showcased Apple’s latest progress in AI and intelligent technologies. Through iPadOS 18 and the Apple Intelligence system, Apple is providing users with a smarter and more efficient experience. In the future, as AI technology continues to develop and be applied, Apple devices will demonstrate their powerful intelligent capabilities in more scenarios.