WWDC 2024 Apple Intelligence with ChatGPT

Summary

이번 WWDC 2024 발표에서는 Apple의 최신 기술과 혁신적인 기능들이 대거 소개되었습니다. 특히 주목할 만한 것은 Apple Intelligence로, 이는 OpenAI ChatGPT 와 통합된 개인 맞춤형 인공지능 시스템으로 iPhone, iPad, Mac에 깊이 통합되어 사용자 경험을 획기적으로 향상시킵니다. Apple Intelligence는 언어 생성 및 이해, 이미지 생성, 개인 컨텍스트 이해를 통해 사용자에게 더욱 강력하고 유용한 도구를 제공합니다. Siri는 대화형 컨텍스트 유지와 화면 인식 능력 등으로 더욱 자연스럽고 개인화된 지원을 제공합니다. 또한, iOS 18, visionOS 2, macOS Sequoia 등 다양한 OS 업데이트와 함께 Apple TV+의 새로운 콘텐츠, iPhone과 iPad의 새로운 기능들도 발표되어 Apple 제품이 더욱 강력해졌습니다. 개발자들을 위한 새로운 API와 프레임워크도 도입되어, 개발자들이 Apple Intelligence를 쉽게 통합하고 다양한 앱 간의 작업을 자동화할 수 있게 되었습니다.

소개

• 2024년 WWDC는 Apple Park에서 개최됨
• 이번 행사에서는 Apple의 최신 플랫폼과 기술 업데이트 발표
• Apple Intelligence를 비롯한 중요한 신기술 소개

Apple Intelligence

개요

• Apple의 개인 인공지능 시스템, Apple Intelligence 소개
• 강력한 개인화된 인공지능으로 iPhone, iPad, Mac 경험 향상
• 언어 생성 및 이해: 시스템 전반에 걸쳐 자연어 이해와 생성 기능 제공
• 이미지 생성: 대화와 작업에서 사용자 맞춤형 이미지를 생성하여 시각적 표현 강화
• 개인 컨텍스트 이해: 사용자의 개인 정보를 기반으로 한 맞춤형 지원 제공
• iOS 18, iPadOS 18, macOS Sequoia에 통합된 Apple Intelligence 시스템을 발표. 이 시스템은 강력한 생성 모델과 개인화된 컨텍스트를 결합하여 사용자에게 유용하고 관련성 높은 지능을 제공.

주요 기능 소개

1. 언어 이해 및 생성

   • Writing Tools: 시스템 전반에 걸쳐 사용할 수 있는 새로운 작성 도구 제공. Mail, Notes, Pages, Keynote 및 타사 앱에서 텍스트를 다시 작성, 교정 및 요약.
     • Rewrite: 다양한 버전의 텍스트를 제공하여 톤과 표현 조정.
     • Proofread: 문법, 단어 선택, 문장 구조를 검사하고 수정 제안.
     • Summarize: 선택한 텍스트를 요약하여 소화하기 쉬운 형식으로 제공.

2. 이미지 생성

   • Image Playground: 애니메이션, 일러스트레이션, 스케치 스타일로 빠르고 쉽게 이미지 생성. Messages, Keynote, Freeform, Pages와 같은 앱에 내장.
   • Genmoji: 사용자 설명에 따라 맞춤형 이모지를 생성.
   • Image Wand: Apple Pencil을 사용해 러프 스케치를 관련 이미지로 변환.

3. Siri의 혁신

   • 새로운 디자인: 시스템 경험에 더 깊이 통합된 우아한 빛나는 디자인.
   • 문맥 인식: 이전 요청의 맥락을 유지하여 더 자연스러운 대화 가능.
   • 타이핑 가능: 음성 외에도 텍스트로 Siri에게 요청 가능.
   • 제품 지식: 기기 기능과 설정에 대한 광범위한 지식 제공.
   • 화면 인식: 메시지에서 받은 주소를 연락처에 추가하는 등의 작업 가능.

4. 사진 및 비디오 처리

   • Clean Up 도구: 배경의 방해 요소를 제거.
   • 메모리 무비 생성: 사진과 비디오를 기반으로 맞춤형 이야기를 생성.

On-Device Processing (온디바이스 처리)

Apple Intelligence의 핵심은 온디바이스 처리. 이는 사용자 개인 정보 보호를 강화하며, 사용자 데이터를 수집하지 않고도 개인화된 지능 제공.

1. 고급 모델의 온디바이스 실행

   • Apple Silicon(A17 Pro, M1 및 이후 모델)의 강력한 계산 성능을 활용.
   • 생성 모델 및 확산 모델: 일상적인 작업에 최적화된 고성능 모델.
   • 온디바이스 의미 인덱스: 앱 전반의 정보를 구성하고 검색.

2. Private Cloud Compute

   • 더 복잡한 요청을 처리하기 위해 서버 기반 모델 활용.
   • Apple Silicon 서버: iPhone의 보안과 동일한 수준의 보안 제공.
   • 데이터 사용 제한: 사용자 데이터는 요청을 처리하기 위해서만 사용되며 저장되지 않음.
   • 투명성 보장: 독립 전문가가 서버 소프트웨어를 검토할 수 있음.

ChatGPT와의 통합

1. Siri와의 통합

   • Siri는 필요할 때 ChatGPT의 전문 지식을 활용 가능.
   • 사용자가 질문을 할 때 Siri는 ChatGPT로부터 답변을 받아 제공.

2. 시스템 전반의 작성 도구

   • Compose 도구: ChatGPT의 이미지 생성 도구를 통해 다양한 스타일로 이미지 생성 가능.
   • 사용자는 무료로 ChatGPT에 접근할 수 있으며, ChatGPT 구독자는 유료 기능 사용 가능.

개발자 지원

1. 새로운 API 및 프레임워크

   • App Intents 프레임워크: Siri, Writing Tools, Image Playground 기능을 앱에 쉽게 통합 가능.
   • 자동 텍스트 편집: Bear Notes와 같은 앱에서 자동으로 다시 작성, 교정, 요약 기능 제공.

2. Xcode 통합

   • Swift 및 SwiftUI 개발: 온디바이스 코드 완성, Swift 코딩 질문에 대한 스마트 지원 제공.

Apple TV+

• Apple TV+는 올해 5주년을 맞이함
• 세계 최고의 창작자들이 만든 다양한 쇼와 영화 제공
• 최근 비평가들의 찬사를 받은 영화와 시리즈 공개
  • “Killers of the Flower Moon”, “Napoleon”
  • “Masters of the Air”, “Palm Royale”, “Hijack”, “Dark Matter”, “Monarch: Legacy of Monsters”
• Apple TV+의 새로운 오리지널 콘텐츠 매주 공개 예정

visionOS

주요 업데이트

• Apple Vision Pro와 visionOS는 완전히 새로운 가능성을 열어줌
  • 엔터테인먼트, 생산성, 협업 등 다양한 분야에서 혁신적인 경험 제공
• 2,000개 이상의 전용 앱과 150만 개 이상의 호환 앱 제공
• visionOS 2 출시:
  • 중요한 추억과의 새로운 연결 방식
  • 생산성 향상
  • 몰입형 경험을 위한 새로운 개발자 API 제공

주요 기능

• 사진: 공간 사진으로 추억을 생생하게 재현
  • 머신 러닝을 통해 2D 이미지를 공간 사진으로 변환
  • SharePlay를 통해 사람들과 함께 추억 공유
• 탐색 기능: 눈, 손, 목소리만으로 쉽게 조작
• Mac Virtual Display: 무선으로 Mac을 Vision Pro로 가져와 큰 4K 디스플레이로 활용 가능
  • 고해상도와 크기로 확장 가능
  • 동적 시선추적 기술 적용

새로운 개발자 API

• TabletopKit: 평면에 고정된 앱 제작 가능
• 기업용 API: 의료 및 제조업 등에서 강력한 활용 사례 제공
• 공간 비디오 촬영: iPhone 15 Pro와 Pro Max를 통해 공간 비디오 촬영 가능
  • Canon EOS R7용 새로운 공간 렌즈 제공
  • Final Cut Pro에서 공간 비디오 편집 가능

Apple Immersive Video

• 180도 8K 녹화와 공간 오디오를 통해 몰입형 경험 제공
• Blackmagic Design과 협력하여 새로운 제작 워크플로우 제공

iOS 18

주요 업데이트

• 홈 화면: 아이콘과 위젯을 재배치하여 더 개인화된 홈 화면 설정 가능
• 컨트롤 센터: 새로운 그룹의 컨트롤 추가 가능, 개발자도 컨트롤 포함 가능
• 앱 잠금: 민감한 앱을 잠그고 숨길 수 있는 기능 제공
• 메시지: 무제한 이모지와 스티커를 사용한 Tapback 기능, 메시지 예약 전송, 텍스트 효과 추가
• 위성 메시지: 셀룰러 서비스가 없는 상황에서도 위성을 통한 메시지 송수신 가능
• 메일: 이메일 자동 분류와 요약 기능 제공

앱과 기능 개선

• 지도: 상세한 등산로 지도와 오프라인 사용 가능
• 월렛: Tap to Cash 기능으로 개인 정보 없이 결제 가능
• 저널: 정신 상태 기록 및 통계 제공
• 게임 모드: 게임 성능 향상을 위한 백그라운드 활동 최소화

사진 앱

• 새로워진 디자인으로 더 쉽게 사진을 찾아 감상 가능
• 컬렉션: 시간, 사람, 여행 등 주제별로 사진 정리
• 카루셀: 포스터처럼 베스트 사진을 강조하는 새로운 공간 제공

마무리

• 이번 WWDC는 Apple의 기술적 혁신과 발전을 보여주는 중요한 행사였음
• Apple Intelligence를 통해 개인화된 인공지능 경험 제공
• 새로운 OS와 기술 업데이트를 통해 개발자와 사용자 모두에게 더 나은 경험 제공

Sources

Start
0:00
♪ ♪
0:06
Craig Federighi: Big day, everyone. Biggest day of the year. Who's fired up? Beth is fired up!
0:12
Doctor? Rockwell? One more thing: just have fun out there.
0:21
Okay, Phil! Phil: I'm getting too old for this stuff. ♪ ♪
0:26
[alarm blaring] ♪ ♪
0:45
Craig: Go! Go! It's showtime!
0:50
♪ ♪
1:08
♪ ♪
1:28
Tim Cook: Wow! That was so cool. Good morning! Welcome to Apple Park!
Introduction
1:33
We're glad you could join us for what promises to be an action-packed and memorable WWDC!
1:40
WWDC marks a moment in the year when we're able to celebrate our global developer community.
1:47
Developers continue to amaze us with the apps they create for our products, apps that are used by over a billion people around the world.
1:56
It's important for us to provide this community with the newest tools and technologies to do their very best work.
2:03
Today, we're going to have some incredible updates to our platforms.
2:09
And I'm excited that we'll introduce profound new intelligence capabilities that we hope will inspire developers, delight users,
2:17
and make our platforms even smarter and more useful than ever. Before we get into our platforms, let's talk about Apple TV+,
2:26
which is celebrating its fifth anniversary this year! Apple TV+ is the best in entertainment,
2:33
filled with shows and movies made by the world's most creative storytellers. And I'm proud to say
2:39
that Apple TV+ has been recognized for delivering the highest-rated originals in the industry for three years running!
2:47
Apple TV+ features great originals that have received industry-wide recognition
2:53
such as Oscars, Emmys, and BAFTAs. This past year alone, Apple TV+ has debuted
3:01
critically acclaimed movies like "Killers of the Flower Moon" and "Napoleon"
3:06
and hit shows like "Masters of the Air," "Palm Royale," "Hijack," "Dark Matter," and "Monarch: Legacy of Monsters."
3:16
And we're about to launch our most exciting lineup yet, with amazing new originals arriving on Apple TV+ each and every week.
3:24
Let's take a look! [elevator dings] - Welcome back. Been a minute.
3:32
♪ ♪ - I can write a story
3:37
that will set you free.
3:50
- Our existence is all about choices. - I just need to get to the truth. - I did not kill her.
3:56
- We can't lose the race for the moon. We need to shoot a backup. - You mean to fake it?
4:05
- We are not finished! We will safely leave the silo! ♪ ♪
4:21
- Good work, Watson. - Rory, you are driving recklessly!
4:28
- I'm in the middle of a high-speed car chase! - Maybe I should drive.
4:33
- My gut is telling me this is connected. - You and I are cut from the same beautiful cloth.
4:41
- You take that back. - This is not how I work. - Feeling's mutual. - Ready? - Yeah.
4:48
♪ ♪
4:55
- Wait! - Admit it, he was cool. - Okay, fine, he was very cool. ♪ ♪
5:04
Tim: This lineup looks incredible. I hope you're as excited about these Apple Originals as I am!
5:10
And now, let's turn to our platforms. We have so much to talk about today.
5:16
We'll start with our OS announcements, and then we'll dive deeper into intelligence.
5:22
Let's start with our newest operating system, visionOS. We released Apple Vision Pro in February,
5:29
and we already have some great updates to share with you today. Here's Mike to tell you more.
5:36
♪ ♪
visionOS
5:42
Mike Rockwell: Apple Vision Pro and visionOS unlock completely new possibilities for entertainment,
5:48
productivity, collaboration, and so much more. Vision Pro has inspired developers to create amazing and unique spatial apps
5:57
that aren't possible on any other platform. Apps like NBA, where you can watch multiple live games with stats,
6:05
"What If?", where you become a superhero in the Marvel universe,
6:10
and "Unextinct," where you can explore endangered species. Games that take advantage of your space, immerse you completely,
6:19
challenge you in new ways, or let you gather around a table to play with friends,
6:24
even when you're not together. You can master meditation with Po from "Kung Fu Panda,"
6:33
bring your data to life with SAP, and doctors can even reimagine surgical simulation and planning.
6:42
New apps, including some from the world's biggest names in entertainment, productivity, and gaming are arriving on the App Store every day.
6:51
There's already over 2,000 apps created specifically for Apple Vision Pro.
6:56
And with over 1.5 million compatible iPhone and iPad apps, there's always something new to do.
7:03
All of these amazing apps and experiences are made possible by visionOS.
7:09
It's been just four months since we launched Vision Pro and visionOS, and today we're already announcing our first major update.
7:17
Introducing visionOS 2. visionOS 2 propels spatial computing forward
7:24
with new ways to connect with your most important memories, great enhancements to productivity,
7:30
and powerful new developer APIs for immersive shared experiences. To tell you more, here's Haley.
7:40
Haley Allen: visionOS 2 is a great release with some big updates. Let's start with Photos.
7:46
Spatial computing has reinvented how you view your photos. There's nothing like seeing them life-sized with incredible fidelity.
7:53
Spatial photos are even more powerful, bringing life and realism to your favorite moments with family and friends.
8:00
It's incredibly moving to step back into a treasured memory, and the rich visual depth of spatial photos makes this possible.
8:08
Now, visionOS 2 lets you do something truly amazing with the photos already in your library.
8:14
With just the tap of a button, advanced machine learning derives both a left and right eye view
8:20
from your beautiful 2D image, creating a spatial photo with natural depth that looks stunning on Vision Pro.
8:27
It's so magical to reach into the past and bring your most cherished photos into the future.
8:33
And now, you can experience all your panoramas and spatial photos and videos together with the people you love using SharePlay in the Photos app.
8:42
With our new spatial Personas, it feels like they are sitting right next to you, even if they're thousands of miles away.
8:51
People are amazed at how easy it is to navigate Vision Pro with just their eyes, hands, and voice.
8:58
And with visionOS 2, we've made it even easier. Now you can just hold your hand up and tap to open Home View.
9:06
Or flip your hand over to bring up time and battery level. And tap again to open Control Center, giving you quick access
9:13
to frequently used features like Notifications and Mac Virtual Display. People love Mac Virtual Display
9:19
because it lets them bring their Mac wirelessly into Vision Pro just by looking at it, giving them a large, private, and portable 4K display.
9:27
Later this year, it gets even better, with higher display resolution and size. And it can be expanded even further, into an ultra-wide display
9:36
that wraps around you, equivalent to two 4K monitors side by side. Your content stays sharp wherever you look
9:43
thanks to dynamic foveation performed on the Mac. Another great thing about Apple Vision Pro is how incredible it is to use on a plane,
9:52
letting you take a private movie theater wherever you go. With visionOS 2, we're adding train support to Travel Mode,
9:59
so you can work privately on your long commute or catch up on your favorite shows on a massive screen.
10:05
These updates are going to make the Vision Pro experience even better. And now, back to Mike.
10:15
Mike: In addition to these great features, visionOS 2 also makes it even easier for developers to create
10:21
sophisticated spatial apps. There are many new frameworks and APIs for developers to explore,
10:27
like advanced volumetric APIs that allow even the most complex 3D apps to run side by side for the ultimate multitasking experience.
10:36
TabletopKit makes it possible for developers to quickly create apps that anchor to flat surfaces,
10:42
like manufacturing workstations or board and card games, and are great for use with spatial Personas on FaceTime.
10:49
And enterprise-specific APIs that will enable powerful use cases like surgical training in healthcare, equipment maintenance in manufacturing,
10:58
and beyond. These new APIs and frameworks will unlock exciting opportunities
11:03
for developers to create truly unique experiences. We're also making it easier for people to create new spatial content
11:11
for Apple Vision Pro, like spatial video. We've made it so easy to capture spatial video anywhere
11:17
with iPhone 15 Pro and iPhone 15 Pro Max.
11:24
It's one of the best ways to relive meaningful moments in your life.
11:30
Spatial video can also be used by pro videographers to tell powerful brand, product, and creative stories.
11:38
To make creating and sharing spatial videos with commercial audiences easier, Canon will offer a brand-new spatial lens for their popular EOS R7 digital camera.
11:49
It can record gorgeous spatial video for Apple Vision Pro, even under the most challenging lighting conditions.
11:56
Spatial videos can then be edited in Final Cut Pro for Mac and shared and viewed in the new Vimeo app for visionOS.
12:03
This new professional workflow will be available this fall. Last year, we also introduced Apple Immersive Video,
12:12
a game-changing entertainment format created just for Vision Pro. Apple Immersive Videos are 180-degree, 8K recordings with Spatial Audio
12:22
that give you mind-blowing experiences with lifelike fidelity. It truly feels like you are there.
12:31
To enable creators to bring their own stories to life with Apple Immersive Video, we've partnered first
12:37
with Blackmagic Design, a leading innovator in creative video technology, to build a new production workflow consisting of Blackmagic cameras,
12:46
DaVinci Resolve Studio, and Apple Compressor. These will all be available to creators later this year.
12:53
And there's new Apple Immersive Video content on the way, including a new extreme sports series with Red Bull,
13:01
reimagined experiences from the world's biggest artists like The Weeknd,
13:06
and our first scripted Apple Immersive short film, "Submerged," from Oscar-winning director Edward Berger.
13:12
These titles and more will be available on the TV app. So that's what's coming to Apple Vision Pro and visionOS.
13:21
visionOS 2 introduces a new way to turn your favorite photos into spatial photos,
13:27
new intuitive gestures, a big boost to productivity with Mac Virtual Display,
13:32
powerful new developer APIs, and so much more. Now, back to Tim.
13:39
Tim: As you can see, we're continuing to push visionOS forward as well as providing
13:45
new content and capabilities for Apple Vision Pro. I've been hearing from people all over the world about their interest
13:52
in this incredible product. So I'm happy to announce we're bringing Apple Vision Pro
13:58
to these eight countries next, starting with China, Japan, and Singapore on June 28.
14:05
And Australia, Canada, France, Germany, and the United Kingdom on July 12.
14:11
Now, here's Craig to tell you all about what's coming in iOS. ♪ ♪
iOS
14:33
Craig: iOS 18 is a big release that delivers more ways to customize your iPhone,
14:38
stay connected, and relive special moments. First, let's talk about a set of features that give you exciting new ways
14:47
to personalize your iPhone further, starting with your Home Screen. You can already customize your Home Screen with your favorite wallpaper,
14:54
apps, and widgets, letting your personality shine through. And now, your app icons and widgets can add even more.
15:04
Let me show you. I have this photo I love as my wallpaper.
15:09
And now I can continue to enjoy it when I unlock my iPhone, because I can arrange my apps and widgets to frame it perfectly.
15:17
I can select them all and easily place them along the bottom, right above the Dock for easy access,
15:25
or even off to the side. And check this out!
15:30
We have an awesome new look for app icons when we go into Dark Mode. Let's turn it on.
15:38
Isn't that cool? Now, in addition to this new dark look, there are even more new ways to adjust how they look.
15:46
I can bring up a new customization sheet, and now I can tint them all with color.
15:54
iOS suggests a tint color that complements my wallpaper. Or I can select any other color I want.
16:06
Now they really pop. It's so easy to create just the right look.
16:12
Whether you prefer the classic look, or want to go dark, or style with color, there are so many possibilities to make your Home Screen truly your own.
16:21
We're also bringing new levels of customization and capability to Control Center,
16:27
helping you access many of the things you do every day even faster. Let's take a look.
16:33
When I swipe from the top-right corner, I can see Control Center, with all my controls organized in one place.
16:41
And now Control Center isn't limited to just the controls you see here. I can swipe to multiple new groups of controls,
16:48
like for Media Playback. You can see how beautiful this looks. And here are my Home Controls.
16:55
It's so useful to have everything arranged for me like this. Oh, that shouldn't be open. Let me close the garage.
17:04
And what's really great is, I can get to any one of these groups with a single, continuous swipe.
17:11
I can get straight to my Home Controls, for instance, or right back up to the top.
17:17
To add more controls, I can open up the new Controls Gallery,
17:22
where I have so many options to choose from. We wanted to make Control Center more extensible than ever.
17:28
So now, developers can include controls from their apps as well! Like this one from Ford.
17:35
Let's add that in. I can adjust how my controls are laid out and resize them too.
17:43
Now I can cool down the car just like that.
17:49
So that's the new Control Center! To enable new controls in Control Center, we have a new Controls API for developers.
17:57
And that's not all. These new controls are also available from the Lock Screen, so you can swap the camera and flashlight for different controls,
18:05
like taking a note when an idea strikes, or quickly capturing the moment for your Snapchat.
18:11
And you can even use the Action button on iPhone 15 Pro to invoke these new controls.
18:18
Another key part of personalizing iOS is about keeping you in control of your privacy.
18:25
And iOS 18 gives you even more ways to control who can see your apps, how you share your contacts, and how you connect to accessories.
18:34
Let's start with apps. Sometimes we hand our device to someone so they can look at a photo or play a game,
18:42
but we want peace of mind that they can't get into sensitive areas of our phone. So this year, we're giving you a new way to protect sensitive apps
18:50
and the information inside them, by letting you lock an app. When you choose to lock an app, if someone else tries to tap it,
18:58
they will be required to authenticate using Face ID, Touch ID, or your passcode.
19:03
And information from inside the app won't appear in other places across the system, like in search and notifications,
19:11
so others won't inadvertently see sensitive information. There may also be occasions when you want to hide an app
19:17
that you don't want others to know is installed on your device. For example, say you use a professional grade spatial capture app
19:25
to track your different hairstyles. I mean, that's just good science, right? Well, anyway, say you use this app, but you don't want anyone else to know.
19:34
Well, now you can hide it and put it in a new hidden apps folder that's locked.
19:41
We're also adding new ways to control how you share information with apps, starting with contacts.
19:47
Today, when you give an app access to your contacts, it can learn about all the people you've added over time.
19:53
In iOS 18, we're putting you in control by letting you decide which contacts an app can see.
20:00
We're also putting you in control when you pair accessories. An app may ask for Bluetooth and local network access
20:08
but also gain visibility to all the other devices on your network, from your computers and TVs
20:14
to your door locks and blood pressure monitor. Now, developers can offer you an intuitive new way to pair your accessories
20:21
that keeps your devices private and makes pairing seamless. Next up, we have big enhancements to the apps we use to stay connected,
20:30
starting with Messages. To tell you more, here's Ronak.
20:37
Ronak Shah: Messages is central to how we communicate with the most important people in our lives, so in iOS 18, we're giving you all-new ways
20:45
to express yourself and stay connected. Let's start with Tapbacks.
20:51
Tapbacks are one of the most popular ways to express yourself in Messages. And people love them.
20:57
This is a huge year for Tapbacks. We've not only redesigned your favorites.
21:02
We're now giving you limitless ways to express yourself by letting you Tapback with any emoji or sticker.
21:08
Next, we're bringing one of your most requested features to Messages. When you don't want to forget to send that friendly reminder
21:16
or birthday text in the morning, you can schedule your message to Send Later.
21:21
We're also giving you more ways to express your tone with text formatting. Bold, italicize, underline, or strike through any text.
21:30
And when formatting is not enough, we're introducing a new way to visually amplify your messages with text effects!
21:36
Whether you want to emphasize some major news, bring your emoji to life, or you're just blown away by a stunning photo,
21:44
you can express yourself in all-new ways with text effects. Some words and phrases automatically surface a suggestion,
21:52
so you can quickly select one and send it. And you can also add one of the many new effects to any text.
22:02
Last, there's a new way to stay connected whenever you don't have Wi-Fi or cellular service.
22:08
We're using the same groundbreaking technology that gave us Emergency SOS via satellite to bring you Messages via satellite.
22:16
Now you can use the satellite capabilities on iPhone 14 and later to connect to satellites hundreds of miles above the Earth
22:23
to text your friends and family when you're off the grid all right from the Messages app. Once you've connected, you'll be able to use key iMessage features
22:31
like sending and receiving messages, emoji, and Tapbacks. Because iMessage was built to protect your privacy,
22:38
iMessages sent over satellite are end-to-end encrypted. And if you need to text people not on iMessage,
22:45
we're supporting SMS messaging via satellite too. Now, let's talk about another app we use to communicate, Mail.
22:54
This year, we're giving you a new way to stay in control and manage incoming email with on-device categorization
23:00
that organizes your messages and helps you stay up to date across all of your accounts.
23:06
The Primary category enables you to focus on what matters most-- emails from people you know and time-sensitive messages.
23:14
The rest of your email will be organized into new categories like Transactions, for receipts and order confirmations,
23:20
Updates, for newsletters and social media notices, and Promotions, for marketing and sales messages.
23:26
And these categories do more than just sort your email. We've also created an elegant new digest view
23:32
that pulls together all the relevant emails you've received from a business to make interacting with these messages even easier.
23:39
For instance, it can bring together all of your flight information from United, so you can get to it in one place.
23:45
You can quickly scan snippets of each message to see what's new and explore what you're interested in.
23:50
If you want a sender to appear in another category, you can recategorize them with just a few taps.
23:56
Archiving or deleting all of the messages from a business is just as easy. And of course, you can always see all of your emails in one place.
24:06
Categorization will be available later this year. And now, back to Craig.
24:13
Craig: iOS 18 also includes some great updates to apps and features you use every day.
24:19
Let's walk through a few of them, starting with Maps. Maps delivers new topographic maps
24:25
with detailed trail networks and hiking routes, including all 63 U.S. national parks,
24:31
that can be saved to your phone and accessed offline with turn-by-turn voice guidance and the ability to create your own hikes.
24:39
Next, Wallet. Continuing on our journey to replace your physical wallet,
24:44
we're introducing Tap to Cash, a quick and private way to exchange Apple Cash
24:50
without sharing phone numbers or email addresses. With Tap to Cash, you can pay someone back for dinner
24:56
just by holding your phones together. We're adding two new ways to pay with Apple Pay Online,
25:02
giving customers around the world the ability to redeem rewards and access installments from their banks and card providers.
25:08
And event tickets are getting a beautiful new design and new features, including an all-new event guide
25:16
combining helpful information about the venue, with smart recommendations from your favorite Apple apps.
25:22
We also have updates to Journal that let you log your state of mind and help you keep track of your goals with an insights view
25:30
that shows your writing streaks, a calendar, and other fun stats. And you can now use Search to quickly find the past entries you're looking for.
25:40
We're also excited to announce an update with great improvements for gamers.
25:45
Game Mode is coming to iPhone, enabling a more immersive experience with games like "Zenless Zone Zero."
25:52
Just like on Mac, Game Mode minimizes background activity to sustain the highest frame rates, especially during long play sessions,
26:01
and it dramatically improves responsiveness with AirPods and wireless game controllers.
26:06
Finally, we have some big news for an app where we relive our most precious memories and adventures, Photos.
26:15
Our photo libraries contain all of the big and small moments in our lives. But as we capture so much, and our libraries grow bigger by the day,
26:24
how can we keep it all organized so we can appreciate all of those moments and easily get to the good stuff?
26:30
iOS 18 brings the biggest redesign ever to the Photos app.
26:36
To tell us more about the all-new design, here's Chelsea.
26:42
Chelsea Burnette: The new Photos app keeps your library organized and makes it super easy to find photos fast,
26:47
so you can spend less time searching and more time enjoying your memories. Let me show you.
26:53
This new design is gorgeous, feels familiar, and it puts everything you want right at your fingertips.
26:59
The app has been unified into a single view, with the photo grid at the top, and your library organized by theme below.
27:07
The photo grid is a great place to view your entire library. When you want to quickly jump back to specific dates,
27:14
you can use Months and Years views at the bottom. I have a lot in my library, so it's great that this filter button
27:21
lets me quickly narrow it down to specific types of content. And now I can even filter out screenshots, to enjoy my photos clutter-free.
27:30
We know that it can be tough to keep our ever-growing libraries organized, so we've built on the amazing intelligence in the Photos app
27:38
and created a space below the grid that makes it easy to access the photos you care about most.
27:44
We call these Collections. With Collections, you can browse by topics like time, people, my favorite memories,
27:54
new ones like Trips, and more. Let's go back and check out Recent Days.
27:59
Recent Days organizes photos by each day with clutter, like receipts, filtered out.
28:05
Here are my photos from earlier today. You'll see an autoplaying view of all the photos at the top.
28:11
I can swipe between days like this to see my hike yesterday. I can view the photos as a beautiful collage,
28:19
and I can share the whole Collection with just a tap right here. When I want to find a specific person in my library, I head to People & Pets.
28:29
And it now includes my favorite groups of people for the first time! Here's me with my husband Don
28:36
and with my best friends. The new Trips section gathers all your memorable adventures in one place.
28:42
I love that they autoplay so I can remember my trips while I browse. I can quickly jump back in time and revisit a trip
28:50
like this one to Patagonia in 2021. Since everyone's photo library is unique, Photos is now customizable
28:59
so you can elevate the topics that are most important to you. You can reorder Collections to put them in the order you like.
29:06
I've put Pinned Collections right here. It's where I can keep things I access frequently
29:11
like Favorites, photos I've recently saved, the places I've been, and even an album of my favorite climbs.
29:18
And we have one more new space to make the Photos app your very own and enjoy your best moments.
29:24
If you swipe right from the grid, you'll find the new Carousel, which highlights your best content in a beautiful, poster-like view.
29:32
Photos you've marked as Favorites are here, and so are Featured Photos surfaced by the app.
29:38
And you can customize this too. Here, I've added a favorite trip to Crater Lake.
29:45
Each day, the Carousel surprises you with a new set of photos to enjoy for each of these.
29:50
And that's a quick peek at the new Photos app. Now, back to you, Craig!
29:55
Craig: So that's iOS 18, a big release that brings deeper customization to iPhone,
30:02
new ways to stay connected in Messages and Mail, enhancements to privacy, and the biggest Photos redesign ever,
30:11
making it even easier to relive those special moments! And so much more,
30:16
including an option for larger icons on the Home Screen, RCS messaging support, and Reminders integration in Calendar!
30:24
Next, I'll hand it over to Ron to tell us the latest in Audio and Home.
30:29
♪ ♪
Audio & Home
30:44
Ron Huang: Whether you're on the go, or at home, we have some great new features that bring more convenience
30:50
to the things you do every day and elevate the entertainment experience for everything you watch.
30:56
So let's start off with AirPods, which are the most loved headphones in the world with an incredible audio experience.
31:04
This year, we're making it even easier to interact with Siri for a seamless hands-free experience.
31:10
For those instances when you may not want to speak out loud in response to Siri, like on the bus to work or in those places that are a little too crowded,
31:20
we've created the ability to simply nod your head "yes" or gently shake your head "no" to interact.
31:28
[phone ringing] Siri: Call from Gam Gam. Answer it?
31:34
Okay. Ron: AirPods are also perfect for staying in touch with friends and colleagues, by taking calls anywhere, even in windy conditions
31:43
or places with loud background noise. So to ensure your voice will sound crystal clear, no matter your environment,
31:50
we're bringing Voice Isolation to AirPods Pro. Powered by advanced computational audio
31:56
Voice Isolation removes the background noise around you, to deliver the best call quality.
32:02
Siri: Call from David. Answer it? - Oh, hey. Was just about to call you. The meeting went so well.
32:10
Also, sorry, it's really noisy. Can you hear me okay? - That's amazing news, and yeah. I can hear you totally fine.
32:17
Ron: AirPods are also great while playing games, thanks to their exceptional audio quality.
32:22
To level up this experience, we're expanding Personalized Spatial Audio to include gaming, so that you'll be
32:28
in the middle of the action like never before. We've built a new API so game developers
32:34
can easily deliver the most immersive listening experience. And we're excited to announce that "Need for Speed Mobile"
32:41
by Tencent Games and EA will be one of the first titles with Personalized Spatial Audio coming this fall.
32:48
Now let's turn to Home and tvOS.
32:54
This year, we're introducing some updates that make watching TV even more enjoyable.
32:59
First, let's talk about those moments when we've all wondered, "Where have I seen this actor before?"
33:05
or, "Hey, what's that song?" For these times, we have a new feature we're bringing to Apple TV+.
33:11
It's called InSight. When you're watching an Apple Original show or movie, just swipe down on the remote and InSight will show
33:18
the actors and their character names in real time. And if you're curious about the song playing,
33:24
you can quickly see the track and add it to an Apple Music playlist to enjoy later.
33:30
InSight will also be available when using iPhone as your remote, perfect for when you're watching with others.
33:36
Next, let's turn to the audio experience on tvOS. We're bringing Enhance Dialogue to more living rooms,
33:43
with support for TV speakers and receivers, along with AirPods and other Bluetooth devices.
33:49
And Enhance Dialogue now uses machine learning for even greater vocal clarity,
33:55
ensuring that the actors' dialogue will always cut through. - Go, go, go, go, go! - Rory, you are driving recklessly.
34:02
- I'm in the middle of a high-speed car chase. - Rory, you're in crisis. - No, I'm not.
34:08
The situation is a crisis. I'm fine. Ron: We're also making subtitles more convenient.
34:13
With many of us turning to subtitles more often, they'll now appear at just the right times, like when you mute the volume or when you skip back.
34:29
Ron: Now let's talk visuals. Apple TV has always delivered a theater-like experience to the home.
34:36
And this year, we're adding to the experience with support for 21 by 9 projectors!
34:41
With 21 by 9, you'll be able to view widescreen movies exactly as the directors intended.
34:47
And in between movies, you can enjoy amazing and visually interesting screen savers
34:52
on Apple TV. We're making it even easier to choose what plays, including a brand-new Portraits category with stunning color effects
35:00
and image segmentation, framing your photos like art in a gallery. Or switch to TV and Movies
35:07
and enjoy moments from Apple TV+ shows you love like this one from "Foundation." We're also adding one more really cool screen saver
35:15
as Snoopy and Woodstock take over the screen. Whenever your Apple TV becomes idle,
35:20
Snoopy springs to life with delightful animations. We're thrilled to bring everyone's favorite beagle to your living room!
35:28
So that's Audio and Home, bringing you more convenient ways to interact with AirPods, new entertainment experiences
35:35
with Apple TV, and there's more. Like a redesigned Apple Fitness+ experience
35:40
that's perfect for the big screen. Next, here's David to tell you about watchOS.
35:46
♪ ♪
watchOS
36:01
David Clark: My Apple Watch always motivates me to stay active. And this year will be no different. watchOS 11 introduces more great features
36:08
to not only keep you active but also healthy and connected. To help you stay active, let's first take a look at an exciting new feature
36:15
that can transform the way you work out, whether you are training for something like your first 5K or your fastest marathon.
36:22
In watchOS 11, we're introducing Training Load, an insightful way to measure how the intensity and duration
36:28
of your workouts are impacting your body over time. To track intensity, we designed a new way to rate your workouts.
36:35
Using calorimetry data, like heart rate, pace, and elevation, plus your personal data, like age and weight,
36:43
a powerful new algorithm automatically translates our sensor data into an estimate of your Effort rating.
36:49
After your workout, you can review the rating on the Summary page, ranging from 1, easy, to 10, all out.
36:56
And you can even adjust your Effort rating up or down to get it just right. Your Effort rating and workout duration are then used
37:03
to calculate your Training Load. You'll be able to see if you're holding steady, above your average and can safely progress and improve,
37:11
or when you're well above your average and should pay close attention to better avoid exhaustion or injury.
37:17
We think Training Load will help enthusiasts and elite athletes get to the next level with data, insights,
37:24
and motivation they need to make the best decisions about their training. And we've now made it even easier for everyone to gain more insights
37:33
from the Fitness app on iPhone by giving you the ability to customize the Summary Tab to show the information you want to see,
37:39
including new metrics like weekly running distance. The personalization even extends to your Activity rings
37:45
where you can now adjust your goals by the day of the week. Or if you have an injury that's making it harder to close your rings,
37:52
or maybe you just need a day off, you can pause them, for a rest day, week, or more and keep your award streak going!
37:59
Those are some of the new ways watchOS11 will help keep you active. And now here's Sumbul to tell you about a new app
38:06
that will give you a better picture of your health. Dr. Sumbul Ahmad Desai: Understanding how your body responds
38:12
and recovers from exercise and other aspects of your life is an important part of your overall health.
38:18
Because Apple Watch can track key vitals while you sleep, like heart rate, respiratory rate, and wrist temperature,
38:23
it can give you a deeper understanding of your body and help you identify when something might be off.
38:29
So with watchOS 11, these metrics are the foundation of the insightful new Vitals app
38:35
where you can check in on your daily health status, and explore your most important health metrics with just a glance.
38:42
You can also see how your metrics relate to your typical range, which is determined from your own historical information
38:48
and an algorithm developed using real-world data from the Apple Heart and Movement Study. For additional insights, your metrics will be highlighted
38:55
when they are outside of your typical range with details on what's changed over the last week.
39:01
And when multiple metrics are out of range, you will be notified with a tailored message to help you understand
39:07
how these changes may be linked to other aspects of your life, such as alcohol, elevation changes, or even illness.
39:13
And that's the Vitals app, a new way to quickly view your most important health metrics, receive alerts when it's time
39:20
to pay more attention to your body, and gain better context when it comes to your health.
39:26
Now let's talk about another time when context about your health matters, which is during pregnancy.
39:32
Cycle Tracking can now show you gestational age to support you during this important time.
39:37
The Health app will display your pregnancy across all charts and prompt you to review things like your high heart rate notification threshold,
39:45
since heart rate often increases during pregnancy. Those are some of the advances in Health.
39:50
And now back to David to tell you what's coming to keep you connected. David: With Apple Watch, you can have quick and meaningful
39:58
interactions right on your wrist, making it so easy to stay connected to the world around you and the people you care about
40:04
without always needing to take your iPhone out of your pocket. Whether it's using Apple Pay to buy your morning coffee or hop on the subway,
40:11
telling Siri to add an item to your grocery list, or replying to a message from a friend,
40:16
you can do it all with just the raise of a wrist. And last year, we introduced the Smart Stack.
40:22
It's another way to keep you connected to important information with just a scroll of the digital crown.
40:27
This year, it becomes even more intelligent by automatically adding new widgets right when you need them,
40:33
like the precipitation widget to alert you before it rains, or the Translate widget for when you're traveling somewhere new.
40:39
Just tap to open the new Translate app on Apple Watch, which uses machine learning models for speech recognition and translation.
40:47
You can now simply dictate to see and hear it right on your wrist! [speaking Korean]
40:52
The Smart Stack also becomes more capable with Live Activities coming to Apple Watch, so you'll have all the details for your favorite events.
41:00
And you can use features like Check In, which lets a friend know you made it back home safely and is now on Apple Watch with additional support for workouts.
41:09
During a late-night run, your friend will know to keep an eye out, and will be updated when you end your workout
41:14
so you both have peace of mind. Developers can also show Live Activities in the Smart Stack,
41:20
so you can see updates in the moment like when your ride is coming for apps like Uber! And with the new Double Tap API, they can also define actions within apps,
41:29
like Sprout Baby Tracker, to log your baby's time asleep without waking them!
41:35
Having access to all of these powerful capabilities right on your wrist makes Apple Watch so indispensable, and being able to customize
41:44
your watch face is one of the ways that makes it incredibly personal to you. With the popular Photos face, there is something special
41:51
about seeing an important person or moment every time you raise your wrist. Now, watchOS 11 will help you find the perfect photos for your watch face.
42:00
Machine learning intelligently identifies, scores, and curates the best photos
42:06
based on facial expressions, aesthetics, and composition. Then, a custom algorithm elegantly frames the image with the time.
42:14
You can select a bold color, choose monotone for a sleek look, or create something that is unique and personal to you.
42:22
That's what's coming in watchOS 11: a redesigned Photos face, a more intelligent Smart Stack, Training Load, the Vitals app,
42:30
new APIs for developers, and so much more, like turn-by-turn directions for walking and hiking routes you've created.
42:38
We're so excited about all the new ways to help you stay connected, active, and healthy.
42:44
Back to you, Craig. ♪ ♪
iPadOS
43:04
Craig: Next, let's talk about iPadOS, which powers our strongest lineup ever,
43:10
including the incredibly thin and powerful iPad Pro and the redesigned iPad Air, now available in two sizes.
43:18
Together with the latest versions of Final Cut Pro and Logic Pro and game-changing accessories like Apple Pencil Pro and Magic Keyboard,
43:27
it creates an experience that's in a category of its own. Our next release, iPadOS 18, starts with features you saw in iOS,
43:36
like new ways to personalize your Home Screen, customize Control Center, and relive special moments in the Photos app.
43:43
iPadOS 18 also brings exciting new ways to get things done,
43:49
reimagined with Apple Pencil, and a big update to apps designed for the distinct capabilities of iPad.
43:56
Apps are fundamental to the iPad experience. In iPadOS 18, we're making them even better,
44:03
starting with a new floating tab bar, which makes it easier to navigate to different parts of an app
44:08
and keeps your content edge to edge in apps like Apple TV. When you want to explore more, the tab bar morphs into the sidebar.
44:17
If you use a specific tab often, you can customize the tab bar to keep your favorites within easy reach.
44:24
This redesigned experience works in apps across the system. We've also made it easier to browse your documents in apps like Pages,
44:32
Keynote, Numbers, and Swift Playgrounds, giving each app a distinct new look.
44:38
And throughout your experience, you'll discover refined animations. You'll notice them as you open files or preview them with Quick Look,
44:46
and they smoothly zoom into view, or when the tab bar elegantly morphs into the sidebar and back.
44:53
Across apps, animations will feel even more responsive. And for developers, all these new elements are
45:00
available as APIs to adopt in your apps too. Now let's take a look at updates to SharePlay and Freeform.
45:08
One of SharePlay's best features is screen sharing! It's a great way to help friends and family from afar,
45:15
and we're making it better in two ways. Now you can tap and draw on your screen
45:20
to point out what they should do on theirs. And if you need to assist more directly, you can ask for permission
45:27
to remotely control their iPad or iPhone.
45:34
- Hope that helps. Craig: And Freeform adds Scenes, an all-new way
45:40
to select sections of a board to present them one by one. Next, I want to talk about a feat that some may have concluded
45:48
must be a mathematical impossibility. That's right, we're bringing Calculator to iPad.
45:55
By leveraging what makes iPad so unique, it makes solving math easier than ever.
46:01
It starts with the Calculator that you know from iPhone, updated to take advantage of the larger iPad display,
46:08
along with some new tricks like history and unit conversions. But the real magic of Calculator on iPad is unlocked
46:15
when you use it with your Apple Pencil, an iPad superpower. Apple Pencil has changed the way you can take notes,
46:22
draw, and even design with iPad. And now, it's changing the way you do math with a feature we call Math Notes.
46:31
Let's see it in action with Jenny. Jenny Chen: I'm so excited to show you the new Math Notes experience.
46:38
I get to it by just tapping the new calculator button right here. And with my Apple Pencil, I'll just start writing out expressions
46:46
like I would on a piece of paper. As soon as I write an equals sign, Calculator immediately solves it for me!
46:54
And even shows me the result in handwriting like my own! When I make a change, the results update live.
47:02
And I can go beyond basic math with all of the same functions from the scientific calculator.
47:08
I can save my Math Notes and come back to them later if I'm working on different things. Like here, where I'm working on a budget
47:16
for my team's upcoming table tennis tournament. Since I'm in Math Notes, I can sum these costs quickly
47:22
by just drawing a line underneath them. It's so natural. Math Notes are also really powerful when it comes to more complex math.
47:32
Here, I have a physics problem my teammate and I are working on. We're calculating the maximum height of a table tennis ball
47:39
when I hit it with different speeds and angles. Math Notes supports variables, so I've declared a few here,
47:45
and there's an expression below, which uses these variables to help me calculate the height.
47:51
What's powerful about variables is that if I change one, like the velocity of my shot, it will change the related results too.
48:01
And if I want to see how this speed impacts the height visually, I can. I'll just put "y equals" in front of this equation.
48:10
And now when I tap the equals sign, I have an option to create a graph.
48:16
And if I'm curious how the height will be impacted by the angle of my shot, I can hover my Pencil over the angle and adjust it
48:24
to see how it affects my graph in real time. It's an easy way to explore equations in math.
48:30
And that's just a quick look at Math Notes in Calculator. Back to you, Craig.
48:36
Craig: Math Notes are perfect for working through a problem set, or just tackling the math we run into day to day.
48:43
And this all works in Notes too. When you need to crunch numbers, Notes has all of the new math capabilities from Calculator.
48:50
Just as we've reimagined math on iPad, we've also reimagined handwriting in Notes
48:57
with a new feature called Smart Script. Notes already has great handwriting features,
49:02
like the ability to select and copy your writing, or even make it straighter. With Smart Script, we're making handwriting your notes smoother than ever.
49:10
It starts with improving the appearance of your writing, as you write. We use a powerful on-device machine learning model
49:18
to re-create your handwriting style from your notes, which unlocks new capabilities.
49:24
Just scribble your thoughts as fast as you have them and Smart Script refines your handwriting as you go.
49:31
It's still your own writing, but it looks smoother, straighter, and more legible. Smart Script further accelerates your writing flow
49:39
by making handwriting just as flexible as typed text. Now you can just paste typed text into a handwritten note,
49:46
and it will appear in your own style. Spell check works just as you would expect and fixes mistakes inline.
49:53
When you decide you need to add to something you've already written, just tap and hold with your Apple Pencil
49:58
and your text will flow out of the way to create more space. If you want to erase something you can just scratch it out.
50:07
Smart Script makes your handwritten notes more effective, fluid, and easier to read.
50:12
And with other enhancements to typed notes, including collapsible sections, it's never been a better time to be a notetaker!
50:20
And that's iPadOS 18, taking the distinct experience of iPad further
50:26
with a big update to apps that makes navigating easier and more responsive, and new ways to work that have been reimagined with Apple Pencil.
50:34
Next, let's talk about macOS. ♪ ♪
macOS
50:53
The all-star combination of the power of Apple silicon and the legendary ease of use of macOS have made the Mac more capable than ever.
51:01
And we're so excited to take macOS to new heights and embark on the next chapter of our journey of productivity and creativity!
51:10
But what should we call it? Well, that brings us once again to the annual escapades
51:16
of our legendary crack marketing team. Distracted briefly from their marathon hacky sack session,
51:22
they stumbled into their minibus and wove a trail toward the Sierras, eventually rolling to a stop in a beautiful national park.
51:31
Staring skyward up the towering trunks surrounding them, they felt a deep kinship with anything that could get that high.
51:39
They knew they'd found their spot. Welcome to macOS Sequoia.
51:45
The incredible features we talked about in iOS 18 and iPadOS 18 are going to be amazing for the ways you use Mac.
51:54
You can be even more expressive in Messages, Math Notes provide a helpful typed experience,
52:01
and you can easily plan a hike in Maps. These new features are terrific on the Mac,
52:07
and macOS Sequoia introduces even more features to help you effortlessly get things done.
52:13
Let's start with Continuity. Continuity helps you do so much more when you use Apple products together.
52:20
It powers some of your favorite features, like Universal Clipboard, Universal Control, and Mac Virtual Display on Apple Vision Pro.
52:28
And macOS Sequoia makes Continuity even more magical. For all those times when we want to use our iPhone,
52:35
only to realize it's tucked away in a bag over in another room, there's a brand-new Continuity feature called iPhone Mirroring.
52:44
With iPhone Mirroring on Mac, I can see what's on my iPhone, and can control it too, all while barely lifting a finger.
52:51
Let me show you how it works. To access my phone, I just click here in my Dock.
52:59
Boom! And there's my iPhone, mirrored in a window right on my Mac.
53:04
I can fully interact with it, all wirelessly. I can see my custom wallpaper. My icons are right where they belong.
53:11
And I can use my phone normally, like swiping through pages of my Home Screen.
53:17
And I can open any of my iPhone apps, like the Philz Coffee app, for a bit of extra energy from my favorite local coffee shop.
53:25
I can use my Mac trackpad to interact with the app. And I can use my Mac keyboard too, like to add special instructions.
53:35
Let's make this ice-cold.
53:42
To make this even more magical, we're bringing iPhone notifications to Mac.
53:49
They appear alongside my Mac notifications and I can even interact with them when I don't have my iPhone handy.
53:55
Here's one from Duolingo. What's neat is, when I click on it, bam!
54:01
I'm taken right into the Duolingo app on my iPhone, so I can practice my Spanish and extend my streak.
54:09
[speaking Spanish] As you can hear, my iPhone's audio even comes through my Mac.
54:17
So you might be wondering what's on my iPhone screen while I'm using iPhone Mirroring.
54:27
It stays locked, so nobody else can access it. And it works seamlessly with StandBy.
54:34
StandBy stays visible, so I can get information at a glance as I use my phone with iPhone Mirroring.
54:40
And iPhone Mirroring makes it effortless to combine the power of my Mac and the convenience of its big screen, with the things I get done on my iPhone.
54:49
I'm using a template in the Unfold app to make a post, and I've got one last video to add.
54:56
On Mac, I've been using Final Cut Pro to stitch some clips together.
55:02
Watch how easy it is to use my devices together.
55:08
I can grab the exported video and just drop it right into the template.
55:15
Perfect! So that's iPhone Mirroring! And macOS Sequoia has fantastic updates to how you arrange your windows,
55:24
share while video conferencing, and organize your passwords. Now, when you drag a window to the edge of the screen,
55:31
macOS automatically suggests a tiled position on your desktop. You can release your window right into place.
55:38
Quickly place tiles side by side, or place them into corners to keep even more apps in your view.
55:44
And new keyboard and menu shortcuts help you arrange your tiles even faster.
55:49
Now, let's talk about video conferencing. When you're on a video call, say goodbye to oversharing with the new presenter preview.
55:58
It lets you see what you're about to share before you share it, and works with apps like FaceTime and Zoom.
56:05
And when you want to express yourself or just hide the laundry behind you, you can now replace your background with some beautiful built-in backgrounds,
56:13
or your own photos! Background replacements use Apple's industry-leading segmentation
56:19
so you look your best while on a call. Now let's talk about how we're building on the foundation of Keychain
56:26
to help you manage your passwords. For over 25 years, we've been adding features
56:31
to make logging in to your accounts easier. And now, we're introducing the Passwords app.
56:37
Passwords makes it easy to access your credentials and have them securely stored, all in one place.
56:43
Everything is organized for you, from your passwords to verification codes to security alerts.
56:50
You can find the app on Mac, iPad, iPhone, Vision Pro, and on Windows, with the iCloud for Windows app.
56:57
All the passwords securely sync across your devices, and if you use AutoFill,
57:03
your passwords will automatically populate in the Passwords app. Now, here's Beth to tell you about Safari.
57:12
Beth Dakin: Safari offers an experience like no other browser on Mac. In macOS Sequoia, Safari is the world's fastest browser,
57:20
enabling you to fly through the web with lightning speed. And it offers up to four hours more battery life
57:26
than Chrome when streaming video. Safari is also a trailblazer in privacy, with industry-leading Intelligent Tracking Prevention
57:35
and private browsing that's actually private. It not only protects your history, it prevents websites
57:40
from seeing what you do while you browse. And it's built on WebKit, which supports the latest
57:46
exciting web technologies and standards. If you missed anything we've added to Safari in the last few years,
57:52
it's time to check it out! Safari has everything you need to feel at home,
57:57
like profiles, translation, and more. And in this release, we're making it even better,
58:03
with easier ways to discover content and streamline your browsing. When you're on a site, Safari can now help you discover
58:10
more about the page with Highlights. Safari uses machine learning to automatically detect
58:16
relevant information and highlight it for you as you browse. Highlights share helpful information, like directions, summaries,
58:24
and quick links to learn more about people, music, movies, and TV shows.
58:29
So if you're planning a trip, you can effortlessly discover a hotel's location and phone number right there.
58:36
You can listen to an artist's music or check out a new show with just a click. And even get a summary, so you can get the gist before reading on.
58:44
Summaries are also integrated into a redesigned Reader. Reader instantly removes distractions from articles,
58:52
and now it can provide a table of contents and includes a helpful summary, right next to the article.
58:58
We're bringing a distraction-free experience to video on the web as well with Viewer.
59:03
When Safari detects a video on the page, Viewer helps you put it front and center, while still giving you full access
59:10
to system playback controls, like AirPlay and Picture-in-Picture, and video automatically moves into Picture-in-Picture if you click away.
59:18
That's a quick look at what's new in Safari. Back to you, Craig. Craig: Let's talk about gaming.
59:25
We're so excited to see more and more game developers embracing the Mac with great games like these,
59:31
including the most recent game of the year, "Baldur's Gate 3," all leveraging Metal 3
59:37
to deliver smooth frame rates, provide high-quality visuals, and take full advantage of Apple silicon.
59:43
Every Mac in the lineup can play today's most cutting-edge games, like "Death Stranding: Director's Cut."
59:49
And so can iPhone 15 Pro and any iPad with an M-series chip.
59:54
And for developers, this creates a unified gaming platform across iPhone, iPad, and Mac,
1:00:01
spanning well over a hundred million devices and growing rapidly.
1:00:06
These devices are capable of playing an entirely new class of games! And with iOS 18, iPadOS 18, and macOS Sequoia,
1:00:14
we continue to deliver features for an even more immersive gaming experience.
1:00:19
And since the introduction of Game Porting Toolkit, developers have been able to bring their games to Apple devices
1:00:25
faster than ever, and gaming enthusiasts can experience more games on the Mac.
1:00:31
And this year, Game Porting Toolkit 2 takes this to the next level, enabling developers to bring
1:00:37
even more advanced games to Mac, with improved Windows compatibility and shader debugging tools.
1:00:43
And it's much easier to bring Mac games to iPad and iPhone with Xcode support
1:00:48
that lets developers unify their game code and shaders across devices. And for players, there's a lot to look forward to.
1:00:56
And that's more games. Like "Frostpunk 2," coming to Mac next month.
1:01:02
"Control," providing a mind-bending story that just looks incredible with ray tracing.
1:01:09
And there's some exciting news from Ubisoft, the developers that released "Assassin's Creed: Mirage"
1:01:15
on iPhone and iPad just a few days ago. To tell you more about what's to come from Ubisoft, here's Marc-Alexis.
1:01:26
Marc-Alexis Côté: At Ubisoft, our mission is to enrich players' lives by creating original and memorable gaming experiences.
1:01:33
We see a huge opportunity to share our passion for games to more players in the Apple ecosystem thanks to the unified gaming platform
1:01:42
with tight integration of Metal and Apple silicon. Just last month, we announced that "Prince of Persia: The Lost Crown"
1:01:50
is coming to Mac, and we unveiled that the next big chapter of "Assassin's Creed" is also coming to Mac on November 15
1:01:59
alongside PCs and consoles. We're so excited about this game
1:02:04
and can't wait for you to experience it on Mac. This is "Assassin's Creed: Shadows"!
1:02:10
We're venturing into feudal Japan, which you can experience from the perspectives of Naoe, a Shinobi assassin,
1:02:18
and Yasuke, a legendary samurai of African origin.
1:02:23
Intricately detailed scenes like this are possible thanks to our next-generation Anvil engine
1:02:28
supporting the latest advancements in Metal, enabling us to leverage the full power of Apple silicon
1:02:35
with a gaming experience that delivers blistering frame rates and high resolutions.
1:02:41
Our next-generation Anvil engine scales performance and quality across the Mac lineup and delivers stunning vistas
1:02:49
embellished with ray tracing. And speaking of Apple Silicon, we're thrilled to announce
1:02:56
that in addition to Mac, "Assassin's Creed: Shadows" will also be coming to iPad!
1:03:01
With Ubisoft's Anvil Engine now supporting the Apple ecosystem, we couldn't be more excited about bringing our biggest titles to Apple devices.
1:03:11
Download and play "Assassin's Creed: Mirage" today. And "Assassin's Creed: Shadows" will be available later this year!
1:03:17
Thank you! Craig: Thanks, Marc-Alexis. We're so excited about these amazing games coming to Apple devices.
1:03:26
And this year, even more games are on the way, creating a stellar lineup of titles to look forward to!
1:03:32
So that's gaming, which wraps up macOS Sequoia. It's a big release that up-levels your productivity and creativity.
1:03:41
You can quickly tile windows for your ideal workspace. A massive update to Safari helps you browse the web distraction-free.
1:03:49
An amazing host of new gaming titles are coming to the Mac. And iPhone Mirroring lets you wirelessly use your iPhone, right from your Mac.
1:03:58
macOS joins the announcements across our platforms. And this is a huge year for developers,
1:04:04
with brilliant new features and APIs coming so they can supercharge their apps and experiences.
1:04:11
Developer betas will be available today. Public betas will be available next month.
1:04:17
And all of our OS releases will be available to users this fall. Back to Tim!
1:04:23
♪ ♪
Apple Intelligence
1:04:30
Tim: At Apple, it's always been our goal to design powerful personal products that enrich people's lives
1:04:37
by enabling them to do the things that matter most, as simply and easily as possible.
1:04:44
We've been using artificial intelligence and machine learning for years to help us further that goal.
1:04:50
Recent developments in generative intelligence and large language models offer powerful capabilities that provide the opportunity
1:04:59
to take the experience of using Apple products to new heights. So as we look to build in these incredible new capabilities,
1:05:07
we want to ensure that the outcome reflects the principles at the core of our products.
1:05:13
It has to be powerful enough to help with the things that matter most to you.
1:05:18
It has to be intuitive and easy to use. It has to be deeply integrated into your product experiences.
1:05:26
Most importantly, it has to understand you and be grounded in your personal context, like your routine,
1:05:34
your relationships, your communications, and more. And, of course, it has to be built
1:05:41
with privacy from the ground up. Together, all of this goes beyond artificial intelligence.
1:05:48
It's personal intelligence, and it's the next big step for Apple.
1:05:54
♪ ♪
1:06:12
♪ ♪
1:06:17
Introducing Apple Intelligence, the new personal intelligence system
1:06:22
that makes your most personal products even more useful and delightful.
1:06:28
To tell you all about it, here's Craig. ♪ ♪
1:06:39
Craig: This is a moment we've been working towards for a long time. We are tremendously excited about the power of generative models.
1:06:47
And there are already some really impressive chat tools out there that perform a vast array of tasks using world knowledge.
1:06:53
But these tools know very little about you or your needs. With iOS 18, iPadOS 18, and macOS Sequoia,
1:07:01
we are embarking on a new journey to bring you intelligence that understands you.
1:07:07
Apple Intelligence is the personal intelligence system that puts powerful generative models right at the core of your iPhone, iPad, and Mac.
1:07:16
It draws on your personal context to give you intelligence that's most helpful and relevant for you.
1:07:22
It protects your privacy at every step. And it is deeply integrated into our platforms and throughout the apps
1:07:30
you rely on to communicate, work, and express yourself. Let's take a closer look at Apple Intelligence
1:07:36
starting with its incredible capabilities. Then, we'll tell you about its unique architecture.
1:07:43
And after that, we'll show you how it elevates so many of your everyday experiences.
1:07:48
Let's begin with capabilities. Apple Intelligence will enable your iPhone, iPad, and Mac
1:07:55
to understand and create language, as well as images, and take action for you to simplify interactions across your apps.
1:08:03
And what's truly unique is its understanding of your personal context. Language and text are fundamental to how we communicate and work.
1:08:11
And the large language models built into Apple Intelligence deliver deep natural language understanding,
1:08:17
making so many of your day-to-day tasks faster and easier. For example, your iPhone can prioritize your notifications
1:08:25
to minimize unnecessary distractions, while ensuring you don't miss something important. Apple Intelligence also powers brand-new Writing Tools
1:08:33
that you can access systemwide to feel more confident in your writing. Writing Tools can rewrite, proofread, and summarize text for you,
1:08:42
whether you are working on an article or blog post, condensing ideas to share with your classmates,
1:08:48
or looking over a review before you post it online. And they are available automatically across Mail,
1:08:54
Notes, Safari, Pages, Keynote, and even your third-party apps. In addition to language, Apple Intelligence offers
1:09:01
a host of capabilities for images. From photos, to emojis, and GIFs,
1:09:07
it's so much fun to express ourselves visually. And now you can create totally original images
1:09:13
to make everyday conversations even more enjoyable. And because Apple Intelligence understands the people in your photo library,
1:09:21
you can personalize these images for your conversations. So when you wish a friend a happy birthday,
1:09:27
you can create an image of them surrounded by cake, balloons, and flowers to make it extra festive.
1:09:33
And the next time you tell Mom that she's your hero, you can send an image of her in a superhero cape
1:09:39
to really land your point. You can create images in three unique styles: Sketch, Illustration, and Animation.
1:09:49
In addition to Messages, this experience is built into apps throughout the system, like Notes, Freeform, Keynote, and Pages.
1:09:59
Another way Apple Intelligence is deeply impactful is its ability to take action across your apps.
1:10:05
The greatest source of tools for taking actions is already in your pocket with the apps you use every day.
1:10:13
And we have designed Apple Intelligence so it can tap into these tools and carry out tasks on your behalf.
1:10:19
So you can say things like, "Pull up the files that Joz shared with me last week," or, "Show me all the photos of Mom, Olivia, and me,"
1:10:28
or, "Play the podcast that my wife sent the other day." We are designing Apple Intelligence to be able to orchestrate these
1:10:35
and hundreds of other actions for you, so you can accomplish more while saving time.
1:10:40
There's one more critical building block for personal intelligence, and that's an understanding of your personal context.
1:10:48
Apple Intelligence is grounded in your personal information and context with the ability to retrieve and analyze the most relevant data
1:10:56
from across your apps, as well as to reference the content on your screen, like an email or calendar event you are looking at.
1:11:04
This can be incredibly useful in so many moments throughout the day. Suppose one of my meetings is being re-scheduled
1:11:11
for late in the afternoon, and I'm wondering if it's going to prevent me from getting to my daughter's play performance on time.
1:11:16
Apple Intelligence can process the relevant personal data to assist me. It can understand who my daughter is, the play details she sent
1:11:24
several days ago, the time and location for my meeting, and predicted traffic between my office and the theater.
1:11:32
Understanding this kind of personal context is essential for delivering truly helpful intelligence.
1:11:39
But it has to be done right. You should not have to hand over all the details of your life
1:11:44
to be warehoused and analyzed in someone's AI cloud. With Apple Intelligence, powerful intelligence goes
1:11:51
hand in hand with powerful privacy. Let me tell you more about its architecture,
1:11:58
and how it is built with privacy at the core. The cornerstone of the personal intelligence system
1:12:04
is on-device processing. We have integrated it deep into your iPhone, iPad, and Mac
1:12:10
and throughout your apps, so it's aware of your personal data, without collecting your personal data.
1:12:16
This is only possible through our unique integration of hardware and software, and our years-long investment
1:12:23
in building advanced silicon for on-device intelligence. Deeply-integrated generative models require immense processing power.
1:12:31
And with our most advanced Apple silicon, the A17 Pro and M-family of chips,
1:12:37
we have the computational foundation to power Apple Intelligence.
1:12:42
This personal intelligence system is comprised of highly-capable large language and diffusion models that are specialized for your everyday tasks,
1:12:50
and can adapt on the fly to your current activity. It also includes an on-device semantic index
1:12:57
that can organize and surface information from across your apps. When you make a request, Apple Intelligence uses its semantic index
1:13:05
to identify the relevant personal data, and feeds it to the generative models so they have the personal context to best assist you.
1:13:12
Many of these models run entirely on-device. There are times, though, when you need models
1:13:18
that are larger than what fits in your pocket today. Servers can help with this. But traditionally, servers can also store your data
1:13:27
without you realizing it, and use it in ways you did not intend. And since server software is only accessible to its owners,
1:13:35
even if a company says it's not misusing your data, you are unable to verify their claim, or if it changes over time.
1:13:41
In contrast, when you use an Apple device like your iPhone, you are in control of your data, where it is stored, and who can access it.
1:13:50
And because the software image for your iPhone is accessible to independent experts, they can continuously verify its privacy.
1:13:58
We want to extend the privacy and security of your iPhone into the cloud to unlock even more intelligence for you.
1:14:06
So we have created Private Cloud Compute. Private Cloud Compute allows Apple Intelligence to flex
1:14:14
and scale its computational capacity, and draw on even larger, server-based models for more complex requests,
1:14:22
while protecting your privacy. These models run on servers we have especially created using Apple silicon.
1:14:29
These Apple silicon servers offer the privacy and security of your iPhone from the silicon on up,
1:14:35
draw on the security properties of the Swift programming language, and run software with transparency built in.
1:14:43
When you make a request, Apple Intelligence analyzes whether it can be processed on-device.
1:14:48
If it needs greater computational capacity, it can draw on Private Cloud Compute, and send only the data that's relevant
1:14:55
to your task to be processed on Apple silicon servers. Your data is never stored or made accessible to Apple.
1:15:03
It's used exclusively to fulfill your request. And just like your iPhone, independent experts can inspect
1:15:11
the code that runs on these servers to verify this privacy promise. In fact, Private Cloud Compute cryptographically ensures
1:15:19
your iPhone, iPad, and Mac will refuse to talk to a server unless its software has been publicly logged for inspection.
1:15:27
This sets a brand-new standard for privacy in AI, and unlocks intelligence you can trust.
1:15:34
So that's a look at the powerful capabilities of Apple Intelligence and its groundbreaking privacy protections.
1:15:42
Now we'd love to show you how it will transform your apps and experiences across iOS 18, iPadOS 18, and macOS Sequoia,
1:15:52
from a big leap forward for Siri, to powerful tools for writing and communication,
1:15:57
and fun visual ways to express yourself. Let's start with Siri. Here's Kelsey to tell you more.
1:16:05
Kelsey Peterson: Today, Siri helps you get everyday tasks done quickly and easily. In fact, Siri users make 1.5 billion voice requests every single day.
1:16:15
Thirteen years ago, we introduced Siri. The original intelligent assistant.
1:16:21
And we had an ambitious vision for it. We've been steadily building towards that vision.
1:16:26
And now, thanks to the incredible power of Apple Intelligence, we have the foundational capabilities to take a major step forward.
1:16:34
So we can make Siri more natural, more contextually relevant, and of course, more personal to you.
1:16:41
Right off the bat, you'll see Siri's got a new look. Let me show you.
1:16:47
When you talk to Siri, you'll notice it's more deeply integrated into the system experience, with this elegant glowing light
1:16:53
that wraps around the edge of your screen. And you can speak to Siri more naturally thanks to richer language understanding capabilities.
1:17:01
Even if I stumble over my words, Siri understands what I'm getting at. What does the weather look like for tomorrow at Muir Beach?
1:17:08
Oh, wait, I meant Muir Woods! Siri: The forecast is calling for clear skies in the morning
1:17:15
near Muir Woods National Monument. Kelsey: Sometimes it takes me a beat to figure out what I actually want to ask Siri,
1:17:21
and now it follows right along. Siri also maintains conversational context,
1:17:27
so I can follow up and say, "Create an event for a hike there tomorrow at 9:00 a.m."
1:17:34
Siri: Hike is scheduled for 9:00 a.m. to 11:00 a.m. on June 11. Kelsey: I didn't have to mention Muir Woods again.
1:17:41
Siri understood what I meant when I said "there." There are also certain times when you might not want
1:17:46
to speak to Siri out loud. What's great is that now, at any time, you have the option to type to Siri.
1:17:54
With just a double tap at the bottom of the screen, I can quickly and quietly ask Siri to set an alarm.
1:18:03
And you can switch between text and voice, communicating in whatever way feels right for the moment.
1:18:08
We're also laying the groundwork for some brand-new ways that Siri will be able to support you,
1:18:14
one of which is its extensive product knowledge. Siri now holds a great deal of information about features and settings
1:18:23
and can answer thousands of questions when you want to know how to do something on your iPhone, iPad, or Mac.
1:18:30
Even if you don't know exactly what a feature is called, you can just describe it and Siri will find the info you're looking for.
1:18:37
Like this: "How can I write a message now and have it be delivered tomorrow?"
1:18:43
Siri understood what feature I was referring to, and now I have step-by-step guidance on how to use the new Send Later feature in Messages.
1:18:50
Everything I've showed you so far will be available from the moment you start using Apple Intelligence.
1:18:55
And over the course of the next year, we will be rolling out more features that make Siri even more personal and capable.
1:19:01
For one, Apple Intelligence will provide Siri with on-screen awareness, so it'll be able to understand and take action
1:19:08
with things on your screen. For example, say a friend texts you his new address. Right from the Messages thread, you can say,
1:19:16
"Add this address to his contact card," and Siri will take care of it.
1:19:21
Siri will also understand more of the things you get done in your apps. And with new orchestration capabilities provided by Apple Intelligence,
1:19:30
Siri will take actions inside apps on your behalf. Siri will have the ability to take hundreds of new actions
1:19:37
in and across apps, including some that leverage our new writing and image generation capabilities.
1:19:44
For example, you'll be able to say, "Show me my photos of Stacey in New York wearing her pink coat," and Siri will bring those right up.
1:19:52
Then you might say, "Make this photo pop," and Siri will enhance it, just like that.
1:19:58
And Siri will be able to take actions across apps, so you could say, "Add this to my note with Stacey's bio,"
1:20:06
and it will jump from the Photos app to the Notes app to make it happen. This is going to bring us closer to realizing our vision
1:20:13
in which Siri moves through the system in concert with you. This is made possible through significant enhancements
1:20:20
that we are making to App Intents, a framework that lets apps define a set of actions for Siri, Shortcuts, and other system experiences.
1:20:29
And this won't be limited to apps made by Apple. For developers, they'll be able to use the App Intents framework
1:20:37
to define actions in their apps and tap into Apple Intelligence too. So you might ask Siri to take a light trails video
1:20:44
in Pro Camera by Moment. Or ask Siri to share a summary of your meeting notes in an email you're drafting to a teammate in Superhuman.
1:20:51
And this is only the beginning. Siri will be able to understand and take more actions in more apps over time.
1:21:00
There's one more set of really cool and useful capabilities coming to Siri.
1:21:05
Thanks to Apple Intelligence, it has awareness of your personal context. With its semantic index of things like photos, calendar events,
1:21:14
and files, plus information that's stashed in passing messages and emails, like hotel bookings,
1:21:20
PDFs of concert tickets, and links that your friends have shared, Siri will find and understand things it never could before.
1:21:29
And with the powerful privacy protections of Apple Intelligence, Siri will use this information to help you get things done
1:21:36
without compromising your privacy. You'll be able to ask Siri to find something
1:21:42
when you can't remember if it was in an email, a text, or a shared note, like some book recommendations that a friend sent you a while back.
1:21:49
Or for times when you're filling out a form and need to input your driver's license, Siri will be able to find
1:21:55
a photo of your license, extract your ID number, and type it into the form for you.
1:22:01
I want to show you one more demo that will give you a sense for how powerful Siri will be
1:22:07
when it draws on the personal context awareness and action capabilities built into Apple Intelligence.
1:22:13
Imagine that I am planning to pick my mom up from the airport, and I'm trying to figure out my timing.
1:22:19
Siri is going to be able to help me do this so easily. Siri, when is my mom's flight landing?
1:22:26
What's awesome is that Siri actually cross-references flight details that my mom shared with me by email with real-time flight tracking to give me her up-to-date arrival time.
1:22:35
What's our lunch plan? I don't always remember to add things to my calendar, and so I love that Siri can help me keep track of plans that I've made
1:22:42
in casual conversation, like this lunch reservation my mom mentioned in a text.
1:22:47
How long will it take us to get there from the airport? I haven't had to jump from Mail to Messages to Maps
1:22:54
to figure out this plan. And a set of tasks that would have taken minutes on my own and honestly probably would have resulted in a call to my Mom
1:23:01
could be addressed in a matter of seconds. That's just a glimpse of the ways in which Siri is going to become
1:23:08
more powerful and more personal thanks to Apple Intelligence. And all of these updates to Siri are also coming to iPad and Mac,
1:23:17
where Siri's new design is a total game-changer. It makes Siri feel seamlessly integrated with your workflow.
1:23:24
Thanks to the capabilities of Apple Intelligence, this year marks the start of a new era for Siri.
1:23:30
Here's Justin to show you more places throughout the system where Apple Intelligence simplifies and accelerates your tasks.
1:23:39
Justin Titi: Apple Intelligence unlocks incredible new ways to enhance your writing, whether you are tidying up your hastily-written class notes, ensuring your blog post reads
1:23:47
just right on Wordpress, or making sure your email is perfectly crafted. Let's use Mail to take a closer look at how the systemwide Writing Tools
1:23:55
can help you communicate even more effectively. Rewrite gives you different versions of what you have written,
1:24:02
so you can choose the one you like best.
1:24:11
This is great for making sure your cover letter for that job you're excited for lands perfectly.
1:24:17
And suggestions are shown inline, so you can go with the combination of flow and wording that works for you.
1:24:23
Rewrite also helps you get the tone right. Have you ever re-read a work email that you just wrote and thought, "Oh, this might not go over well"?
1:24:31
Well, now you can change the tone of that response to your colleague to make it sound more friendly, professional, or concise.
1:24:39
You can also describe how you'd like it rewritten. For example, you can invite your friends to a get-together
1:24:45
with a one-of-a-kind invitation written as a poem. Who could say no to that?
1:24:50
Another way Writing Tools can help you is with Proofread. Say you're emailing your English professor.
1:24:55
With Proofread, you can nail grammar, word choice, and sentence structure to put your best foot forward.
1:25:02
You can review suggested edits and their explanations individually, or accept them all with a click.
1:25:08
And if you are about to email a project status that has gotten quite long, use Summarize to bring out the key points,
1:25:16
and then add them as a TL;DR right at the top. In addition to Mail, you can access Writing Tools systemwide,
1:25:23
nearly everywhere you write, including third-party apps. Apple Intelligence also powers Smart Reply in Mail.
1:25:31
For example, when you need to RSVP to an event, you will now see suggestions for your response based on the email.
1:25:38
If you say you'll be there, Mail identifies questions you were asked in the invite, and offers intelligent selections
1:25:44
so you can quickly choose your responses. Your drafted response incorporates your answers.
1:25:49
So with just a few taps, you're ready to send it off with all the right details. Finally, let's talk about how Apple Intelligence
1:25:57
helps you stay on top of a busy inbox. We all deal with sorting through a ton of email every day.
1:26:04
And now it is easier and faster than ever to browse your inbox. Instead of previewing the first few lines of each email that don't always convey
1:26:12
the most useful information, you can now see summaries, visible right from your email list.
1:26:17
So without even opening the email, you'll know that your team is meeting on Thursday to discuss a new design.
1:26:23
And if you jump into a particularly long email when you're in a hurry, you can tap to reveal a summary at the top of the email
1:26:29
and cut right to the chase. We're also elevating Priority Messages.
1:26:35
Apple Intelligence can understand the content of the emails you receive, determine what's most urgent, and surface it right at the top.
1:26:43
Like a dinner invite for tonight, or a boarding pass for your trip this afternoon. And deep understanding of language extends beyond your inbox into more places,
1:26:54
like your Notifications. First, just like in Mail, your Priority Notifications appear at the top of the stack, letting you know what to pay attention to at a glance.
1:27:03
And to make scanning your notifications faster, they're summarized. So when the group chat is blowing up, you can quickly see
1:27:11
that Savita booked the house and Lia is arriving early, right from your Lock Screen. Apple Intelligence also enables an all-new Focus
1:27:19
called Reduce Interruptions. It understands the content of your notifications to selectively surface only the ones that might need
1:27:27
immediate attention, like a text about today's daycare pickup. From catching up on Priority Notifications,
1:27:33
to staying present and focused with Reduce Interruptions, and refining your words with Writing Tools,
1:27:38
Apple Intelligence helps you save time in so many ways. Now, over to Cyrus to show you how it unlocks new ways to express yourself.
1:27:48
Cyrus Irani: Apple Intelligence enables you to create fun, original images whether you are sprucing up a Keynote for class
1:27:55
or trying to land an idea while collaborating in Freeform. And third-party apps can offer this experience too, like in Craft,
1:28:02
where you can create a delightful image to add to your document. Let's take a closer look at how Apple Intelligence
1:28:08
helps you express yourself visually in Messages. One of the most fun ways to communicate in Messages is with emoji.
1:28:16
But even with thousands of emoji to choose from, there are times when you can't quite find the right one for how you feel.
1:28:23
So we're introducing Genmoji. Leveraging the power of Apple Intelligence,
1:28:29
you can create Genmoji, on-device, right in the Keyboard, and match any moment perfectly.
1:28:36
Just provide a description and you'll see your Genmoji appear right before your eyes, along with more options to choose from.
1:28:42
This is great in those times when you're updating a friend about your relaxing weekend, getting the group chat excited about brunch,
1:28:49
or complaining about the rowdy squirrel right outside your window. And because Apple Intelligence is aware of who's in your photo library,
1:28:57
you can simply pick someone and create a Genmoji that looks just like them! These are perfect for sharing with friends as a sticker,
1:29:04
reacting to messages with a Tapback, and you can even add Genmoji inline in your messages!
1:29:10
Let your imagination run wild as you create just the right Genmoji!
1:29:16
And because it's so much fun to use images to express ourselves, we went even further with a new system experience
1:29:22
we call Image Playground. This is a new way to create playful images in just seconds.
1:29:29
It's so easy to use, and we've built it right into apps like Messages. To get started, you can choose from a range of concepts
1:29:37
like themes, costumes, accessories, places, and more.
1:29:45
When you select them, they get added to your playground. No need to engineer the perfect prompt.
1:29:51
In a few seconds, you'll see Apple Intelligence creates a preview of what your image could look like.
1:29:57
A moment later, you'll see more previews you can swipe through. This all happens on-device!
1:30:03
So you have the freedom to experiment and create as many images as you want. This is great for quickly responding to your friends with just the right image.
1:30:12
When you have a really specific idea in mind, you can just type a description to add it to your playground.
1:30:20
And you can easily adjust which style you want to use
1:30:25
and choose from Animation, Sketch, or Illustration.
1:30:32
Whichever suits the vibe of your conversation. If you change your mind along the way, no problem!
1:30:37
Just switch back and you'll see your previous previews. It's that simple. Since Apple Intelligence understands your personal context,
1:30:45
you'll see suggestions for concepts related to your Messages conversation, including you and people from your Messages thread.
1:30:52
When selected, it uses appearances from Photos to add you, or one of them, to the image you're creating.
1:30:59
♪ ♪
1:31:09
With an intuitive experience to create totally original images, and so many ways to express what you want,
1:31:16
the Image Playground is going to make everyday conversations a whole lot more fun.
1:31:22
In addition to Messages, this experience is also available in apps like Keynote, Pages, and Freeform.
1:31:30
To make it easy to experiment with creating images, we've also built a dedicated Image Playground app.
1:31:36
You can use it to try out Styles, play around with different concepts, and make something to share with friends in other apps or on social media.
1:31:43
And for Developers, they can integrate the new Image Playground experience in their app too, with a new API.
1:31:51
With the Image Playground experience and Genmoji, you can create fun and delightful images right where you need them.
1:31:58
Now, here's Seb to show you more experiences enabled by the powerful capabilities of Apple Intelligence.
1:32:06
Sebastien Marineau-Mes: With the ability to deeply understand and create images, Apple Intelligence unlocks some fantastic new experiences.
1:32:14
Like a brand-new tool in the Notes app that we call Image Wand. Image Wand can transform a rough sketch into a polished image
1:32:22
that complements your notes and makes them more visual. And it's available right in your tool palette.
1:32:28
Suppose you want a better image for your architectural history course. With Image Wand, you can circle your rough sketch
1:32:34
using Apple Pencil to open up an Image Playground within your note. Image Wand uses on-device intelligence to analyze your sketch and words
1:32:43
and creates an image for you. What's really fun is that you can even circle empty space,
1:32:50
and it will pull out context from the surrounding area to suggest the ideal image to go with your note.
1:32:56
It has never been easier to make your notes more visual and engaging.
1:33:01
Apple Intelligence also helps us make the most out of our ever-growing photo libraries. First, we have an update to photo editing.
1:33:10
We've all had that time when we thought we got the perfect shot, then realized later it wasn't quite perfect.
1:33:16
Now, the new Clean Up tool will identify distracting objects in the background, so you can make them disappear,
1:33:22
without accidentally changing your subject. Plus, searching for photos and videos is much more convenient,
1:33:30
because you can now use natural language phrases. So you can search for really specific things,
1:33:35
like "Maya skateboarding in a tie-dye shirt," or "Katie with stickers on her face."
1:33:41
Search in videos is also more powerful, with the ability to find a particular moment in the middle of a video clip.
1:33:48
So you can go right to the relevant segment when you search for that video of Maria cartwheeling on the grass.
1:33:56
Apple Intelligence also makes it so much more delightful to create a Memory Movie.
1:34:02
Today, when you want to use your photos and videos to create a movie yourself, like for your fishing trips with your kids,
1:34:08
it can take hours of work. You have to search through tons of photos to pick out the best ones,
1:34:14
figure out how to arrange them, and hunt for the right music. Now, thanks to Apple Intelligence, it is super easy
1:34:22
to create a memory about the story you want to see. Just type a description, and it can interpret that "learning to fish"
1:34:29
involves things like water, docks, fishing rods, and boats. Using its language and image understanding,
1:34:36
Apple Intelligence picks out the best photos and videos. And then it crafts a storyline with unique chapters
1:34:43
that are based on themes identified from your photos, and arranges them into a movie with its own narrative arc.
1:34:49
So now I can watch a wonderful Memory that starts with my son practicing on the dock, transitions to fishing on the boat,
1:34:58
and finishes with us holding the prize catch. And all of this is set to the perfect song selected from Apple Music.
1:35:06
Like all of Apple Intelligence, these updates to Photos are built on a foundation of privacy, so your photos and videos
1:35:13
are not shared with Apple, or anyone else. With endless possibilities, it is so much fun trying out
1:35:20
different ideas and revisiting our most precious moments. And now, back to Craig.
1:35:29
Craig: Apple Intelligence is truly unique in how it understands you and meets you where you are.
1:35:35
And what you saw here is just the beginning. It enables so many more helpful features.
1:35:40
For example, in the Notes app, you can now record and transcribe audio, to capture detailed notes while staying present in the moment.
1:35:48
And when your recording is finished, Apple Intelligence generates a summary to help you recall the key points at a glance.
1:35:55
Recordings, transcriptions, and Apple Intelligence-powered summaries are also coming to the Phone app.
1:36:02
And when you start a recording in a live call, participants are automatically notified, so no one is surprised.
1:36:08
Apple Intelligence is available for free with iOS 18, iPadOS 18, and macOS Sequoia,
1:36:15
bringing you personal intelligence across the products you use every day.
1:36:20
Still, there are other artificial intelligence tools available that can be useful for tasks that draw on broad world knowledge,
1:36:27
or offer specialized domain expertise. We want you to be able to use these external models
1:36:32
without having to jump between different tools. So we're integrating them right into your experiences.
1:36:38
And we're starting out with the best of these, the pioneer and market leader ChatGPT from Open AI,
1:36:46
powered by GPT-4o. First, we built support into Siri, so Siri can tap into ChatGPT's expertise
1:36:54
when it might be helpful for you. For example, if you need menu ideas for an elaborate meal to make for friends
1:37:00
using some freshly caught fish and ingredients from your garden, you can just ask Siri. Siri determines that ChatGPT might have good ideas for this,
1:37:09
asks your permission to share your question, and presents the answer directly. You can also include photos with your questions.
1:37:16
If you want some advice on decorating, you can take a picture and ask, "What kind of plants would go well on this deck?"
1:37:23
Siri confirms if it's okay to share your photo with ChatGPT and brings back relevant suggestions.
1:37:28
It's a seamless integration. In addition to photos, you can also ask questions related to your documents, presentations, or PDFs.
1:37:36
We've also integrated ChatGPT into the systemwide Writing Tools with Compose.
1:37:42
You can create content with ChatGPT for whatever you're writing about. Suppose you want to create a custom bedtime story
1:37:48
for your six-year-old who loves butterflies and solving riddles. Put in your initial idea and send it to ChatGPT
1:37:55
to get something back she'll love. Compose can also help you tap into ChatGPT's image capabilities
1:38:02
to generate images in a wide variety of styles to illustrate your bedtime story. You'll be able to access ChatGPT for free and without creating an account.
1:38:12
Your requests and information will not be logged. And for ChatGPT subscribers, you'll be able to connect your account
1:38:20
and access paid features right within our experiences. Of course, you're in control over when ChatGPT is used
1:38:27
and will be asked before any of your information is shared. ChatGPT integration will be coming to iOS 18, iPadOS 18, and macOS Sequoia
1:38:36
later this year. We also intend to add support for other AI models in the future.
1:38:41
Now, let's talk about developers, and how they can integrate the experiences powered by Apple Intelligence into their apps.
1:38:50
We have updated our SDKs with new APIs and frameworks. For example, developers can add the Image Playground experience
1:38:57
to their app with just a few lines of code. This means that an app like Craft can help users create images
1:39:03
to make their documents much more visual. And Writing Tools are automatically available within apps that use the standard editable text view.
1:39:11
So without any development effort, an app like Bear Notes can automatically allow users to rewrite, proofread, and summarize notes.
1:39:20
Plus, we are building many more ways for users to take action in apps with Siri.
1:39:26
If a developer has already adopted SiriKit, they'll see immediate enhancements from many of Siri's new capabilities without additional work.
1:39:34
We're also investing deeply in the App Intents framework to connect the vast world of apps with Apple Intelligence.
1:39:41
We're defining new intents across our operating systems and making them available to developers starting with these categories.
1:39:49
These intents are pre-defined, trained, and tested, so they're easy for developers to adopt.
1:39:55
Using new App Intents, an app like Darkroom will be able to use the Apply Filter intent to give users the ability to say,
1:40:02
"Apply a cinematic preset to the photo I took of Ian yesterday." These are just a handful of the updates coming to our platform SDKs
1:40:09
so developers can add intelligent and useful features to their apps. We will share more details in the Platforms State of the Union
1:40:17
later today, like how we are bringing generative intelligence to Xcode for developing apps using Swift and SwiftUI,
1:40:24
with features like on-device code completion, and smart assistance for Swift coding questions.
1:40:30
So that's Apple Intelligence, with tremendous benefits for developers and users.
1:40:37
This is AI for the rest of us, personal intelligence you can rely on at work, home, and everywhere in between.
1:40:45
Apple Intelligence harnesses the power of our most advanced silicon, and will be available on iPhone 15 Pro, and iPad and Mac with M1 and later.
1:40:55
Apple Intelligence will be available to try out in US English this summer.
1:41:00
We are bringing it to users in beta as part of iOS 18, iPadOS 18,
1:41:06
and macOS Sequoia this fall, with some features and additional languages and platforms coming out
1:41:11
over the course of the next year. This is the beginning of an exciting new chapter of personal intelligence.
1:41:18
Intelligence built for your most personal products: your iPhone, iPad, and Mac.
1:41:25
Intelligence grounded in the things that make you, you. And intelligence available to you systemwide,
1:41:32
so you can get things done in the way that works for you. We are just getting started, and I hope you are as excited
1:41:40
as I am for the road ahead. And now, back to Tim.
1:41:45
Tim: Thank you, Craig, and thanks to all of our presenters. It's been an exciting day of announcements.
1:41:53
We shared powerful new features and advancements to our six incredible platforms.
1:41:59
And the introduction of powerful new Apple Intelligence features to iOS 18,
1:42:05
iPadOS 18, and macOS Sequoia make these releases game-changers.
1:42:12
Built in a uniquely Apple way, we think Apple Intelligence is going to be
1:42:17
indispensable to the products that already play such an integral role in our lives.
1:42:23
We have a big week ahead for developers. It kicks off this afternoon with the Platforms State of the Union.
1:42:30
We also have over a hundred technical sessions, live forums, in-depth consultations, and Q&As with Apple engineers.
1:42:39
All of this content is available online, for free, for developers.
1:42:45
We're excited to provide developers with the amazing new OS platforms and technologies we announced today, as well as tools and resources
1:42:54
to help them do the very best work of their lives. Thank you so much for joining us.
1:43:01
Let's have a great WWDC! ♪ ♪


Apple IntelligenceOverviewiOS 18 PreviewiPadOS 18 PreviewmacOS Sequoia Preview
Apple Intelligence Preview
Apple Intelligence

AI for the rest of us.

Coming in beta this fall*

Multiple iPhone devices scroll left-to-right each one showing a different Apple intelligence feature onscreen.












Built into your iPhone, iPad, and Mac to help you write, express yourself, and get things done effortlessly.Draws on your personal context while setting a brand-new standard for privacy in AI.
Apple Intelligence






Write with intelligent new tools. Everywhere words matter.
Apple Intelligence powers new Writing Tools, which help you find just the right words virtually everywhere you write. With enhanced language capabilities, you can summarize an entire lecture in seconds, get the short version of a long group thread, and minimize unnecessary distractions with prioritized notifications.

iPhone and Mac showing Writing Tools


Explore new features for writing, focus, and communication.
UI for Writing Tools with a text field to enter prompts, buttons for Proofread and Rewrite, different tones of writing voice, and options for summarize, key points, table, and list
Transform how you communicate using intelligent Writing Tools that can proofread your text, rewrite different versions until the tone and wording are just right, and summarize selected text with a tap. Writing Tools are available nearly everywhere you write, including third-party apps.

Notifications list on an iPhone highlights Most Important at the top of the stack
Priority notifications appear at the top of the stack, letting you know what to pay attention to at a glance. And notifications are summarized, so you can scan them faster.

iPhone shows inbox in Mail app with important messages at the top and highlighted a different color
Priority messages in Mail elevate time-sensitive messages to the top of your inbox — like an invitation that has a deadline today or a check-in reminder for your flight this afternoon.

An email in the Mail app is shown with a summary you can read at the top.
Tap to reveal a summary of a long email in the Mail app and cut to the chase. You can also view summaries of email right from your inbox.

Phone app is shown with a new record function on a live call. A second iPhone shows a summary of the call based on live audio transcription.
Just hit record in the Notes or Phone apps to capture audio recordings and transcripts. Apple Intelligence generates summaries of your transcripts, so you can get to the most important information at a glance.

iPhone with Reduce Notifications Focus enabled shows a single notification marked "maybe important."
Reduce Interruptions is an all-new Focus that understands the content of your notifications and shows you the ones that might need immediate attention, like a text about picking up your child from daycare later today.

Smart Reply options in the Mail app are shown on an iPhone.
Use a Smart Reply in Mail to quickly draft an email response with all the right details. Apple Intelligence can identify questions you were asked in an email and offer relevant selections to include in your response. With a few taps you’re ready to send a reply with key questions answered.



Delightful images created just for you.
Apple Intelligence enables delightful new ways to express yourself visually. Create fun, original images and brand-new Genmoji that are truly personal to you. Turn a rough sketch into a related image that complements your notes with Image Wand. And make a custom memory movie based on the description you provide.

Custom images are shown in the Message app and the Image Wand feature in Notes is shown on an iPad.



Play
Create expressive images, unique Genmoji, and custom memory movies.
UI of the Image Playground experience shows a colorful image of a brain surrounded by classical instruments and music notation with suggestions for more elements to add to the image
Produce fun, original images in seconds with the Image Playground experience right in your apps. Create an entirely new image based on a description, suggested concepts, and even a person from your Photos library. You can easily adjust the style and make changes to match a Messages thread, your Freeform board, or a slide in Keynote.

Image Playground app is shown on iPad. A custom image in the center is surrounded by different ideas and keywords used to make it.
Experiment with different concepts and try out image styles like animation, illustration, and sketch in the dedicated Image Playground app. Create custom images to share with friends in other apps or on social media.

Preview of a custom Genmoji of someone named Vee based on the prompt, race car driver
Make a brand-new Genmoji right in the keyboard to match any conversation. Provide a description to see a preview, and adjust your description until it’s perfect. You can even pick someone from your Photos library and create a Genmoji that looks like them.

A hand holding Apple Pencil draws a circle around a sketch in the Notes app on iPad.
Image Wand can transform your rough sketch into a related image in the Notes app. Use your finger or Apple Pencil to draw a circle around your sketch, and Image Wand will analyze the content around it to produce a complementary visual. You can even circle an empty space, and Image Wand will use the surrounding context to create a picture.

Cover of a custom new memory based on the description entered in the text field in the Photos app
Create a custom memory movie of the story you want to see, right in Photos. Enter a description, and Apple Intelligence finds the best photos and videos that match. It then crafts a storyline with unique chapters based on themes it identifies and arranges your photos into a movie with its own narrative arc.

A grid of photos based on the search prompt Katie with stickers on her face
Search for photos and videos in the Photos app simply by describing what you’re looking for. Apple Intelligence can even find a particular moment in a video clip that fits your search description and take you right to it.

A hand taps an object in the background of a photo on iPhone to highlight what to clean up
Remove distractions in your photos with the Clean Up tool in the Photos app. Apple Intelligence identifies background objects so you can remove them with a tap and perfect your shot — while staying true to the original image.



The start of a new era for Siri.
Siri draws on Apple Intelligence for all-new superpowers. With an all-new design, richer language understanding, and the ability to type to Siri whenever it’s convenient for you, communicating with Siri is more natural than ever. Equipped with awareness of your personal context, the ability to take action in and across apps, and product knowledge about your devices’ features and settings, Siri will be able to assist you like never before.

Mac, iPad, and iPhone are shown with new Siri features powered by Apple Intelligence


Discover an even more capable, integrated, personal Siri.
A light, colorful glow is barely visible around the edge of an iPhone showing the home screen
Siri has an all-new design that’s even more deeply integrated into the system experience, with an elegant, glowing light that wraps around the edge of your screen.

A text field at the top of keyboard in iPhone says Ask Siri
With a double tap on the bottom of your iPhone or iPad screen, you can type to Siri from anywhere in the system when you don’t want to speak out loud.

An iPhone is shown with step-by-step guidelines on how to schedule a text message to send later
Tap into the expansive product knowledge Siri has about your devices’ features and settings. You can ask questions when you’re learning how to do something new on your iPhone, iPad, and Mac, and Siri can give you step-by-step directions in a flash.

Siri, set an alarm for — oh wait no, set a timer for 10 minutes. Actually, make that 5.

Richer language understanding and an enhanced voice make communicating with Siri even more natural. And when you refer to something you mentioned in a previous request, like the location of a calendar event you just created, and ask ”What will the weather be like there?” Siri knows what you’re talking about.

A notification in the Apple TV+ app reminds you that a contact shared a show recommendation with you
Apple Intelligence empowers Siri with onscreen awareness, so it can understand and take action with things on your screen. If a friend texts you their new address, you can say “Add this address to their contact card,” and Siri will take care of it.

Snippets of information like calendar events, photos, and notes shows the many sources Siri can draw from
Awareness of your personal context enables Siri to help you in ways that are unique to you. Can’t remember if a friend shared that recipe with you in a note, a text, or an email? Need your passport number while booking a flight? Siri can use its knowledge of the information on your device to help find what you’re looking for, without compromising your privacy.

Photos library is shown on an iPhone along with a search description. A second iPhone is open to a single photo favorited based on the search. A third iPhone shows the photo incorporated into a note in the Notes app.
Seamlessly take action in and across apps with Siri. You can make a request like “Send the email I drafted to April and Lilly” and Siri knows which email you’re referencing and which app it’s in. And Siri can take actions across apps, so after you ask Siri to enhance a photo for you by saying “Make this photo pop,” you can ask Siri to drop it in a specific note in the Notes app — without lifting a finger.



Great powers come with great privacy.
Apple Intelligence is designed to protect your privacy at every step. It’s integrated into the core of your iPhone, iPad, and Mac through on-device processing. So it’s aware of your personal information without collecting your personal information. And with groundbreaking Private Cloud Compute, Apple Intelligence can draw on larger server-based models, running on Apple silicon, to handle more complex requests for you while protecting your privacy.

Private Cloud Compute
Your data is never stored
Used only for your requests
Verifiable privacy promise

ChatGPT, seamlessly integrated.
With ChatGPT from OpenAI integrated into Siri and Writing Tools, you get even more expertise when it might be helpful for you — no need to jump between tools. Siri can tap into ChatGPT for certain requests, including questions about photos or documents. And with Compose in Writing Tools, you can create and illustrate original content from scratch.

You control when ChatGPT is used and will be asked before any of your information is shared. Anyone can access ChatGPT for free, without creating an account. ChatGPT subscribers can connect accounts to access paid features within these experiences.

The Compose in Writing Tools feature is shown on a MacBook

New possibilities for your favorite apps.
New App Intents, APIs, and frameworks make it incredibly easy for developers to integrate system-level features like Siri, Writing Tools, and Image Playground into your favorite apps.

Learn more about developing for Apple Intelligence

Apple Intelligence is compatible with these devices.
Apple Intelligence is free to use and will initially be available in U.S. English. Coming in beta this fall.*

iPhone 15 Pro Max
A17 Pro
iPhone 15 Pro
A17 Pro
iPad Pro
M1 and later
iPad Air
M1 and later
MacBook Air
M1 and later
MacBook Pro
M1 and later
iMac
M1 and later
Mac mini
M1 and later
Mac Studio
M1 Max and later
Mac Pro
M2 Ultra
Apple Footer
PRESS RELEASE
June 10, 2024
Introducing Apple Intelligence, the personal intelligence system that puts powerful generative models at the core of iPhone, iPad, and Mac
Setting a new standard for privacy in AI, Apple Intelligence understands personal context to deliver intelligence that is helpful and relevant




https://nr.apple.com/dj4L1U8Tm4

MacBook Pro, iPad Pro, and iPhone 15 Pro show new Apple Intelligence features.
Apple Intelligence — the personal intelligence system for iPhone, iPad, and Mac — combines the power of generative models with personal context to deliver intelligence that’s useful and relevant to the user.
CUPERTINO, CALIFORNIA Apple today introduced Apple Intelligence, the personal intelligence system for iPhone, iPad, and Mac that combines the power of generative models with personal context to deliver intelligence that’s incredibly useful and relevant. Apple Intelligence is deeply integrated into iOS 18, iPadOS 18, and macOS Sequoia. It harnesses the power of Apple silicon to understand and create language and images, take action across apps, and draw from personal context to simplify and accelerate everyday tasks. With Private Cloud Compute, Apple sets a new standard for privacy in AI, with the ability to flex and scale computational capacity between on-device processing and larger, server-based models that run on dedicated Apple silicon servers.
“We’re thrilled to introduce a new chapter in Apple innovation. Apple Intelligence will transform what users can do with our products — and what our products can do for our users,” said Tim Cook, Apple’s CEO. “Our unique approach combines generative AI with a user’s personal context to deliver truly helpful intelligence. And it can access that information in a completely private and secure way to help users do the things that matter most to them. This is AI as only Apple can deliver it, and we can’t wait for users to experience what it can do.”
New Capabilities for Understanding and Creating Language
Apple Intelligence unlocks new ways for users to enhance their writing and communicate more effectively. With brand-new systemwide Writing Tools built into iOS 18, iPadOS 18, and macOS Sequoia, users can rewrite, proofread, and summarize text nearly everywhere they write, including Mail, Notes, Pages, and third-party apps.
Whether tidying up class notes, ensuring a blog post reads just right, or making sure an email is perfectly crafted, Writing Tools help users feel more confident in their writing. With Rewrite, Apple Intelligence allows users to choose from different versions of what they have written, adjusting the tone to suit the audience and task at hand. From finessing a cover letter, to adding humor and creativity to a party invitation, Rewrite helps deliver the right words to meet the occasion. Proofread checks grammar, word choice, and sentence structure while also suggesting edits — along with explanations of the edits — that users can review or quickly accept. With Summarize, users can select text and have it recapped in the form of a digestible paragraph, bulleted key points, a table, or a list.
A user opens the Writing Tools menu while working on an email, and is given the option to select Proofread or Rewrite.
A user opens the Notes app and chooses the Summarize tool for their notes on holistic health.
A user opens the Writing Tools menu while working on an email, and is given the option to select Proofread or Rewrite.
With brand-new systemwide Writing Tools powered by Apple Intelligence, users can rewrite, proofread, and summarize text nearly everywhere they write.
previous
next
In Mail, staying on top of emails has never been easier. With Priority Messages, a new section at the top of the inbox shows the most urgent emails, like a same-day dinner invitation or boarding pass. Across a user’s inbox, instead of previewing the first few lines of each email, they can see summaries without needing to open a message. For long threads, users can view pertinent details with just a tap. Smart Reply provides suggestions for a quick response, and will identify questions in an email to ensure everything is answered.
The Priority Messages feature is shown on iPhone 15 Pro.
The email preview summary feature is shown on iPhone 15 Pro.
The Smart Reply feature is shown on iPhone 15 Pro.
The Priority Messages feature is shown on iPhone 15 Pro.
With Priority Messages in Mail, a new section at the top of the inbox shows the most urgent emails.
previous
next
Deep understanding of language also extends to Notifications. Priority Notifications appear at the top of the stack to surface what’s most important, and summaries help users scan long or stacked notifications to show key details right on the Lock Screen, such as when a group chat is particularly active. And to help users stay present in what they’re doing, Reduce Interruptions is a new Focus that surfaces only the notifications that might need immediate attention, like a text about an early pickup from daycare.
Priority Notifications are shown on iPhone 15 Pro.
The new Reduce Interruptions Focus is shown on iPhone 15 Pro.
Priority Notifications are shown on iPhone 15 Pro.
Priority Notifications surface what’s most important, and summaries help users scan long or stacked notifications to show key details right on the Lock Screen.
previous
next
In the Notes and Phone apps, users can now record, transcribe, and summarize audio. When a recording is initiated while on a call, participants are automatically notified, and once the call ends, Apple Intelligence generates a summary to help recall key points.
iPad Pro shows the ability to record and transcribe audio in the Notes app.
iPad Pro shows the ability to generate a summary from recorded audio.
iPad Pro shows the ability to record and transcribe audio in the Notes app.
In the Notes and Phone apps, users can now record, transcribe, and summarize audio.
previous
next
Image Playground Makes Communication and Self‑Expression Even More Fun
Apple Intelligence powers exciting image creation capabilities to help users communicate and express themselves in new ways. With Image Playground, users can create fun images in seconds, choosing from three styles: Animation, Illustration, or Sketch. Image Playground is easy to use and built right into apps including Messages. It’s also available in a dedicated app, perfect for experimenting with different concepts and styles. All images are created on device, giving users the freedom to experiment with as many images as they want.
The new Image Playground app is shown on iPad Pro.
Easy to use and built right into apps like Messages, Image Playground allows users to create fun images in seconds.
With Image Playground, users can choose from a range of concepts from categories like themes, costumes, accessories, and places; type a description to define an image; choose someone from their personal photo library to include in their image; and pick their favorite style.
Pause playback of video: Image Playground Creation
With Image Playground, users can choose from a range of concepts from categories like themes, costumes, accessories, and places.
With the Image Playground experience in Messages, users can quickly create fun images for their friends, and even see personalized suggested concepts related to their conversations. For example, if a user is messaging a group about going hiking, they’ll see suggested concepts related to their friends, their destination, and their activity, making image creation even faster and more relevant.
iPhone 15 Pro shows how Image Playground works in Messages.
In Messages on iPhone 15 Pro, an Image Playground-generated image shows the user’s mom stylized as a superhero.
iPhone 15 Pro shows how Image Playground works in Messages.
In Messages, users can use Image Playground to quickly create fun images for their friends, and see personalized suggested concepts related to their conversations.
previous
next
In Notes, users can access Image Playground through the new Image Wand in the Apple Pencil tool palette, making notes more visually engaging. Rough sketches can be turned into delightful images, and users can even select empty space to create an image using context from the surrounding area. Image Playground is also available in apps like Keynote, Freeform, and Pages, as well as in third-party apps that adopt the new Image Playground API.
Pause playback of video: Image Wand in the Notes App
With Image Wand in the Apple Pencil tool palette, users can select empty space to create an image using context from the surrounding area.
Genmoji Creation to Fit Any Moment
Taking emoji to an entirely new level, users can create an original Genmoji to express themselves. By simply typing a description, their Genmoji appears, along with additional options. Users can even create Genmoji of friends and family based on their photos. Just like emoji, Genmoji can be added inline to messages, or shared as a sticker or reaction in a Tapback.
A user selects Genmoji options based on the prompt, “Smiley relaxing wearing cucumbers.”
A user selects Genmoji options based on the prompt, “Smiley relaxing wearing cucumbers.”
In Messages, a user is presented with an array of Genmoji options to use as a Tapback.
In Messages, a user is presented with an array of Genmoji options to use as a Tapback.
A user selects Genmoji options based on the prompt, “Smiley relaxing wearing cucumbers.”
By simply typing a description, a Genmoji appears, along with additional options.
previous
next
New Features in Photos Give Users More Control
Searching for photos and videos becomes even more convenient with Apple Intelligence. Natural language can be used to search for specific photos, such as “Maya skateboarding in a tie-dye shirt,” or “Katie with stickers on her face.” Search in videos also becomes more powerful with the ability to find specific moments in clips so users can go right to the relevant segment. Additionally, the new Clean Up tool can identify and remove distracting objects in the background of a photo — without accidentally altering the subject.
Pause playback of video: Photos Clean Up Tool
The new Clean Up tool in Photos can identify and remove distracting objects in the background of a photo — without accidentally altering the subject.
With Memories, users can create the story they want to see by simply typing a description. Using language and image understanding, Apple Intelligence will pick out the best photos and videos based on the description, craft a storyline with chapters based on themes identified from the photos, and arrange them into a movie with its own narrative arc. Users will even get song suggestions to match their memory from Apple Music. As with all Apple Intelligence features, user photos and videos are kept private on device and are not shared with Apple or anyone else.
Three iPhone 15 Pro screens show how users can create Memory Movies.
With Memories, Apple Intelligence can pick out the best photos and videos based on a user’s description, craft a storyline, and arrange it all into a movie with its own narrative arc.
Siri Enters a New Era
Powered by Apple Intelligence, Siri becomes more deeply integrated into the system experience. With richer language-understanding capabilities, Siri is more natural, more contextually relevant, and more personal, with the ability to simplify and accelerate everyday tasks. It can follow along if users stumble over words and maintain context from one request to the next. Additionally, users can type to Siri, and switch between text and voice to communicate with Siri in whatever way feels right for the moment. Siri also has a brand-new design with an elegant glowing light that wraps around the edge of the screen when Siri is active.
A user types to Siri on iPhone 15 Pro.
Now users can type to Siri, and switch between text and voice to communicate with Siri in whatever way feels right for the moment.
Siri can now give users device support everywhere they go, and answer thousands of questions about how to do something on iPhone, iPad, and Mac. Users can learn everything from how to schedule an email in the Mail app, to how to switch from Light to Dark Mode.
On iPhone 15 Pro, Siri answers a user’s question about scheduling a text message.
With onscreen awareness, Siri makes it easy to perform an action related to information on the screen, such as adding an address received in Messages to a friend’s contact card.
With onscreen awareness, Siri will be able to understand and take action with users’ content in more apps over time. For example, if a friend texts a user their new address in Messages, the receiver can say, “Add this address to his contact card.”
Pause playback of video: Siri Adding an Address to Contact Card
Siri can now take hundreds of new actions in and across apps, including finding book recommendations sent by a friend in Messages and Mail.
With Apple Intelligence, Siri will be able to take hundreds of new actions in and across Apple and third-party apps. For example, a user could say, “Bring up that article about cicadas from my Reading List,” or “Send the photos from the barbecue on Saturday to Malia,” and Siri will take care of it.
Siri finds a friend’s book recommendations for an iPhone 15 Pro user.
Siri can now take hundreds of new actions in and across apps, including finding book recommendations sent by a friend in Messages and Mail.
Siri will be able to deliver intelligence that’s tailored to the user and their on-device information. For example, a user can say, “Play that podcast that Jamie recommended,” and Siri will locate and play the episode, without the user having to remember whether it was mentioned in a text or an email. Or they could ask, “When is Mom’s flight landing?” and Siri will find the flight details and cross-reference them with real-time flight tracking to give an arrival time.
Pause playback of video: Siri Intelligence Based on On-Device Information
Siri is able to deliver intelligence that’s tailored to the user and their on-device information, like locating details on an upcoming flight or keeping track of a dinner reservation.
A New Standard for Privacy in AI
To be truly helpful, Apple Intelligence relies on understanding deep personal context while also protecting user privacy. A cornerstone of Apple Intelligence is on-device processing, and many of the models that power it run entirely on device. To run more complex requests that require more processing power, Private Cloud Compute extends the privacy and security of Apple devices into the cloud to unlock even more intelligence.
With Private Cloud Compute, Apple Intelligence can flex and scale its computational capacity and draw on larger, server-based models for more complex requests. These models run on servers powered by Apple silicon, providing a foundation that allows Apple to ensure that data is never retained or exposed.
Independent experts can inspect the code that runs on Apple silicon servers to verify privacy, and Private Cloud Compute cryptographically ensures that iPhone, iPad, and Mac do not talk to a server unless its software has been publicly logged for inspection. Apple Intelligence with Private Cloud Compute sets a new standard for privacy in AI, unlocking intelligence users can trust.
ChatGPT Gets Integrated Across Apple Platforms
Apple is integrating ChatGPT access into experiences within iOS 18, iPadOS 18, and macOS Sequoia, allowing users to access its expertise — as well as its image- and document-understanding capabilities — without needing to jump between tools.
Siri can tap into ChatGPT’s expertise when helpful. Users are asked before any questions are sent to ChatGPT, along with any documents or photos, and Siri then presents the answer directly.
An iPhone 15 Pro user enters a prompt for Siri that reads, “I have fresh salmon, lemons, tomatoes. Help me plan a 5-course meal with a dish for each taste bud.”
On iPhone 15 Pro, Siri replies to a user’s prompt with “Do you want me to use ChatGPT to do that?”
On iPhone 15 Pro, ChatGPT’s results are presented through Siri. The first course — tomato and basil bruschetta — is detailed in a bullet.
An iPhone 15 Pro user enters a prompt for Siri that reads, “I have fresh salmon, lemons, tomatoes. Help me plan a 5-course meal with a dish for each taste bud.”
When a user grants permission, Siri can tap into ChatGPT’s broad world knowledge and present an answer directly.
previous
next
Additionally, ChatGPT will be available in Apple’s systemwide Writing Tools, which help users generate content for anything they are writing about. With Compose, users can also access ChatGPT image tools to generate images in a wide variety of styles to complement what they are writing.
Using the Compose tool in Pages, a user enters a prompt about writing a bedtime story about a 6-year-old named Annie who’s great at solving riddles.
Using the Compose tool in Pages, a user accesses ChatGPT image tools to generate an image. The menu shows a range of styles suggested by ChatGPT: “Add a magical impressionist image,” “Add a photorealistic image of the story,” and “Include a backstory for the caterpillar.”
In Pages, a user’s Compose-generated bedtime story and accompanying image are shown.
Using the Compose tool in Pages, a user enters a prompt about writing a bedtime story about a 6-year-old named Annie who’s great at solving riddles.
ChatGPT will be available in Apple’s systemwide Writing Tools in macOS, which help users generate content for anything they are writing about.
previous
next
Privacy protections are built in for users who access ChatGPT — their IP addresses are obscured, and OpenAI won’t store requests. ChatGPT’s data-use policies apply for users who choose to connect their account.
ChatGPT will come to iOS 18, iPadOS 18, and macOS Sequoia later this year, powered by GPT-4o. Users can access it for free without creating an account, and ChatGPT subscribers can connect their accounts and access paid features right from these experiences.
June 10, 2024

OpenAI and Apple announce partnership to integrate ChatGPT into Apple experiences
Coming to iOS, iPadOS, and macOS later this year.

Editor’s Note: This news was shared at Apple's Worldwide Developer Conference 2024. You can also read about the news here(opens in a new window).

Apple is integrating ChatGPT into experiences within iOS, iPadOS, and macOS, allowing users to access ChatGPT’s capabilities—including image and document understanding—without needing to jump between tools.

Siri can also tap into ChatGPT’s intelligence when helpful. Apple users are asked before any questions are sent to ChatGPT, along with any documents or photos, and Siri then presents the answer directly.

Additionally, ChatGPT will be available in Apple’s systemwide Writing Tools, to help users generate content for anything they are writing about. Users can also tap into ChatGPT image tools to generate images in a wide variety of styles to complement what they are writing.

Privacy protections are built in when accessing ChatGPT within Siri and Writing Tools—requests are not stored by OpenAI, and users’ IP addresses are obscured. Users can also choose to connect their ChatGPT account, which means their data preferences will apply under ChatGPT’s policies.

The ChatGPT integration, powered by GPT-4o, will come to iOS, iPadOS, and macOS later this year. Users can access it for free without creating an account, and ChatGPT subscribers can connect their accounts and access paid features right from these experiences.

We're excited to partner with Apple to bring ChatGPT to their users in a new way. Apple shares our commitment to safety and innovation, and this partnership aligns with OpenAI's mission to make advanced AI accessible to everyone. Together with Apple, we're making it easier for people to benefit from what AI can offer.
Sam Altman, CEO of OpenAI

write a report for apple intelligence. The report should be written in Korean and use the 개조식 문체 style. the title is WWDC 2024 Apple Intelligence with ChatGPT. Give technical details as much as possible. especilly, write more details for ondevice related topic.