Today, Samsung unveiled its highly anticipated Galaxy S24, touting advanced AI capabilities that it hopes will reshape fundamental phone functions like communication, creativity, and search. Many of the new AI functionalities are enabled by a strategic Google partnership that leverages Google's state-of-the-art Gemini AI models to power innovative new experiences.
Specifically, the Galaxy S24 series will come built-in with Gemini Nano (Google's smallest and most efficient model) to facilitate on-device processing for certain apps. Gemini Pro will provide better summarization and transcription in Samsung's Notes and Voice Recorder apps. Samsung's Gallery app also leverages Google's Imagen 2 technology to enable clever photo editing features like background completion. Overall, the new Galaxy flagship phones feature an array of AI tools aimed at streamlining everyday tasks.
Most notably, the phones introduce a real-time translation feature called Live Translate for translating conversations during phone calls without third-party apps.
There is a new intelligent messaging feature called Chat Assist, which provides tone suggestions to refine the language in texts and social media posts. AI built into Samsung Keyboard can also translate messages in real-time in 13 languages.
The Galaxy S24 also debuts handy AI-enabled productivity features for notes and voice recordings. Note Assist in Samsung Notes provides auto-generated summaries and suggests templates and formatting to streamline notetaking. Similarly, Transcript Assist leverages speech recognition to automatically transcribe voice recordings, then further summarizes the content and translates it into other languages if needed.
Importantly, using features like Live Translate, Chat Assist, Note Assist and Transcript Assist will require an internet connection (they use Gemini Pro) as well as a Samsung Account login.
The on-device Gemini Nano model will now power features in Google Messages like "Magic Compose" to help you to write messages in different styles, and "Photomoji" to create custom emojis from personal photos.
Additionally, the Galaxy S24 introduce Circle to Search - a new way to get Google search results on any item users highlight or circle on their screens without switching apps. This will also leverage Google's Search Generative Experience to provide overviews with helpful background information pulled from across the web.
Additionally, the phones incorporate AI throughout the camera experience with the updated ProVisual Engine to significantly enhances the photography experience. From stabilizing images to adaptive zoom capabilities, the phones are using AI to push the boundaries of mobile photography. Generative AI can now fill in photo backgrounds when an image needs to be recomposed.
Nightography features and advanced editing tools like Generative Edit and Edit Suggestion further enrich the user experience, and offer new dimensions in capturing and sharing moments.
Finally, Android Auto will now automatically summarize messages and suggest relevant actions like navigation or calls while driving.
With the new generative AI features spanning the OS, apps, and core phone capabilities, Samsung is promising its "most intelligent experience ever" in the new Galaxy flagship series. As people spend time with their new phones, we'll see whether these AI functionalities will evolve into truly integral phone capabilities or fade into gimmicks that are never used and fail to change consumer behaviors.