LLM/AI Changelog

Today we made Canvas available in 4o by default for all users, Free and Paid. Additionally, we launched a number of new capabilities for canvas, including:
Canvas in GPTs: Canvas can now be used with GPTs when enabled in the GPT creator. This toggle will be enabled for newly created GPTs by default.
Python code execution: You can now execute Python code in a canvas. ChatGPT will take a pass on fixing bugs in your code and provide comments on errors.Canvas shortcut: You can now paste content into ChatGPT and instantly open it in canvas via a shortcut in the upper right corner of the composer.Canvas in Toolbox: Canvas has been added as an option in the toolbox.

Additional premade Gems available for Google Workspace customersWhat:We're excited to announce the launch of a series of new premade Gems, designed to give Gemini for Google Workspace subscribers access to AI-powered expertise across a variety of work related use cases, starting in English. The list of premade Gems includes Hiring consultant, Copy creator, Sales pitch ideator, Sentiment analyzer, and Outreach specialist.Why:Business users need an AI solution with a deeper understanding of core business outcomes, and a focus on formulas, metrics and role profiles. These Gems provide advanced capabilities to help you tackle complex tasks and streamline your workflow.

Additional pre-made Gems available for Google Workspace customersWhat: We're excited to announce the launch of a series of new pre-made Gems, designed to give Gemini for Google Workspace subscribers access to AI-powered expertise across a variety of work related use cases, starting in English. The list of pre-made Gems includes Hiring consultant, Copy creator, Sales pitch ideator, Sentiment analyser and Outreach specialist.Why: Business users need an AI solution with a deeper understanding of core business outcomes and a focus on formulas, metrics and role profiles. These Gems provide advanced capabilities to help you tackle complex tasks and streamline your workflow.

Priority access with Gemini Advanced: Play chess with our new Chess GemWhat:The Chess champ Gem brings a new, conversational way to experience chess within the Gemini app. Explore different openings, banter with your AI opponent, and see if you can beat it in a game. This experimental Gem is available in English in the Gemini web app for Gemini Advanced subscribers via Google One AI Premium Plan.Why:Experience chess in a whole new way! Chess champ lets you test your talent against a language model. Enjoy a full game of chess and chatting.Chess piece SVG images byGreenChess.net, used under CC BY-SA 3.0. No changes were made to the original SVG images.

Priority access with Gemini Advanced: Play chess with our new Chess GemWhat: The Chess champ Gem brings a new, conversational way to experience chess within the Gemini app. Explore different openings, banter with your AI opponent and see if you can beat it in a game. This experimental Gem is available in English in the Gemini web app for Gemini Advanced subscribers via Google One AI Premium plan.Why: Experience chess in a whole new way! Chess champ lets you test your talent against a language model. Enjoy a full game of chess and chatting.Chess piece SVG images byGreenChess.net, used under CC BY-SA 3.0. No changes were made to the original SVG images.

Expanding Workspace extensions to more languages: Keep and TasksWhat:Over the coming days, more users around the world will be able to connect with more apps and services in 9 languages (Korean, Japanese, Spanish, French, German, Bahasa Indonesia, Hindi, Portuguese, and Chinese), letting you set reminders with Google Tasks, make and refine lists with Google Keep, and engage with playlists in YouTube Music.Learn more about extensions.Why:We're continuing to build new ways for Gemini to connect to the apps you rely on every day. Through these extensions, Gemini can coordinate across your apps and take actions for you, better than ever.Read moreabout how Gemini works with your favorite Assistant actions, including details on upcoming improvements.

Expanding Workspace extensions to more languages: Keep and TasksWhat: Over the coming days, more users around the world will be able to connect with more apps and services in 9 languages (Korean, Japanese, Spanish, French, German, Bahasa Indonesia, Hindi, Portuguese and Chinese), letting you set reminders with Google Tasks, make and refine lists with Google Keep, and engage with playlists in YouTube Music.Learn more about extensions.Why: We're continuing to build new ways for Gemini to connect to the apps that you rely on every day. Through these extensions, Gemini can coordinate across your apps and take actions for you, better than ever.Read moreabout how Gemini works with your favourite Assistant actions, including details on upcoming improvements.

We are rolling out the following updates over the next two weeks to all ChatGPT users.
Sidebar redesign
New floating mode added with soft dismiss behaviorRecent conversations are now limited in the sidebar, with an unlimited infinite scroll flyout for all conversationsRecent GPTs & Pinned GPTs are now displayed below conversationsSettings are now always in the bottom of the sidebarA small settings icon was added in larger viewports when the sidebar is not openNew transitions were added to create a more immersive feel
Other updates for ChatGPT on Web
The core underpinnings of the site were revamped, offering much better support for a larger variety of devices and sizesInitiating a new conversation now scrolls it into view at the top of the screenInitiating a new conversation no longer auto scrolls to the bottom while the message is generatingThe sidebar when pinned can now stay open with an active Canvas if enough space is availableA new composer bar layout now fades content underneath it as you scroll with an updated look & feelThe new chat button has been moved to the left of the Model Picker to be easier to accessThe system icon in conversations has been removed to make additional horizontal spaceDALL-E focused view has an updated layoutGPT Creator has an updated layout
Improved Mobile Web Experience
The experience with the on-screen keyboard on mobile devices has been greatly improved across iOS & Android devicesThe new sidebar is always in floating mode and auto closes when switching threadsWe no longer focus the composer on mobile web when switching conversationsAn issue causing scroll to get stuck in certain situations should be resolved

We are rolling out the following updates over the next two weeks to all ChatGPT users.
Sidebar redesign
New floating mode added with soft dismiss behaviorRecent conversations are now limited in the sidebar, with an unlimited infinite scroll flyout for all conversationsRecent GPTs & Pinned GPT's are now displayed below conversationsSettings are now always in the bottom of the sidebarA small settings icon was added in larger viewports when the sidebar is not openNew transitions were added to create a more immersive feel
Other updates for ChatGPT on Web
The core underpinnings of the site were revamped, offering much better support for a larger variety of devices and sizesInitiating a new conversation now scrolls it into view at the top of the screenInitiating a new conversation no longer auto scrolls to the bottom while the message is generatingThe sidebar when pinned can now stay open with an active Canvas if enough space is availableA new composer bar layout now fades content underneath it as you scroll with an updated look & feelThe new chat button has been moved to the left of the Model Picker to be easier to accessThe system icon in conversations has been removed to make additional horizontal spaceDall-E focused view has an updated layoutGPT Creator has an updated layout
Improved Mobile Web Experience
The experience with the on-screen keyboard on mobile devices has been greatly improved across iOS & Android devicesThe new sidebar is always in floating mode and auto closes when switching threadsWe no longer focus the composer on mobile web when switching conversationsAn issue causing scroll to get stuck in certain situations should be resolved

**Model updates:**

- Released `gemini-exp-1121`, an even more powerful experimental Gemini API model.

**Model updates:**

- Updated the `gemini-1.5-flash-latest` and `gemini-1.5-flash` model aliases to use `gemini-1.5-flash-002`.
- Change to `top_k` parameter: The `gemini-1.5-flash-002` model supports `top_k` values between 1 and 41 (exclusive). Values greater than 40 will be changed to 40.

**Model updates:**

* Released `gemini-exp-1121`, an even more powerful experimental Gemini API
model.

**Model updates:**

* Updated the `gemini-1.5-flash-latest` and `gemini-1.5-flash` model aliases
to use `gemini-1.5-flash-002`.

* Change to `top_k` parameter: The `gemini-1.5-flash-002` model supports
`top_k` values between 1 and 41 (exclusive). Values greater than 40 will
be changed to 40.

We’ve updated GPT-4o for ChatGPT users on all paid tiers. This update to GPT-4o includes improved writing capabilities that are now more natural, audience-aware, and tailored to improve relevance and readability. This model is also better at working with uploaded files, able to provide deeper insights and more thorough responses.

Starting today, we’re beginning to roll out Advanced Voice Mode on web (already available on mobile and desktop apps). You can now start a voice chat on chatgpt.com on your desktop and have real-time, natural conversations with ChatGPT while doing tasks like shopping, planning, writing, and brainstorming.We’re starting to roll out to all paid (Plus, Team, Enterprise, and Edu) users today, and expect it to take a few days.

Priority access with Gemini Advanced: Ask Gemini to remember the things you care about, and get help that’s unique to you.What:Starting today, you canask Gemini to rememberyour interests and preferences, whether it’s about your work, your hobbies, or your general aspirations in life. This helps Gemini provide even more helpful and relevant responses, tailored precisely to your needs. Think of it as giving Gemini a user manual, designed by you. You can share info and manage info saved with Gemini either through natural conversation or on the dedicated"Saved Info" page. You’re in control: easily view, edit, or delete any information you’ve shared with Gemini, and Gemini will display when it makes use of your saved info. Define how you want Gemini to interact with you, and it will adapt accordingly, giving you full authority over the information it saves and uses. The experience is available in English with Gemini Advanced as part of the Google One AI Premium Plan.Why:Saving info about your life and work empowers you to shape Gemini and unlock new levels of efficiency and creativity. Get more consistent, predictible results without repeating the same details, maintain control over your data, and experience Gemini that seemingly integrates into your workflow. Whether you’re a writer, developer, student, or someone who simply wants more control, now you can make Gemini truly your own.

Priority access with Gemini Advanced: Ask Gemini to remember the things you care about, and get help that’s unique to you.What:Starting today, you canask Gemini to rememberyour interests and preferences, whether it’s about your work, your hobbies, or your general aspirations in life. This helps Gemini provide even more helpful and relevant responses, tailored precisely
to your needs. Think of it as giving Gemini a user manual, designed by you. You can
share info and manage info saved with Gemini either through natural conversation or
on the dedicated'Saved info' page. You're in control: Easily view,
edit or delete any information that you've shared with Gemini, and Gemini will display
when it makes use of your saved info. Define how you want Gemini to interact with you,
and it will adapt accordingly, giving you full authority over the information that it
saves and uses. The experience is available in English with Gemini Advanced as part of the Google One AI Premium Plan.Why:Saving info about your life and work empowers you to shape Gemini and unlock new levels of efficiency and creativity. Get more consistent, predictable results without
repeating the same details, maintain control over your data and experience Gemini
that seemingly integrates into your workflow. Whether you're a writer, developer,
student or someone who simply wants more control, now you can make Gemini truly your
own.

Starting today, we’re beginning to roll out Advanced Voice Mode on web (already available on mobile and desktop apps). You can now start a voice chat on chatgpt.com on your desktop and have real-time, natural conversations with ChatGPT while doing tasks like shopping, planning, writing, and brainstorming.
We’re starting to roll out to all paid (Plus, Team, Enterprise, and Edu) users today, and expect it to take a few days.

Expanding the Gemini app as a core service with enterprise-grade data protection to more business and education customersWhat:The Gemini app (gemini.google.com) with enterprise-grade data protection is now included inmore Google Workspace editions.Why:By extending access to the Gemini app, more employees, educators and students can save time, deliver higher quality work, and learn confidently with a secure, AI-powered assistant at work or at school.

Try the new Gemini app on your iPhoneWhat:Today, we're launching a dedicated Gemini app on iPhones! Enjoy Gemini Live, create stunning images, easily find information across your favorite Google apps like YouTube, Gmail, Maps, and more. Need help solving a problem? Simply take a picture and ask Gemini questions about it. To get started, download the app from theApp Store.Learn more about language, country, device, and account availability in theHelp Center.Why:We're making it easy to access Gemini on your iPhone, including the latest experiences like Gemini Live and image generation.

Try the new Gemini app on your iPhoneWhat: Today, we're launching a dedicated Gemini app on iPhones! Enjoy Gemini Live, create stunning images, easily find information across your favourite Google apps like YouTube, Gmail, Maps and more. Need help solving a problem? Simply take a picture and ask Gemini questions about it. To get started, download the app from theApp Store.Learn more about language, country, device, and account availability in theHelp Center.Why:We're making it easy to access Gemini on your iPhone, including the latest experiences like Gemini Live and image generation.

Add files when creating your GemsWhat:Gemini Advanced subscribers can now upload files when creating a Gem, equipping the Gem to provide more tailored and contextually relevant responses. Starting in English, this feature is available for Gemini Advanced subscribers via Google One and Google Workspace.Why:Files serve as source material to help your Gems provide accurate and relevant responses. Referencing your files in your Gems can unlock a new level of customization, such as answering questions based on your files, assisting in content creation, or addressing business needs.Launching Gemini to Google Workspace for Education teen studentsWhat:Google Workspace for Education users 13+ (or theapplicable age in their country) can now access the Gemini app with added data protection. Education administrators manage access settings for these users via the Google Workspace Admin console.Why:Google is committed tomaking AI helpful for everyone, in the classroom and beyond. We want to both prepare teens with the skills and tools they need to thrive in a future where GenAI exists and help them learn how this technology can be used to unlock creativity and facilitate learning. Gemini can provide guided support to help students learn more confidently with in-the-moment assistance, practice materials and real-time feedback and ideas.

Add files when creating your GemsWhat: Gemini Advanced subscribers can now upload files when creating a Gem, equipping the Gem to provide more tailored and contextually relevant responses. Starting in English, this feature is available for Gemini Advanced subscribers via Google One and Google Workspace.Why:Files serve as source material to help your Gems provide accurate and relevant responses. Referencing your files in your Gems can unlock a new level of customization, such as answering questions based on your files, assisting in content creation, or addressing business needs.Launching Gemini to Google Workspace for Education teen studentsWhat:Google Workspace for Education users 13+ (or theapplicable age in their country) can now access the Gemini app with added data protection. Education administrators manage access settings for these users via the Google Workspace Admin console.Why:Google is committed tomaking AI helpful for everyone, in the classroom and beyond. We want to both prepare teenagers with the skills and tools that they need to thrive in
a future where GenAI exists and help them learn how this technology can be used to
unlock creativity and facilitate learning. Gemini can provide guided support to help
students learn more confidently with in-the-moment assistance, practice materials and
real-time feedback and ideas.

Expanding Workspace extensions in Beta for Google Workspace customers: Calendar, Keep and TasksWhat:Extensions are the tools that connect Gemini to other apps and services you rely on, letting you pull information and complete tasks directly from Gemini. Users accessing the Gemini app as a core service via their Google Workspace subscription or a Gemini for Workspace add-on can now use the Calendar, Keep and Tasks Workspace extensions in Beta in order to take actions, such as scheduling meetings, directly from the Gemini app.Why:Extensions help provide more contextual and relevant responses to your prompts and take certain actions, enhancing productivity and collaboration with the Gemini app.Access to Imagen 3 now available for Google Workspace customersWhat:Users accessing the Gemini app via their Google Workspace subscription or a Gemini for Workspace add-on can now create stunning images in Gemini with Imagen 3, our highest quality text-to-image model.And starting in English, Gemini for Workspace add-on subscribers unlock the added capability of generating images featuring people, empowering even more variety in your creations.Why:As we continue to build Gemini responsibly, we’re expanding access to more user profiles.Gemini is now SOC 2 and SOC 3 compliant for Google Workspace customersWhat:For Google Workspace users accessing the Gemini app as a core service, Gemini is now SOC 2 and SOC 3 compliant. Awarded by a third party (American Institute of Certified Public Accountants (AICPA)), SOC 2 and SOC 3 compliance ensures that sensitive business data is handled securely.Why:Users can be confident that Gemini meets the industry standard for handling financial data, data security, availability, processing integrity, confidentiality and privacy.

Expanding Workspace extensions in beta for Google Workspace customers: Calendar, Keep and TasksWhat: Extensions are the tools that connect Gemini to other apps and services that you rely on, letting you pull information and complete tasks directly from Gemini. Users accessing the Gemini app as a core service via their Google Workspace subscription or a Gemini for Workspace add-on can now use the Calendar, Keep and Tasks Workspace extensions in Beta in order to take actions, such as scheduling meetings, directly from the Gemini app.Why:Extensions help provide more contextual and relevant responses to your prompts and take certain actions, enhancing productivity and collaboration with the Gemini app.Access to Imagen 3 now available for Google Workspace customersWhat:Users accessing the Gemini app via their Google Workspace subscription or a Gemini for Workspace add-on can now create stunning images in Gemini with Imagen 3, our highest quality text-to-image model.And starting in English, Gemini for Workspace add-on subscribers unlock the added capability of generating images featuring people, empowering even more variety in your creations.Why:As we continue to build Gemini responsibly, we’re expanding access to more user profiles.Gemini is now SOC 2 and SOC 3 compliant for Google Workspace customersWhat:For Google Workspace users accessing the Gemini app as a core service, Gemini is now SOC 2 and SOC 3 compliant. Awarded by a third party (American Institute of Certified Public Accountants (AICPA)), SOC 2 and SOC 3 compliance ensures that sensitive business data is handled securely.Why:Users can be confident that Gemini meets the industry standard for handling financial data, data security, availability, processing integrity, confidentiality and privacy.

Introducing Imagen 3What:Create stunning images in Gemini with Imagen 3, our highest quality text-to-image model yet. Simply describe what you imagine, and watch as your ideas transform into visuals, bursting with vivid details and realism, in seconds.And starting in English, Gemini Advanced subscribers unlock the added capability of generating images featuring people, empowering even more variety in your creations.Why:Your imagination is limitless, and we want to place the power of creativity in your hands. We're also expanding image generation to more countries and languages, so even more people can bring their ideas to life with Gemini. While this model represents a leap forward in image generation quality and accuracy, we're constantly learning and will continue to improve to provide you the best experience possible.

Introducing Imagen 3What: Create stunning images in Gemini with Imagen 3, our highest quality text-to-image model yet. Simply describe what you imagine, and watch as your ideas transform into visuals, bursting with vivid details and realism, in seconds.And starting in English, Gemini Advanced subscribers unlock the added capability of generating images featuring people, empowering even more variety in your creations.Why:Your imagination is limitless, and we want to place the power of creativity in your hands. We're also expanding image generation to more countries and languages, so even more people can bring their ideas to life with Gemini. While this model represents a leap forward in image generation quality and accuracy, we're constantly learning and will continue to improve to provide you the best experience possible.

Gemini can access helpful information from more apps and servicesWhat:Over the coming days, Gemini will connect to more apps and services, letting you set reminders with Google Tasks, make and refine lists with Google Keep, and engage with playlists in YouTube Music. Learn more about extensions.Learn more about extensions.Why:We’re continuing to build new ways for Gemini to connect to the apps you rely on every day. Through these extensions, Gemini can coordinate across your apps and take actions for you, better than ever.Read moreabout how Gemini works with your favorite Assistant actions, including details on upcoming improvements.

Gemini can access helpful information from more apps and servicesWhat: Over the coming days, Gemini will connect to more apps and services, letting you set reminders with Google Tasks, make and refine lists with Google Keep, and engage with playlists in YouTube Music. Learn more about extensions.Learn more about extensions.Why: We're continuing to build new ways for Gemini to connect to the apps that you rely on every day. Through these extensions, Gemini can coordinate across your apps and take actions for you, better than ever.Read moreabout how Gemini works with your favourite Assistant actions, including details on upcoming improvements.

Gemini 1.5 Pro in Gemini Advanced just became more capableWhat:Gemini Advanced, with a chat optimized version of 1.5 Pro-002, now provides better and more accurate responses for prompts related to math and exploring complex topics that invite thoughtful conversation. Whether you’re providing detailed, multi-step instructions, or tackling advanced mathematical calculations, Gemini Advanced will help you navigate these challenges with greater ease.Why:We remain committed to rapid development and delivering the best of Gemini to our users. Through continuous model training and valuable user feedback, we’ve further enhanced the capabilities of Gemini 1.5 Pro, continuing to make Gemini Advanced better over time.Upgrade to Gemini Advanced

Gemini 1.5 Pro in Gemini Advanced just became more capableWhat: Gemini Advanced, with a chat optimised version of 1.5 Pro-002, now provides better and more accurate responses for prompts related to maths and exploring complex topics that invite thoughtful conversation. Whether you’re providing detailed, multi-step instructions, or tackling advanced mathematical calculations, Gemini Advanced will help you navigate these challenges with greater ease.Why:We remain committed to rapid development and delivering the best of Gemini to our users. Through continuous model training and valuable user feedback, we’ve further enhanced the capabilities of Gemini 1.5 Pro, continuing to make Gemini Advanced better over time.Upgrade to Gemini Advanced

Priority access with Gemini Advanced: Upload your code filesWhat:In May, we upgraded Gemini Advanced to a 1 million token context window and added the ability to upload files and get answers and insights about documents. Today, we are adding the ability to upload multiple code files directly from Google Drive or your device to get help understanding, modifying, or debugging your code. We supportmost code file formatslike C, Python, SQL, and more.Why:Elevate your coding experience and accelerate development with Gemini Advanced's 1M token context window, now capable of processing up to 30k lines of code. Get assistance on complex coding questions, saving time and boosting productivity.

Priority access with Gemini Advanced: Upload your code filesWhat: In May, we upgraded Gemini Advanced to a 1 million token context window and added the ability to upload files and get answers and insights about documents. Today, we are adding the ability to upload multiple code files directly from Google Drive or your device to get help understanding, modifying or debugging your code. We supportmost code file formatslike C, Python, SQL, and more.Why:Elevate your coding experience and accelerate development with Gemini Advanced's 1M token context window, now capable of processing up to 30k lines of code. Get assistance on complex coding questions, saving time and boosting productivity.

**Model updates:**

- Released `gemini-1.5-pro-002` and `gemini-1.5-flash-002`, two new stable versions of Gemini 1.5 Pro and 1.5 Flash, for general availability.
- Updated the `gemini-1.5-pro-latest` model code to use `gemini-1.5-pro-002` and the `gemini-1.5-flash-latest` model code to use `gemini-1.5-flash-002`.
- Released `gemini-1.5-flash-8b-exp-0924` to replace `gemini-1.5-flash-8b-exp-0827`.
- Released the [civic integrity safety filter](https://ai.google.dev/gemini-api/docs/safety-settings#safety-filters) for the Gemini API and AI Studio.
- Released support for two new parameters for Gemini 1.5 Pro and 1.5 Flash in Python and NodeJS: [`frequencyPenalty`](https://ai.google.dev/api/generate-content#FIELDS.frequency_penalty) and [`presencePenalty`](https://ai.google.dev/api/generate-content#FIELDS.presence_penalty).

Advanced voice usesGPT-4o’s native audio capabilities and features more natural, real-time conversations that pick up on non-verbal cues, such as the speed you’re talking, and can respond with emotion. Usage of advanced Voice (audio inputs and outputs) by Plus and Team users is limited on a daily basis.

**Model updates:**

* Released `gemini-1.5-pro-002` and `gemini-1.5-flash-002`, two new stable
versions of Gemini 1.5 Pro and 1.5 Flash, for general availability.

* Updated the `gemini-1.5-pro-latest` model code to use `gemini-1.5-pro-002`
and the `gemini-1.5-flash-latest` model code to use `gemini-1.5-flash-002`.

* Released `gemini-1.5-flash-8b-exp-0924` to replace
`gemini-1.5-flash-8b-exp-0827`.

* Released the [civic integrity safety filter](/docs/safety-settings#safety-filters)
for the Gemini API and AI Studio.

* Released support for two new parameters for Gemini 1.5 Pro and 1.5 Flash in
Python and NodeJS:
[`frequencyPenalty`](https://ai.google.dev/api/generate-content#FIELDS.frequency_penalty)
and
[`presencePenalty`](https://ai.google.dev/api/generate-content#FIELDS.presence_penalty).