Every part Google Simply Introduced at I/O 2024 – Video

Speaker 1: Welcome to Google io. It is nice to have all of you with us. Greater than 1.5 million builders use Gemini fashions throughout our instruments. You are utilizing it to debug code, get new insights, and construct the following technology of AI purposes. We have additionally been bringing Gemini’s breakthrough capabilities throughout our merchandise in highly effective methods. We’ll present examples right this moment throughout search, photographs, workspace, Android, and extra.

Speaker 2: At present we [00:00:30] have some thrilling new progress to share about the way forward for AI help that we’re calling Undertaking Astra Constructing. On our Gemini mannequin, we have developed brokers that may course of data sooner by constantly encoding video frames, combining the video and speech enter right into a timeline of occasions and caching this for environment friendly recall.

Speaker 3: Inform me whenever you see one thing that makes sound.

Speaker 4: I see a speaker which makes sound.

Speaker 3: Do you keep in mind the place you noticed my glasses?

Speaker 4: [00:01:00] Sure, I do. Your glasses. Had been on the desk close to a crimson apple.

Speaker 3: What can I add right here to make this method sooner?

Speaker 5: Including a cache between the server and database may enhance velocity.

Speaker 3: What does this remind you of?

Speaker 5: Schrodinger’s cat.

Speaker 2: At present I am excited to announce our latest, most [00:01:30] succesful generative video mannequin known as vo. VO creates top quality 10 80 P movies from textual content, picture and video prompts. It could actually seize the small print of your directions in numerous visible and cinematic kinds. You may immediate for issues like aerial pictures of a panorama or time lapse and additional edit your movies utilizing extra prompts. You should use VO in our new experimental device known as Video fx. [00:02:00] We’re exploring options like storyboarding and producing longer scenes. VO provides you unprecedented inventive management.

Speaker 6: Core know-how is Google Deep Minds generative video mannequin that has been educated to transform enter textual content into output video.

Speaker 7: It seems to be

Speaker 6: Good. We’re in a position to carry concepts to life that have been in any other case not potential. We are able to visualize issues on a timescale that is 10 or 100 instances sooner than earlier than.

Speaker 1: At present [00:02:30] we’re excited to announce the sixth technology of TPUs known as Trillium.

Speaker 1: Trillium delivers a 4.7 x enchancment in compute efficiency per chip over the earlier technology. It is our best and performant TPU At present we’ll make Trillium obtainable to our cloud prospects in late 2024. Alongside our TPUs, we’re proud to supply CPUs and [00:03:00] GPUs to assist any workload that features the brand new axion processes we introduced final month, our first customized ARM-based CPU with trade main efficiency and vitality effectivity, we’re additionally proud to be one of many first cloud suppliers to supply Nvidia innovative Blackwell, GPUs obtainable in early 2025. Probably the most thrilling transformations with Gemini has been in Google search prior to now 12 months. We have answered billions of queries as half [00:03:30] of her search generative expertise. Individuals are utilizing it to look in totally new methods and asking new varieties of questions longer and extra advanced queries, even looking out with photographs and getting again the very best the online has to supply. Now we have been testing this expertise outdoors of labs and we’re inspired to see not solely a rise in search utilization, but in addition a rise in consumer satisfaction. I am excited to announce that we’ll [00:04:00] start launching this totally revamped expertise AI overviews to everybody within the US this week, and we’ll carry it to extra nations quickly.

Speaker 8: Say you are heading to Dallas to have a good time your anniversary and also you’re on the lookout for the proper restaurant. What you get right here breaks AI out of the field and it brings it to the entire web page. Our Gemini mannequin uncovers probably the most fascinating angles so that you can discover and organizes these outcomes into these useful clusters. Such as you would possibly [00:04:30] by no means have thought of eating places with stay music or ones with historic allure. Our mannequin even makes use of contextual components just like the time of the 12 months. So because it’s heat in Dallas, you may get rooftop patios as an concept and it pulls the whole lot collectively right into a dynamic complete web page expertise. You will begin to see this new AI organized search outcomes web page whenever you search for inspiration, beginning with eating and recipes and coming to motion pictures, music, [00:05:00] books, inns, buying and

Speaker 9: Extra. I will take a video and ask Google why will this not keep in place ending a close to prompt. Google provides me an AI overview, I assume some causes this may be taking place and steps I can take to troubleshoot selects like first. That is known as a toner. Very useful and it seems to be like it could be unbalanced and there is some actually useful steps right here and I [00:05:30] love that as a result of I am new to all this. I can take a look at this beneficial hyperlink from Audio Technica to study much more.

Speaker 10: And this summer time you may have an in-depth dialog with Gemini utilizing your voice. We’re calling this new expertise stay utilizing Google’s newest speech fashions. Gemini can higher perceive you and reply naturally. You may even interrupt whereas Gemini is responding and it’ll adapt to your speech patterns. And that is only the start. [00:06:00] We’re excited to carry the velocity good points and video understanding capabilities from Undertaking Astra to the Gemini app. While you go stay, you can open your digicam so Gemini can see what you see and reply to your environment in actual time. Now the way in which I take advantage of Gemini is not the way in which you utilize Gemini, so we’re rolling out a brand new characteristic that allows you to customise it on your personal wants and create private specialists on any matter [00:06:30] you need. We’re calling these gems, they’re actually easy to arrange. Simply faucet to create a health club, write your directions as soon as and are available again everytime you want it.

Speaker 11: We have launched into a multi-year journey to reimagine Android with AI on the core, and it begins with three breakthroughs You will see this 12 months first we’re placing AI powered search proper at your fingertips, creating totally new methods to get the solutions you want. [00:07:00] Second Gemini is turning into your new AI assistant on Android. There that will help you anytime. And third, we’re harnessing on machine AI to unlock new experiences that work as quick as you do whereas protecting your delicate knowledge non-public. One factor we have heard from college students is that they are doing extra of their schoolwork instantly on their telephones and tablets. So we thought may circle the search. Be your excellent [00:07:30] examine buddy. For example my son wants assist with a tough physics phrase drawback like this one. My first thought is, oh boy, it has been some time since I’ve thought of kinematics. If he is stumped on this query, as an alternative of placing me on the spot, he can circle the precise half he is caught on and will get step-by-step directions, proper the place he’s already doing the work.

Speaker 12: Now we’re making Gemini context conscious so it may well anticipate what you are attempting to [00:08:00] do and supply extra useful strategies within the second. In different phrases, to be a extra useful assistant. So let me present you the way this works and I’ve my shiny new pixel eight A right here to assist me.

Speaker 12: So my pal Pete is asking if I need to play pickleball this weekend and I understand how to play tennis, I’ve to say that for the demo, however I am new to this pickleball factor, so I will reply and attempt to be humorous and I will say, is that [00:08:30] like tennis? However with pickles, this shall be truly rather a lot funnier. What a meme. So let me carry up Gemini to assist with that and I will say create picture of tennis with pickles. Now one you assume you may discover is that the Gemini window now hovers in place above the app in order that I keep within the circulation. Okay, in order that generated some fairly good photographs. What’s is I can then drag and drop any of those instantly into the messages app beneath [00:09:00] and now I can ask particular questions concerning the video. So for instance, wat is can sort the 2 bounce rule as a result of that is one thing that I’ve heard about however do not fairly perceive within the recreation.

Speaker 12: By the way in which, this makes use of alerts like YouTube’s captions, which suggests you should utilize it on billions of movies. So give it a second and there and get a pleasant succinct reply the ball within the bands as soon as on either side of the court docket after a serve. So as an alternative of trolling [00:09:30] by this complete doc, I can pull up Gemini to assist. And once more, Gemini anticipates what I would like and provides me an ask this PDF choice. So if I faucet on that, Gemini now ingest all the guidelines to change into a pickleball professional. And which means I can ask very esoteric questions like for instance, our spin serves allowed and there you’ve gotten it. It seems, nope, spin serves usually are not allowed. [00:10:00] So Gemini not solely provides me a transparent reply to my query, it additionally exhibits me precisely the place on the PDF to study extra. Constructing Google AI instantly into the OS elevates the complete smartphone expertise and Android is the primary cell working system to incorporate a built-in on-device basis mannequin. This lets us carry Gemini goodness from the information heart proper into your pocket so the expertise is quicker whereas additionally defending your privateness. Beginning with pixel. [00:10:30] Later this 12 months we’ll be increasing what’s potential with our newest mannequin Gemini Nano with multimodality. This implies your cellphone can perceive the world the way in which you perceive it, so not simply by textual content enter, but in addition by websites sounds and spoken language.

Speaker 1: Earlier than we wrap, I’ve a sense that somebody on the market may be counting what number of instances now we have talked about AI right this moment, and since [00:11:00] the massive theme right this moment has been letting Google do the give you the results you want, we went forward and rely it in order that you do not have to, that may be a recording. What number of instances somebody has stated AI.