Enabling protected AI experiences on Google Play

Posted by Prabhat Sharma – Director, Belief and Security, Play, Android, and Chrome

The speedy developments in generative AI unlock alternatives for builders to create new immersive and fascinating app experiences for customers all over the place. On this time of fast-paced change, we’re excited to proceed enabling builders to create revolutionary, high-quality apps whereas sustaining the protected and trusted expertise individuals anticipate from Google Play. Our objective is to make AI useful for everybody, enriching the app ecosystem and enhancing consumer experiences.

Making certain security for apps with generative AI options

Over the previous 12 months, we’ve expanded our overview capabilities to handle new complexities that include apps with generative AI options. We’re utilizing new expertise like massive language fashions (LLMs) to shortly analyze app submissions, together with huge quantities of textual content to determine potential points like sexual content material or hate speech, and flag them for individuals on our international workforce to take a better look. This mixture of human experience and elevated AI effectivity helps us enhance the app overview expertise for builders and create a safer app atmosphere for everybody.

Moreover, we’ve got strengthened Play’s present insurance policies to handle rising issues and suggestions from customers and builders, and maintain tempo with evolving applied sciences like generative AI. For instance, final October, we shared that each one generative AI apps should give customers a strategy to report or flag offensive content material with out having to depart the app.

Constructing apps with generative AI options in a accountable method

Google Play’s insurance policies, which have lengthy supported the inspiration of our consumer security efforts, are deeply rooted in a steady collaboration between Play and builders. They supply a framework for accountable app growth, and assist make sure that Play stays a trusted platform around the globe. As generative AI continues to be in its early levels, we’ve got acquired suggestions from builders searching for readability on the necessities for apps on Play that function AI-created content material. In the present day we’re responding to that suggestions and offering steering to assist builders improve the standard and security of AI-powered apps, keep away from potential points or delays in app submissions, foster belief amongst customers, and contribute to a thriving and accountable app ecosystem on Google Play:

• Overview Google Play insurance policies: Google Play’s insurance policies assist us present a protected and high-quality expertise, subsequently we don’t permit apps that function generative AI that may be inappropriate or dangerous to customers. Be sure you overview our AI-Generated Content material Coverage and make sure that any of your apps meet these necessities to keep away from them being rejected or faraway from Google Play. 

Particularly, apps that generate content material utilizing AI should:

• Give customers a strategy to report or flag offensive content material. Monitoring and prioritizing consumer suggestions is particularly necessary for apps with generative AI options, the place consumer interactions immediately form the content material and expertise.

Notice: Photos are examples and topic to vary
• Promote your app responsibly: Promoting your app is a vital device in rising your corporation, and it is important to do it in a method that is protected and respectful of customers. Finally you’re chargeable for how your app is marketed and marketed, so overview your advertising supplies to make sure that your adverts precisely characterize your app’s capabilities, and that each one adverts and promotional content material related together with your app, throughout all platforms, meet our App Promotion necessities. For instance, promoting your app for an inappropriate use case might lead to it being faraway from Google Play.

• Rigorously take a look at AI instruments and fashions: You’re accountable for the expertise in your apps, so it’s essential so that you can perceive the underlying AI instruments and fashions used to create media and to make sure that these instruments are dependable and that the outputs are aligned with Google Play’s insurance policies and respect consumer security and privateness. You’ll want to take a look at your apps throughout varied consumer eventualities and safeguard them towards prompts that might manipulate your generative AI function to create dangerous or offensive content material. For instance, you need to use our closed testing function to share early variations of your app and ask for particular suggestions on in case your customers get generated outcomes that they anticipate.

This thorough understanding and testing particularly applies to generative AI, so we suggest that you simply begin documenting this testing as a result of we might ask to overview it sooner or later to assist us higher perceive how you retain your customers protected.

Because the AI panorama evolves, we’ll proceed to replace our insurance policies and developer instruments to handle rising wants and complexities. This contains introducing new app onboarding capabilities sooner or later to make the method of submitting a generative AI app to Play much more clear and streamlined. We’ll additionally share finest practices and assets, like our Individuals + AI Guidebook, to assist builders in constructing revolutionary and accountable apps that enrich the lives of customers worldwide.

As at all times, we’re your companions in retaining customers protected and are open to your suggestions so we are able to construct insurance policies that aid you lean into AI to scale your corporation on Play in ways in which delight and shield our shared customers.