Gemini Overlay Introduces 'Ask About This PDF' Feature for Android

Google has recently rolled out a powerful new feature for its Gemini AI that aims to make working with PDF documents significantly easier. Announced earlier this year at Google I/O 2024, the feature is now live in the Files by Google app.

With the introduction of the "Ask about this PDF" feature, users can now ask specific questions about a PDF directly within the app, streamlining the process of extracting relevant information from documents.

Overview of the "Ask About This PDF" Feature

The new functionality is part of Google’s Gemini overlay, an initiative to bring AI-driven tools to Android’s various apps. The feature is integrated into the Files by Google app’s updated PDF viewer, allowing users to interact with the document in a more intuitive and efficient way.

The feature enables you to upload a PDF and directly ask questions about its contents, such as requesting a summary, seeking clarification on specific sections, or even inquiring about tables, charts, or any complex content present in the document.

How the Feature Works

Once you open a PDF in Files by Google, you'll notice a new button labeled “Ask about this PDF.” Tapping this button prompts the app to upload the document, allowing you to enter your questions in a text box labeled “Ask Gemini.” While the document uploads, the send button remains greyed out.

Once the upload is complete, the send button becomes active, and you can proceed to ask questions related to the content. Gemini will then provide its responses in an overlay, allowing you to continue viewing the PDF while reading the answers.

Benefits and User Experience

The integration of this feature directly into the Files by Google app provides a more seamless and efficient experience for users. Unlike using the standalone Gemini app, which requires you to switch between apps to ask questions about a document, this functionality allows you to perform the entire process without leaving the app.

This integration ensures a more cohesive user experience, saving both time and effort. Additionally, it allows you to ask follow-up questions without needing to re-upload the file, which is a notable convenience.

Availability and Limitations

The "Ask about this PDF" feature is currently only available to users with Gemini Advanced. This advanced version of Gemini is capable of handling large context windows, allowing it to process and understand longer documents more effectively. Therefore, users without Gemini Advanced will not be able to access this feature.

For now, the feature is exclusively available within the Files by Google app and does not work with Google Drive’s PDF viewer. The Google Drive PDF viewer still offers the basic "Ask about this screen" feature, which is more limited compared to the new functionality in Files by Google.

Future Expansion

While the feature is currently limited to the Files by Google app, Google has hinted that it may expand the "Ask about this PDF" capability to other apps in future updates. This could mean that users who manage their PDFs via Google Drive may eventually see this advanced feature added to the Google Drive PDF viewer, offering broader flexibility and enhanced user experience across different platforms.

Conclusion

The "Ask about this PDF" feature is a significant enhancement to the Gemini AI and Files by Google, providing users with a more interactive way to work with PDF documents. By leveraging Gemini’s powerful AI capabilities, users can now extract valuable information from PDFs in a much faster and more efficient manner, without the need to switch between apps. With this feature being part of Gemini Advanced, it’s poised to deliver even greater convenience for those managing large and complex document