March 2024

Google's New API Brings Powerful Language Processing to Android and iOS devices

Get ready for AI that goes wherever you do! Google launched an early-access API that lets powerful language processing models run directly on your phone, no matter if it’s Android, iPhone, or even a web app.

This is a game-changer for mobile app development, promising a future of smarter, more intuitive, and frankly, way cooler apps.

While still under development, Google is offering this API as an experimental tool for researchers and developers. This allows them to test and build prototypes using readily available LLM models directly on mobile devices.

Subscribe to our news letter for article regarding mobile app development, app development ideas and many more.

We only collect information for business use as detailed in our Privacy Policy

For Android specifically, developers working on production applications with LLMs can leverage the Gemini API or Gemini Nano on-device. These options are available through Android 14’s AICore, a system-level feature designed for high-end devices. AICore provides Gemini-powered solutions that include hardware acceleration, safety measures, and data compression tools.

Ready to Experiment with On-Device AI?

Trying out Google’s new LLM technology is a breeze for developers. There are two options:

  • Play around with a web demo: This lets you see the LLM capabilities firsthand without any coding.
  • Build your own sample app: Google provides a starter app on GitHub to get you going quickly.

The API makes adding LLMs to your mobile app a simple process. All you need are the platform-specific tools (SDKs) provided by Google. Thanks to clever optimizations, the API delivers super-fast performance on your device, using both the central processor (CPU) and graphics card (GPU) for broad compatibility.

Google isn’t stopping there. They plan to bring this API to even more platforms and expand the LLM models available in the coming year, giving developers even more options to create powerful mobile apps.

What are Large Language Models (LLMs)?

Imagine having a super-powered AI assistant that can understand complex language, generate different creative text formats, and answer your questions in an informative way. That’s essentially what LLMs are. They’ve been making waves in the tech world, but were previously limited to powerful computer systems. Google’s new API changes that by making LLMs accessible on your smartphone.

What does this mean for you?

The possibilities are vast. Here are just a few ways LLMs could transform your mobile experience:

  • Smarter Search: Imagine voice searches that understand context and nuance, allowing you to have natural conversations with your phone to find exactly what you need.
  • Enhanced Messaging: Say goodbye to typos and awkward phrasing. LLMs could suggest text completions, translate languages on the fly, and even summarize lengthy messages for you.
  • Personalized Experiences: Apps could adapt to your individual needs and preferences. Imagine a news app that curates content based on your reading habits or a shopping app that recommends products you’d actually love.
  • Offline Functionality: No internet connection? No problem. LLMs could power features and functionalities even when you’re not connected.

A Boon for Developers

This API isn’t just exciting for users; it’s a developer’s dream come true.  Imagine building apps that can:

  • Generate creative text formats like poems, code, scripts, musical pieces, email, letters, etc.
  • Answer your users’ questions in a comprehensive and informative way, even for open ended, challenging, or strange questions.
  • Translate languages in real-time, making communication seamless across borders.

Stop dreaming, start building! Partner with Cizo Technology to develop cutting-edge mobile apps using Google's revolutionary on-device AI.

The Future is Now

Google’s new API is a glimpse into the future of mobile computing. With powerful LLMs at their fingertips, mobile app developers can create a whole new generation of intelligent and engaging apps. Buckle up, because the way we interact with our phones is about to get a whole lot smarter.