Media & Entertainment

Android apps can now react to your environment

Comment

Image Credits:

What if the apps on your phone knew where you were, what you were doing, what’s nearby, and even what the weather was like outside, and then combined this information to react intelligently to your current situation? Would that be creepy or amazing? We will soon find out, it seems. At this week’s Google I/O conference, the company introduced new tools for app developers that will allow them to create applications that customize themselves to a user’s current context.

For example, a streaming music application could display an energetic playlist when you plug in your headphones and start jogging.

Or perhaps an app could alert you to stop by the pharmacy to pick up your medications – but it would only do so if you were driving, near the store, and the store was actually open.

To make these sorts of smarter applications possible, Google is introducing a new “Awareness API” which will become available shortly after its I/O conference wraps.

Effectively, this API combines a variety of functions previously available via other APIs – like gaining access to a user’s location or recognizing that they’re now driving their vehicle, for example. It can even sense nearby beacons and devices, which means it can tap into data from things like Android Wear smartwatches, or interoperate with devices like Chromecast (Google Cast) or Google’s new smart speaker, Google Home. 

puzzle

Google suggested a number of use cases, besides the examples above, as to how this functionality could be implemented in future applications.

For instance, a smarter alarm clock app could decide when to wake you up based on how late you stayed up the night before, and when your first meeting is that day.

A weather application could sense the Chromecast plugged into your bedroom TV and project the day’s weather onto the screen.

An assistant application could wake up Google Home to tell you that it’s time to leave for your calendar appointment.

A running app could immediately log your run for you, even if you forgot to start the tracking function.

A launcher application could place your camera app front-and-center when you’re outside because it knows you take a lot of nature photos outdoors. And, as an added bonus, when you snap the photo, it tags it with the weather and activity. This becomes part of the photo’s metadata, allowing you to later search for “outdoor photos taken while running and it was sunny outside.”

Some of these functions were possible before, if developers used multiple APIs. However, Google explained that calling upon multiple APIs, depending on conditions, can drain the battery or make the device run sluggishly due to increased RAM usage.

That could lead to users getting frustrated with the app and possibly even uninstalling it from their phone.

apis-around-you

The new Awareness API, then, not only offers the convenience of requesting all this information about a user’s situation more easily, it also does so while optimizing for system health. That means the apps get smarter without slowing the phone down or killing your battery.

The Awareness API actually contains two distinct APIs – one that lets apps react to the current situation (Fence API) and another to request information about the user’s current context (Snapshot API).

While Google’s suggested examples sound interesting, some of the real-world use cases implemented by partners who had early access to the API are a bit less inspiring.

Screen Shot 2016-05-19 at 12.29.24 PM

Real estate app Trulia, for instance, is using the API for smarter push notifications. That is, it will alert you to visit an open house only if you’re nearby, walking, and it’s nice outside.

Runkeeper will let you tag your running posts with the current weather.

GrubHub and Aviary are also tapping into the weather to personalize their apps.

Latin American music streaming app Superplayer Music, however, seems a little more fun. It will suggest music based on where you are and what you’re doing. If you just got to the gym, it will suggest different music than if you’re about to start a road trip, for example.

Screen Shot 2016-05-19 at 12.30.48 PM

And Android launcher Nova is considering rewriting its app to be context aware – meaning it will show you the right apps at the right time.

Creating a contextually aware mobile experience is something other startups have attempted before, often in the form of a launcher, like Aviate’s launcher that Yahoo acquired in 2014. But people have so far resisted having their phone’s user interface overhauled in reaction to their surroundings.

Screen Shot 2016-05-19 at 12.29.41 PM

That’s why it makes sense for this situational awareness to become more deeply embedded in the apps themselves. Instead of asking users to readjust how they use their phone, the experience of using the phone just gets better as notifications get smarter and less bothersome, apps react to what you’re doing, and interoperate with other devices around you more seamlessly.

Developers can sign up for early access here.

More TechCrunch

India’s mobile payments regulator is likely to extend the deadline for imposing market share caps on the popular UPI payments rail by one to two years, sources familiar with the…

India weighs delaying caps on UPI market share in win for PhonePe, Google Pay

Line Man Wongnai, an on-demand food delivery service in Thailand, is considering an initial public offering on a Thai exchange or the U.S. in 2025.

Thai food delivery app Line Man Wongnai weighs IPO in Thailand, US in 2025

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

Ever wonder why conversational AI like ChatGPT says “Sorry, I can’t do that” or some other polite refusal? OpenAI is offering a limited look at the reasoning behind its own…

OpenAI offers a peek behind the curtain of its AI’s secret instructions

The federal government agency responsible for granting patents and trademarks is alerting thousands of filers whose private addresses were exposed following a second data spill in as many years. The…

US Patent and Trademark Office confirms another leak of filers’ address data

As part of an investigation into people involved in the pro-independence movement in Catalonia, the Spanish police obtained information from the encrypted services Wire and Proton, which helped the authorities…

Encrypted services Apple, Proton and Wire helped Spanish police identify activist

Match Group, the company that owns several dating apps, including Tinder and Hinge, released its first-quarter earnings report on Tuesday, which shows that Tinder’s paying user base has decreased for…

Match looks to Hinge as Tinder fails

Private social networking is making a comeback. Gratitude Plus, a startup that aims to shift social media in a more positive direction, is expanding its wellness-focused, personal reflections journal to…

Gratitude Plus makes social networking positive, private and personal

With venture totals slipping year-over-year in key markets like the United States, and concern that venture firms themselves are struggling to raise more capital, founders might be worried. After all,…

Can AI help founders fundraise more quickly and easily?

Google has found a way to bring a variation of its clever “Circle to Search” gesture to iPhone users. The new interaction, launched in January, allows Android users to search…

Google brings a variation on ‘Circle to Search’ to iPhone users

A new sculpture going live on Wednesday in the Flatiron South Public Plaza in New York is not your typical artwork. It combines technology, sociology, anthropology and art to let…

Always-on video portal lets people in NYC and Dublin interact in real time

Apple’s iPad event had a lot to like. New iPads with new chips and new sizes, a new Apple Pencil, and even some software updates. If you are a big…

TechCrunch Minute: When did iPads get as expensive as MacBooks?

Autonomous, AI-based players are coming to a gaming experience near you, and a new startup, Altera, is joining the fray to build this new guard of AI agents. The company announced…

Bye-bye bots: Altera’s game-playing AI agents get backing from Eric Schmidt

Google DeepMind has taken the wraps off a new version of AlphaFold, their transformative machine learning model that predicts the shape and behavior of proteins. AlphaFold 3 is not only…

Google DeepMind debuts huge AlphaFold update and free proteomics-as-a-service web app

Uber plans to deliver more perks to Uber One members, like member-exclusive events, in a bid to gain more revenue through subscriptions.  “You will see more member-exclusives coming up where…

Uber promises member exclusives as Uber One passes $1B run-rate

We’ve all seen them. The inspector with a clipboard, walking around a building, ticking off the last time the fire extinguishers were checked, or if all the lights are working.…

Checkfirst raises $1.5M pre-seed to apply AI to remote inspections and audits

Close to a decade ago, brothers Aviv and Matteo Shapira co-founded a company, Replay, that created a video format for 360-degree replays — the sorts of replays that have become…

Controversial drone company Xtend leans into defense with new $40 million round

Usually, when something starts to rot, it gets pitched in the trash. But Joanne Rodriguez wants to turn the concept of rot on its head by growing fungus on trash…

Mycocycle uses mushrooms to upcycle old tires and construction waste

Monzo has raised another £150 million ($190 million), as the challenger bank looks to expand its presence internationally — particularly in the U.S. The new round comes just two months…

UK challenger bank Monzo nabs another $190M as US expansion beckons

iRobot has announced the successor to longtime CEO, Colin Angle. Gary Cohen, who previous held chief executive role at Timex and Qualitor Automotive, will be heading up the company, marking a major…

iRobot names former Timex head Gary Cohen as CEO

Reddit — now a publicly-traded company with more scrutiny on revenue growth — is putting a big focus on boosting its international audience, starting with francophones. In their first-ever earnings…

Reddit tests automatic, whole-site translation into French using LLM-based AI

Mushrooms continue to be a big area for alternative proteins. Canada-based Maia Farms recently raised $1.7 million to develop a blend of mushroom and plant-based protein using biomass fermentation. There’s…

Meati Foods bites into another $100M amid growth to 7,000 retail locations

Cleaning the outside of buildings is a dirty job, and it’s also dangerous. Lucid Bots came on the scene in 2018 with its Sherpa line of drones to clean windows…

Lucid Bots secures $9M for drones to clean more than your windows

High interest rates and financial pressures make it more important than ever for finance teams to have a better handle on their cash flow, and several startups are hoping to…

Israeli startup Panax raises a $10M Series A for its AI-driven cash flow management platform

The European Union has deepened the investigation of Elon Musk-owned social network, X, that it opened back in December under the bloc’s online governance and content moderation rulebook, the Digital Services Act…

EU grills Elon Musk’s X about content moderation and deepfake risks

For the founders of Atlan, a data governance startup, data has always been at the heart of what they do, even before they launched the company. In fact, co-founders Prukalpa…

Atlan scores $105M for its data control plane, as LLMs boost importance of data

It is estimated that about 2 billion people, especially those in lower and middle-income countries, lack access to quality and affordable essential medicines. The situation is exacerbated by low-quality or even killer…

Axmed raises $2M from Founderful to streamline drug supply chains in underserved markets

For decades, the Global Positioning System (GPS) has maintained a de facto monopoly on positioning, navigation and timing, because it’s cheap and already integrated into billions of devices around the…

Xona Space Systems closes $19M Series A to build out ultra-accurate GPS alternative

Bankruptcy lawyers representing customers impacted by the dramatic crash of cryptocurrency exchange FTX 17 months ago say that the vast majority of victims will receive their money back — plus interest. The…

FTX crypto fraud victims to get their money back — plus interest

On Wednesday, Google launched its digital wallet in India with local integrations, nearly two years after the app was relaunched as a digital wallet platform in the U.S. As TechCrunch exclusively reported last month,…

Google Wallet is now available in India