- cross-posted to:
- technology@beehaw.org
- cross-posted to:
- technology@beehaw.org
Niantic, the company behind the extremely popular augmented reality mobile games Pokémon Go and Ingress, announced that it is using data collected by its millions of players to create an AI model that can navigate the physical world.
In a blog post published last week, first spotted by Garbage Day, Niantic says it is building a “Large Geospatial Model.” This name, the company explains, is a direct reference to Large Language Models (LLMs) Like OpenAI’s GPT, which are trained on vast quantities of text scraped from the internet in order to process and produce natural language. Niantic explains that a Large Geospatial Model, or LGM, aims to do the same for the physical world, a technology it says “will enable computers not only to perceive and understand physical spaces, but also to interact with them in new ways, forming a critical component of AR glasses and fields beyond, including robotics, content creation and autonomous systems. As we move from phones to wearable technology linked to the real world, spatial intelligence will become the world’s future operating system.”
By training an AI model on millions of geolocated images from around the world, the model will be able to predict its immediate environment in the same way an LLM is able to produce coherent and convincing sentences by statistically determining what word is likely to follow another.
You must log in or # to comment.
I just want real Pokemon battles and an easier way to sort by appraisal.
Ever wonder why websites that use Captchas prefer pictures of cars, busses, crosswalks, stop signs, bicycles, motorcycles and stairs?
They’re using YOU to train their AI models.
No you pretty much have this wrong in fundamental way.
These websites are not using you to train their models. Google is using these websites to use you to train Google’s models.
Joke’s on them because I use AI to solve that too.
Please share
I use Buster: Captcha is not really “AI” but it fixes the issue for me, there’s many others.
P.S: Nopecha uses AI
This Pokémon Go player has unwittingly poisoned an AI dataset by spoofing across bodies of water for years.
Gunna have cars attempt to fly!
I’m learning to flyyyy… But I ain’t got wiings…
Its 2030. your state of the art AR glasses have a bug. mr. mime is lurking behind every corner… always watching
It’s 2024 how do I get rid of Mr. Mime in my peripheral vision when I’m not wearing glasses?
same way an LLM is able to produce coherent and convincing sentences by statistically determining what word is likely to follow another
To me this implies that the navigation AI is going to hallucinate parts of its model of the world, because it’s basing that model on what’s statically the most likely to be there as opposed to what’s actually there. What could go wrong?
AI: Dave, turn right and walk across the bridge.
Dave : But AI, there is no bridge
AI: I am 99% sure based on 99 billion images that there should be a bridge
Dave: ok , you’re the smart one
Dave: aaaargh . . . .
SPLAT
Reminds me of Morrowind’s directions, with the frequent east-west mixups, and sporadic north-south mixups.
Fun fact, that’s why the immersion-breaking magic compass thing exists in Oblivion (and most open worlds since). Bethsoft devs explained it once.
Stuff is relocated a lot in development, and this means having to rework all dialogues refering to directions, occasionally missing some. It was even more unfeasible for Oblivion in which all dialogue is voiced and would have to be re-recorded.
So they just removed all directions from the dialogue and now you’ve got 100% accurate floating tags telling you exactly where to go, even when you are not yet sure what you’re looking for.
It’s not impossible to counter this while still having text be correct if you use a dialogue model that takes parameters to ue in calculation of the output dialogue.
“Dialogue here should lead you to the {direction}.”
NPC cords, quest objective cords = calculate relative position, insert in dialogue.
The game knows after you take the quest. So it can also know at the moment.
You know, since we’re on the subject of Elder Scrolls, Daggerfall actually had something like that.
You could ask anyone for where to find some random place, and the NPC would tell you roughly in which direction you should go, if they “knew” the place. Or sometimes they’d just write it directly on your map.
Still hard to do with voiced dialogue if you don’t want your NPCs to sound like robots. Then again, Oblivion didn’t need that to make its NPCs weird and robotic, with its 4 voice actors and huge amount of shared lines between everyone.
Fun fact, I worked with several other people on a localization patch for polish version of Morrowind, and we had so many of those east-west mixups fixed. Of course the publisher just translated strings and didn’t QA anything.
I had the French version. While translation was mostly correct, there were some errors here and there.
But the worst part was the newly introduced bugs, because original bethesda bugs weren’t enough apparently. For example, every interior with water had an erroneous water level value that made them entirely underwater.
There’s a slaver lair cave a couple meters from the beginning of the game, it takes like 30 seconds from the end of character creation to get there. In the French version, it’s completely underwater and everyone inside has drowned when you enter it. That’s the level of QA we had.
Oh, by the way, publisher for the French version? Ubisoft.
Its more amusing than you think. Most really hardcore of the players left now spoof their GPS position.
Id be willing to bet that most of the navigation data is completely useless.
I’m not sure if it’s “most [of the] hardcore players”, or “[the] most hardcore players”.
In the circles I’m around, spoofing is still frowned upon.
Same here. But you can reliably fill a raid at its launch by yourself with no one else around.
Not in my area. “Air support” hasn’t been a thing where I play in a while. But it’s not a super dense area where I usually play.
I presume the idea is to generate a base idea with ai then correct it with real time data.
Like the way go AI has one part to make a ‘policy’ of moves and a second part to simulate (‘read’) the results of those moves many steps ahead.
It’s only going to hallucinate until it gets new input from reality. Not nearly as precarious as generative models.
And this software will probably be able to route soumeone from one special Pokemon point to the other. Wow. There are three of them in our town. It will be very smart in speedrunning that triangle.
They have added tasks that make you photograph your surroundings or Objects and give them real world lidarr data linked with geo data for some in-game benefits, last I checked.
OK, that is actually something usable. So far what they could learn from here is how to take a shortcut through the fields ;-)
More like they can learn what the corner of the bank looks like
From all the apps invading your privacy and abusing your data, I didn’t suspect Pokemon GO to be one of them.
This should be so extremely illegal that it should bring criminal charges to all the members of their board.
From all the apps invading your privacy and abusing your data, I didn’t suspect Pokemon GO to be one of them.
I can’t tell if you’re being sarcastic.
Even if you never played the game, it’s fairly common knowledge that it uses GPS data to place in-game elements and to track where players are.
The game also uses real-world locations as in-game “treasure chests”, which people were theorizing all the way back in 2016 would eventually become open to “sponsored” locations. (Every McDonalds where I am is now a PokeStop)
And if you’ve played the game, you’ve likely seen all the invitations to turn on your camera and submit photos (which are tied to your GPS), move to specific locations, walk (or create) walking routes, take short videos of landmarks, etcetcetc.
I’ve been playing on and off since 2016, and I’ve known I’ve been trading data in exchange for a low-cost game this whole time.
You probably agreed to it when you installed the app.
Well I didn’t install it but a Privacy Policy does not go above the law in Europe.
I also said “should be extremely illegal”, which means that laws should be made for this so they can’t abuse the fact that the laws haven’t caught up yet.
Hu? Really? I thought that was known even when pkm go wasn’t released and only ingress existed.
Niantic is a google split up after all, if they were not collecting data, I would have been very surprised
I had friends who were addicted to ingress even though they knew it was vacuuming up their usage data, years before Pokemon Go
Niantic always announced itself as a data company
I considered trying to make a mini version of this to auto-contribute to OSM. Street view image shows a compacted dirt road? Submit to OSM. Two lanes with lines? Submit to OSM.
I was thinking about the exact same thing! Open source, OSM mapping with a Pokemon-like travel and collection game. But I’m super busy in grad school at the moment, so I can’t do it. Just put the idea out into the universe for now.
That already exists in Street Complete: https://streetcomplete.app/
I was thinking more about machine learning against images of places to populate data automatically.
I participate in Street Complete already. But I was interested in something more game-like.
It’s almost like listening to my crazy rants predicts the future.
Hope you guys don’t have those loyalty rewards cards to grocery stores or pharmacies. Oh, who am I kidding? All of you do.
Hope you guys don’t have those loyalty rewards cards to grocery stores or pharmacies. Oh, who am I kidding? All of you do.
Does it count if they’re all just copies of someone else’s cards?
I mean, good luck shopping without them. All shops artificially inflate the prices without them and then act like you’re getting a huge discount. For example, Tesco, as much as 100% price increase without their loyalty card, and most products have some. At least a 25% price increase.Eh, my store doesn’t require using the loyalty card to get discounts, the loyalty card is only useful for gas discounts, which I’m not going to use anyway because I already get decent discounts on Costco gas. So I don’t bother w/ the loyalty card because screw that noise.
If a store requires a loyalty card for competitive prices, I shop at a competitor that doesn’t require that BS, or I use my parents’ phone number or something.
One creepy thing though is that banks can still track my transactions because I tend to use the same card. I bought something at Home Depot the other day and opted for the emailed receipt (needed to apply for a rebate), and I didn’t have to enter my email in because they recognized my card and linked it to another time when I had them email a receipt (or maybe it was an online account for delivery). So in response, I try to cycle which card I use at a given store so they hopefully don’t associate my data, but I think purchases are tied to my name, so it probably still happens.
Yeah, I just stopped buying products.
Jenny’s number: (area code) 867-5309
Of course it probably doesn’t matter if you also use a credit card to make the purchase - every single purchase is fed into your personal consumer profile.
In some cases you trade the purchase history information for the 2% cash back or whatever.
You can also use a service like privacy.com to get credit card numbers for online services for a modicum of privacy.
Yup. I just purchased something from Home Depot and opted for the emailed receipt (needed for a rebate), and they didn’t ask for my email because they could look it up from my credit card (must have used the same card to order something online). In fact, I wouldn’t be surprised if they get the card owner’s name as well, so it might not matter which card you use.
Now let’s wait and see how google trains Earth 2 AI with their streetview data. We will be able to hallucinate places too just like that AI Minecraft project.
Lol, Niantic coding anything that actually works well is hilarious.
I’d also argue that Ingress players likely gave them way more useful data than PoGo
So slavery, then. No surprise.
Bro…
I mean… the Pokémon kind of get forced into combat for your entertainment… so more like cockfighting?
