Everything is pocket
Duration: 10.2022 - 12.2022 / Artcenter X Meta sponsership project#XR Interaction Design
Program: Unity, RunwayML, Premier Pro, After Effect, Figma
Device: Oculus Quest
Can the storage and sharing of data (location-based) be personalized in the digital world?
A new physical way for storing, sharing, and modifying personal data in the virtual realm that adapts machine learning, drawing inspiration from natural patterns, like how squirrels store their food.
Outcome
Research 1 _ Nature Behavior
How is it possible to personalize data storage locations?
Squirrels store their food in the fall to prepare for food shortages in winter. They have the type of squirrel that stores memories intensively in one place, and the type of squirrel that stores them distributed and stored in several places to prevent the risk of disappearing. They use their spatial memory capabilities to find their stored food later. However, they can't retrieve all their stored food. Changes in geographic requirements and other animals discover and bring their food.
Research 2 _ Being a squirrel
I tested the way squirrels behave using the scattering method by bringing it to the human environment.
(I had to take a little note to prevent the manager from throwing it away because he thought it was trash.)
Hid a total of 7 items, but I could find 5.
(But there was no reply below my little note..)It was unexpected, but can I use this disturbance phenomenon with my intention? What if I can use others (other animals) as a transportation system? Or it can be a delete system?
Insights
B: The place where I hid the item is no longer recognized by me as the same place as before.
A: The missing data part could be played and personalized.
There's a mat in front of the door.
But what if someone hides the key to this house here?
This mat may look the same on the outside, but it's no longer just a mat. It functions as a key storage that the people living in this house implicitly promised.
Key funcion Flow
User Flow
"How can I find my own space in the digital world?”
What if I can maximize objects?
To find the space for my secret pockets in the digital world, I played with Oculus in Unity and tried to maximize objects. There were holes! It is not only on the objects but also the surface of the wall.
From Physical to Virtual Space:
"How can I define these spaces as my pocket in the digital world?”
What if I can retrain AI?
To define the space that I selected for my personal pockets, I used a Machine Learning program. These spaces are not the typical pocket spaces nor objects that AI can recognize. So I had to retrain it for personalizing the labeling as a pocket.
What can we do when we have our personal pockets and hide our data there?
Save Data
Move Data
Post Data
Share Data
Save Data
You can store your data anywhere in your own secret space whichever you choose. Also, the space, which is judged to be a crack or hole by machine learning, helps you save your data by forming a new folder.
It could be something about your studies, or it could be a list of your favorite music, or a list that you shouldn't forget.
Move Data
This function helps you move your data. It can also use the surface of a moving object. But keep in mind that your data will never be found if you deviate from the surface of this moving object from the perspective we can see. Therefore, this data also has the ability to discard the data. I let the spider deliver my negative emotions of the day to the outside world. Instead of throwing it away, you can leave the data you want to open again a year later or at the moment you don't know when. What data would you like to leave for when you come back to your house after transferring your data to a migratory bird?
Post Data
Like the Move data function, the Post data function can also use the surface of a moving object. You can deliver your data to a flying bird and drop it where you want it. Post data is a function that posts the data you want to share to the desired location. Machine learning sets a moving object that an individual finds interesting and when the object is detected by computer vision, you can choose one of them and use it.
Share Data
Share data is a function that allows you to share posted data with others. Not only can you set your own scope for sharing, but you can also share it with a specific individual or make it public to everyone.
“Seeing technology unveils the way humans perceive the world. It destabilizes agreed-upon definitions: What is a chair, how to describe an apple, and what is a weed?”
— Simone C Niquille
“One’s idea of a chair may even involve the smell of furniture, the utensils you use at the kitchen table, and the food you eat. The experience and the object can’t be separated, just as the object and the abstract knowledge base in which it is located can’t be separated.”
— Eleanor Rosch
Tomatoes are fruits and other tales from category-land (in conversation with Eleanor Rosch), Simone C Niquille