After a long day everyone deserves a quality meal. For a lot of people that would mean to order a take out. And they too want to eat as good as freshly prepped homemade meal. Therefore we introduce Freeshno, a machine learning model that recognizes different movements of the package and evaluates if the movement could be harmful or not.
At the time we were also working on another project, where we made a platform for local farmers to sell their food baskets on demand via parcel machines. In addition to that project we wanted to implement Freeshno sensors straight onto those baskets.
How?Freeshno has 3 main elements: FreeshnoMachineLearningModel that analyses data collected by ArduinoNano33BLESense device's accelerometer and then sends the processed data to FreeshnoMobileApp via Bluetooth.
Machine learning modelBuilt using Edge Impulse, the model is built to distinguish between and detect downturn_normal, sliding, walking, idle, false conduct (consisting of throwing, overturning, falling), pickup_normal, running and carrying with one hand.
Via a library, the fore-described model is implemented into an Arduino sketch which checks for a Bluetooth connection and then writes value 1 if detects "false conduct" movement or value 0 if detects anything else.
if (central.connected() && prediction == "napacnoRavnanje") {
batteryLevelChar.writeValue(1);
} else if (central.connected() && prediction != "napacnoRavnanje") {
batteryLevelChar.writeValue(0);
}
Freeshno appLastly, the app, built using Android Studio, first searches for the Freeshno Arduino device and then displays the data it receives on a scale of 0-100. 0 meaning your basket handling was terrible and the food can be damaged, 100 meaning you have taken care of the basket as if it was your own child.
If the score gets worse, the color of the score changes. Under 80 it's yellow and under 50 it's red.
When you finish your delivery, you press the back arrow button and the device disconnects. After that the app announces your final score.
Comments