Lesson 15 (#54)
* Adding content * Update en.json * Update README.md * Adding structure for project 4 * More on lesson 15 * Update TRANSLATIONS.md * Adding lesson tempolates * Adding more AI stuff * Fixing code files with each others code in * Update README.md * Update virtual-device.md * Bananas! ![](https://media.giphy.com/media/1uPiL9Amv5zkk/giphy.gif) * Adding assignment * Tweakspull/63/head
@ -0,0 +1,20 @@
|
|||||||
|
{
|
||||||
|
"cSpell.words": [
|
||||||
|
"ADCs",
|
||||||
|
"Geospatial",
|
||||||
|
"Kbps",
|
||||||
|
"Mbps",
|
||||||
|
"Seeed",
|
||||||
|
"Twilio",
|
||||||
|
"UART",
|
||||||
|
"UDID",
|
||||||
|
"Zigbee",
|
||||||
|
"antimeridian",
|
||||||
|
"geofence",
|
||||||
|
"geofences",
|
||||||
|
"geofencing",
|
||||||
|
"microcontrollers",
|
||||||
|
"mosquitto",
|
||||||
|
"sketchnote"
|
||||||
|
]
|
||||||
|
}
|
@ -0,0 +1,24 @@
|
|||||||
|
# Manufacturing and processing - using IoT to improve the processing of food
|
||||||
|
|
||||||
|
Once food reaches a central hub or processing plant, it isn't always just shipped out to supermarkets. A lot of the time the food goes through a number of processing steps, such as sorting by quality. This is a process that used to be manual - it would start in the field when pickers would only pick ripe fruit, then at the factory the fruit would be ride a conveyer belt and employees would manually remove any bruised or rotten fruit. Having picked and sorted strawberries myself as a summer job during school, I can testify that this isn't a fun job.
|
||||||
|
|
||||||
|
More modern setups rely on IoT for sorting. Some of the earliest devices like the sorters from [Weco](https://wecotek.com) use optical sensors to detect the quality of produce, rejecting green tomatoes for example. These can be deployed in harvesters on the farm itself, or in processing plants.
|
||||||
|
|
||||||
|
As advances happen in Artificial Intelligence (AI) and Machine Learning (ML), these machines can become more advanced, using ML models trained to distinguish between fruit and foreign objects such as rocks, dirt or insects. These models can also be trained to detect fruit quality, not just bruised fruit but early detection of disease or other crop problems.
|
||||||
|
|
||||||
|
> 🎓 The term *ML model* refers to the output of training machine learning software on a set of data. For example, you can train a ML model to distinguish between ripe and unripe tomatoes, then use the model on new images to see if the tomatoes are ripe or not.
|
||||||
|
|
||||||
|
In these 4 lessons you'll learn how to train image-based AI models to detect fruit quality, how to use these from an IoT device, and how to run these on the edge - that is on an IoT device rather than in the cloud.
|
||||||
|
|
||||||
|
> 💁 These lessons will use some cloud resources. If you don't complete all the lessons in this project, make sure you [Clean up your project](../clean-up.md).
|
||||||
|
|
||||||
|
## Topics
|
||||||
|
|
||||||
|
1. [Train a fruit quality detector](./4-manufacturing/lessons/1-train-fruit-detector/README.md)
|
||||||
|
1. [Check fruit quality from an IoT device](./4-manufacturing/lessons/2-check-fruit-from-device/README.md)
|
||||||
|
1. [Run your fruit detector on the edge](./4-manufacturing/lessons/3-run-fruit-detector-edge/README.md)
|
||||||
|
1. [Trigger fruit quality detection from a sensor](./4-manufacturing/lessons/4-trigger-fruit-detector/README.md)
|
||||||
|
|
||||||
|
## Credits
|
||||||
|
|
||||||
|
All the lessons were written with ♥️ by [Jim Bennett](https://GitHub.com/JimBobBennett)
|
@ -0,0 +1,16 @@
|
|||||||
|
# Train your classifier for multiple fruits and vegetables
|
||||||
|
|
||||||
|
## Instructions
|
||||||
|
|
||||||
|
In this lesson you trained an image classifier to be able to distinguish between ripe and unripe fruits, but only using one type of fruit. A classifier can be trained to recognize multiple fruits, with varying rates of success depending on the type of fruit and the difference between ripe and unripe.
|
||||||
|
|
||||||
|
For example, with fruits that change color when they ripen, image classifiers might be less effective than a color sensor as they usually work on grey scale images instead of full color.
|
||||||
|
|
||||||
|
Train your classifier with other fruits to see how well it works, especially when fruits look similar. For example, apples and tomatoes.
|
||||||
|
|
||||||
|
## Rubric
|
||||||
|
|
||||||
|
| Criteria | Exemplary | Adequate | Needs Improvement |
|
||||||
|
| -------- | --------- | -------- | ----------------- |
|
||||||
|
| Train the classifier for multiple fruits | Was able to train the classifier for multiple fruits | Was able to train the classifier for one additional fruit | Was unable to train the classifier for more fruits |
|
||||||
|
| Determine how well the classifier works | Was able to comment correctly on how well the classifier worked with different fruits | Was able to observe and offer suggestions as to how well it was working | Was unable to comment on how well the classifier worked |
|
After Width: | Height: | Size: 315 KiB |
After Width: | Height: | Size: 285 KiB |
After Width: | Height: | Size: 272 KiB |
After Width: | Height: | Size: 290 KiB |
After Width: | Height: | Size: 310 KiB |
After Width: | Height: | Size: 306 KiB |
After Width: | Height: | Size: 297 KiB |
After Width: | Height: | Size: 302 KiB |
After Width: | Height: | Size: 252 KiB |
After Width: | Height: | Size: 294 KiB |
After Width: | Height: | Size: 298 KiB |
After Width: | Height: | Size: 293 KiB |
After Width: | Height: | Size: 308 KiB |
After Width: | Height: | Size: 278 KiB |
After Width: | Height: | Size: 283 KiB |
After Width: | Height: | Size: 295 KiB |
After Width: | Height: | Size: 286 KiB |
After Width: | Height: | Size: 300 KiB |
After Width: | Height: | Size: 309 KiB |
After Width: | Height: | Size: 314 KiB |
After Width: | Height: | Size: 297 KiB |
After Width: | Height: | Size: 306 KiB |
After Width: | Height: | Size: 283 KiB |
After Width: | Height: | Size: 302 KiB |
After Width: | Height: | Size: 303 KiB |
After Width: | Height: | Size: 306 KiB |
After Width: | Height: | Size: 294 KiB |
After Width: | Height: | Size: 302 KiB |
After Width: | Height: | Size: 284 KiB |
After Width: | Height: | Size: 290 KiB |
After Width: | Height: | Size: 281 KiB |
After Width: | Height: | Size: 291 KiB |
After Width: | Height: | Size: 285 KiB |
After Width: | Height: | Size: 283 KiB |
After Width: | Height: | Size: 263 KiB |
After Width: | Height: | Size: 282 KiB |
After Width: | Height: | Size: 286 KiB |
After Width: | Height: | Size: 286 KiB |
After Width: | Height: | Size: 276 KiB |
After Width: | Height: | Size: 291 KiB |
After Width: | Height: | Size: 286 KiB |
After Width: | Height: | Size: 281 KiB |
After Width: | Height: | Size: 285 KiB |
After Width: | Height: | Size: 281 KiB |
After Width: | Height: | Size: 279 KiB |
After Width: | Height: | Size: 275 KiB |
After Width: | Height: | Size: 285 KiB |
After Width: | Height: | Size: 263 KiB |
After Width: | Height: | Size: 284 KiB |
After Width: | Height: | Size: 262 KiB |
After Width: | Height: | Size: 283 KiB |
After Width: | Height: | Size: 282 KiB |
After Width: | Height: | Size: 287 KiB |
After Width: | Height: | Size: 284 KiB |
After Width: | Height: | Size: 271 KiB |
After Width: | Height: | Size: 261 KiB |
After Width: | Height: | Size: 280 KiB |
@ -0,0 +1,33 @@
|
|||||||
|
# Check fruit quality from an IoT device
|
||||||
|
|
||||||
|
Add a sketchnote if possible/appropriate
|
||||||
|
|
||||||
|
![Embed a video here if available](video-url)
|
||||||
|
|
||||||
|
## Pre-lecture quiz
|
||||||
|
|
||||||
|
[Pre-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/31)
|
||||||
|
|
||||||
|
## Introduction
|
||||||
|
|
||||||
|
In this lesson you will learn about
|
||||||
|
|
||||||
|
In this lesson we'll cover:
|
||||||
|
|
||||||
|
* [Thing 1](#thing-1)
|
||||||
|
|
||||||
|
## Thing 1
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 🚀 Challenge
|
||||||
|
|
||||||
|
## Post-lecture quiz
|
||||||
|
|
||||||
|
[Post-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/32)
|
||||||
|
|
||||||
|
## Review & Self Study
|
||||||
|
|
||||||
|
## Assignment
|
||||||
|
|
||||||
|
[](assignment.md)
|
@ -0,0 +1,9 @@
|
|||||||
|
#
|
||||||
|
|
||||||
|
## Instructions
|
||||||
|
|
||||||
|
## Rubric
|
||||||
|
|
||||||
|
| Criteria | Exemplary | Adequate | Needs Improvement |
|
||||||
|
| -------- | --------- | -------- | ----------------- |
|
||||||
|
| | | | |
|
@ -0,0 +1,33 @@
|
|||||||
|
# Run your fruit detector on the edge
|
||||||
|
|
||||||
|
Add a sketchnote if possible/appropriate
|
||||||
|
|
||||||
|
![Embed a video here if available](video-url)
|
||||||
|
|
||||||
|
## Pre-lecture quiz
|
||||||
|
|
||||||
|
[Pre-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/33)
|
||||||
|
|
||||||
|
## Introduction
|
||||||
|
|
||||||
|
In this lesson you will learn about
|
||||||
|
|
||||||
|
In this lesson we'll cover:
|
||||||
|
|
||||||
|
* [Thing 1](#thing-1)
|
||||||
|
|
||||||
|
## Thing 1
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 🚀 Challenge
|
||||||
|
|
||||||
|
## Post-lecture quiz
|
||||||
|
|
||||||
|
[Post-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/34)
|
||||||
|
|
||||||
|
## Review & Self Study
|
||||||
|
|
||||||
|
## Assignment
|
||||||
|
|
||||||
|
[](assignment.md)
|
@ -0,0 +1,9 @@
|
|||||||
|
#
|
||||||
|
|
||||||
|
## Instructions
|
||||||
|
|
||||||
|
## Rubric
|
||||||
|
|
||||||
|
| Criteria | Exemplary | Adequate | Needs Improvement |
|
||||||
|
| -------- | --------- | -------- | ----------------- |
|
||||||
|
| | | | |
|
@ -0,0 +1,33 @@
|
|||||||
|
# Trigger fruit quality detection from a sensor
|
||||||
|
|
||||||
|
Add a sketchnote if possible/appropriate
|
||||||
|
|
||||||
|
![Embed a video here if available](video-url)
|
||||||
|
|
||||||
|
## Pre-lecture quiz
|
||||||
|
|
||||||
|
[Pre-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/35)
|
||||||
|
|
||||||
|
## Introduction
|
||||||
|
|
||||||
|
In this lesson you will learn about
|
||||||
|
|
||||||
|
In this lesson we'll cover:
|
||||||
|
|
||||||
|
* [Thing 1](#thing-1)
|
||||||
|
|
||||||
|
## Thing 1
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 🚀 Challenge
|
||||||
|
|
||||||
|
## Post-lecture quiz
|
||||||
|
|
||||||
|
[Post-lecture quiz](https://brave-island-0b7c7f50f.azurestaticapps.net/quiz/36)
|
||||||
|
|
||||||
|
## Review & Self Study
|
||||||
|
|
||||||
|
## Assignment
|
||||||
|
|
||||||
|
[](assignment.md)
|
@ -0,0 +1,9 @@
|
|||||||
|
#
|
||||||
|
|
||||||
|
## Instructions
|
||||||
|
|
||||||
|
## Rubric
|
||||||
|
|
||||||
|
| Criteria | Exemplary | Adequate | Needs Improvement |
|
||||||
|
| -------- | --------- | -------- | ----------------- |
|
||||||
|
| | | | |
|
After Width: | Height: | Size: 127 KiB |
After Width: | Height: | Size: 455 KiB |
After Width: | Height: | Size: 380 KiB |
After Width: | Height: | Size: 84 KiB |
After Width: | Height: | Size: 1.5 KiB |
After Width: | Height: | Size: 231 KiB |
After Width: | Height: | Size: 42 KiB |
After Width: | Height: | Size: 27 KiB |
After Width: | Height: | Size: 34 KiB |