Internet of Things
Using Micropython to develop an IoT sensor platform with an Augmented Reality UI
How to marry the physical world and IoT with the virtual
IoT with Augmented Reality
Anyone with a curious mind and interested in how to marry the physical world and IoT with the virtual. This talk is pitched at intermediate, but for beginners extensive documentation and a github repo is available to read and learn from. It shows the tiny Micorpython Pyboard 'D' being used as a tiny web server serving up an Augmented Reality display. The display shows sensor data overlay on a marker used to identify the IoT device. The work is open sourced from a project being run at the Samsung Research Institute in the UK.
Using Micropython to develop an IoT multimode sensor platform with an Augmented Reality UI
Who is this for
Anyone with a curious mind and interested in how to marry the physical world and IoT with the virtual. This talk is pitched at intermediate, but for beginners extensive documentation and a github repo is available to read and learn from.
What is it about
The story of a project at Samsung to capture data for the purpose of using in AI projects, which then became an OS platform with innovative ideas more important that the original concept. A multimode sensor platform using Augmented Reality for visualization.
Will I See The Real Prototype
Yes there will be a demonstration of the prototype and this will be used as part of the talk to explain the concepts.
What Technologies Will It Cover
This talk will cover a microcontroller with plug-able sensors using micropython for the main software development platform. For the serve side components the talk will be using a micro web server used to serve sensor data and a simple AR display. For Augmented Reality the talk will switch to using HTML and JavaScript needed to render objects in the browser for the demo.
What Will I Learn
Hopefully you will learn an introduction to IoT concepts to developers who are interested in this tech, but we will use micropython for embedded systems and show how to used. You will see in this talk:
1. How to use a tiny microcontroller with real sensors using micropython.
2. How to connect 'things' to the platform.
3. A micro web server to serve content.
4. The web side, using web technologies like A-Frame, AR.js for the purpose of having AR capabilities.
In Summary
This talk will cover going from the small embedded world of IoT and sensors using micropython. Some time will be given to go over the general micro server. Then the last part of the talk will go over the concepts of Augmented Reality and using a mobile browser to view data from the sensors.
Resources
The main github repo for the project is here. It's open source and still changing. Be sure to keep track on it! :-)
Additional information
| Type | devroom |
|---|
More sessions
| 2/2/20 |
Welcome to the IOT devroom
|
| 2/2/20 |
Some constrained embedded systems cannot use batteries, those are called transiently-powered embedded systems. They can be equipped with a non volatile RAM (NVRAM) and a super capacitor for gathering energy when available. Developing in such an environment is not straight. During this talk, we will expose our work on a constrained real time OS tolerant with power loss on a MSP430 based platform. This platform is a MSP430FR5994 Launchpad equipped with FRAM and a super capacitor.
|
| 2/2/20 |
We will demonstrate how to quickly develop simple tools to: check for a GPIO state, communicate with an I2C OLED screen or gdb into a running firmware.
|
| 2/2/20 |
Technical barrier to target low cost micro controllers can be too high for many developers already used to high level API. But did you know that those devices can support many operating systems like NuttX inspired by POSIX (same for Linux), but it goes even behind than C APIs, even JavaScript runtimes like IoT.js can be supported too. IoT.js can also support JS community modules such as Generic-sensor-lite to support sensors and actuators or webthing-iotjs to enable REST API for embedded ...
|
| 2/2/20 |
While Machine Learning is usually deployed in the cloud, lightweight versions of these algorithms that fit for constrained IoT systems such as microcontrollers are appearing. Using Machine Learning « at-the-edge » has indeed several advantages such as the reduction of network latency, it provides better privacy, and are working offline. In this presentation, we will demonstrate how to deploy Deep Learning algorithms on IoT devices thanks to TensorFlow Lite. We will see how to use it to design ...
|
| 2/2/20 |
We propose a combined visual and text-based programming environment based on the actor model suitable for novice to expert programmers. This model encompasses simple communicating entities which easily scale from utilizing threads inside the computer to massive distributed computer systems. Our proposal is very suitable for IOT scenarios, creative coding practices and rapid prototyping. The prototype utilizes zeromq transports and embeds python for easy creation of actors.
|
| 2/2/20 |
We will have to talk about Tarantool Cartridge: it's framework for creating distributed applications. The application will be based on Tarantool – blazing fast in-memory database and Lua application server in one. Instances interconnect with each other by SWIM protocol – UDP Gossip protocol. We believe that our platform can bring brand new opportunities for the IoT world: we have the aggregated solution for many potential cases in IoT.
|
