Session
Schedule FOSDEM 2020
Internet of Things

Using Micropython to develop an IoT sensor platform with an Augmented Reality UI

How to marry the physical world and IoT with the virtual
UD2.218A
Nicholas Herriot
IoT with Augmented Reality Anyone with a curious mind and interested in how to marry the physical world and IoT with the virtual. This talk is pitched at intermediate, but for beginners extensive documentation and a github repo is available to read and learn from. It shows the tiny Micorpython Pyboard 'D' being used as a tiny web server serving up an Augmented Reality display. The display shows sensor data overlay on a marker used to identify the IoT device. The work is open sourced from a project being run at the Samsung Research Institute in the UK.

Using Micropython to develop an IoT multimode sensor platform with an Augmented Reality UI

Who is this for

Anyone with a curious mind and interested in how to marry the physical world and IoT with the virtual. This talk is pitched at intermediate, but for beginners extensive documentation and a github repo is available to read and learn from.

What is it about

The story of a project at Samsung to capture data for the purpose of using in AI projects, which then became an OS platform with innovative ideas more important that the original concept. A multimode sensor platform using Augmented Reality for visualization.

Will I See The Real Prototype

Yes there will be a demonstration of the prototype and this will be used as part of the talk to explain the concepts.

What Technologies Will It Cover

This talk will cover a microcontroller with plug-able sensors using micropython for the main software development platform. For the serve side components the talk will be using a micro web server used to serve sensor data and a simple AR display. For Augmented Reality the talk will switch to using HTML and JavaScript needed to render objects in the browser for the demo.

What Will I Learn

Hopefully you will learn an introduction to IoT concepts to developers who are interested in this tech, but we will use micropython for embedded systems and show how to used. You will see in this talk: 1. How to use a tiny microcontroller with real sensors using micropython. 2. How to connect 'things' to the platform. 3. A micro web server to serve content. 4. The web side, using web technologies like A-Frame, AR.js for the purpose of having AR capabilities.

In Summary

This talk will cover going from the small embedded world of IoT and sensors using micropython. Some time will be given to go over the general micro server. Then the last part of the talk will go over the concepts of Augmented Reality and using a mobile browser to view data from the sensors.

Resources

The main github repo for the project is here. It's open source and still changing. Be sure to keep track on it! :-)

Additional information

Type devroom

More sessions

2/2/20
Internet of Things
Benjamin Henrion (zoobab)
UD2.218A
Welcome to the IOT devroom
2/2/20
Internet of Things
David Garriou
UD2.218A
Some constrained embedded systems cannot use batteries, those are called transiently-powered embedded systems. They can be equipped with a non volatile RAM (NVRAM) and a super capacitor for gathering energy when available. Developing in such an environment is not straight. During this talk, we will expose our work on a constrained real time OS tolerant with power loss on a MSP430 based platform. This platform is a MSP430FR5994 Launchpad equipped with FRAM and a super capacitor.
2/2/20
Internet of Things
Dimitri del Marmol (ddm)
UD2.218A
We will demonstrate how to quickly develop simple tools to: check for a GPIO state, communicate with an I2C OLED screen or gdb into a running firmware.
2/2/20
Internet of Things
Philippe Coval
UD2.218A
Technical barrier to target low cost micro controllers can be too high for many developers already used to high level API. But did you know that those devices can support many operating systems like NuttX inspired by POSIX (same for Linux), but it goes even behind than C APIs, even JavaScript runtimes like IoT.js can be supported too. IoT.js can also support JS community modules such as Generic-sensor-lite to support sensors and actuators or webthing-iotjs to enable REST API for embedded ...
2/2/20
Internet of Things
Alexis DUQUE
UD2.218A
While Machine Learning is usually deployed in the cloud, lightweight versions of these algorithms that fit for constrained IoT systems such as microcontrollers are appearing. Using Machine Learning « at-the-edge » has indeed several advantages such as the reduction of network latency, it provides better privacy, and are working offline. In this presentation, we will demonstrate how to deploy Deep Learning algorithms on IoT devices thanks to TensorFlow Lite. We will see how to use it to design ...
2/2/20
Internet of Things
Arnaud Loonstra
UD2.218A
We propose a combined visual and text-based programming environment based on the actor model suitable for novice to expert programmers. This model encompasses simple communicating entities which easily scale from utilizing threads inside the computer to massive distributed computer systems. Our proposal is very suitable for IOT scenarios, creative coding practices and rapid prototyping. The prototype utilizes zeromq transports and embeds python for easy creation of actors.
2/2/20
Internet of Things
Artur Barsegyan
UD2.218A
We will have to talk about Tarantool Cartridge: it's framework for creating distributed applications. The application will be based on Tarantool – blazing fast in-memory database and Lua application server in one. Instances interconnect with each other by SWIM protocol – UDP Gossip protocol. We believe that our platform can bring brand new opportunities for the IoT world: we have the aggregated solution for many potential cases in IoT.