WebAssembly
WebAssembly is a new technology that allows code to run efficiently and securely on any device. With Decthings, you can create and run models that run in WebAssembly.
The alternative to running in WebAssembly is to run in the systems native operating system, which on Decthings servers is Ubuntu.
When deciding whether to run your model in WebAssembly or not, consider the following:
- WebAssembly only supports a fraction of the features of linux. Additionally, not all programming languages are supported, and not all libraries and frameworks within those programming languages are supported. This is discussed more below.
- The startup speed of WebAssembly virtual machines is significantly faster than for linux virtual machines. This allows for lower latency when starting and stopping a model.
- The memory consumption of WebAssembly virtual machines is significantly smaller than for linux virtual machines.
- WebAssembly allows you to run your AI on any system, including on microcontrollers, in the browser, and on servers.
- In Decthings, GPUs are not supported for WebAssembly.
