Module System

As we have mentioned in the previous section, the model is build on basic components: operators. But operators are too small-grained. We need to group them together to form a more complex structure, making it more powerful, flexible and easy to manage. The module system is designed to solve this problem. Basically, a module is a group of operators that are used to implement a specific function. Modules can be subclassed to create a new module.

In short, operators are the basic building blocks like basic electronic components like resistors, capacitors, inductors, etc. Modules are the larger components like memory, CPU, GPU, etc.