Design and Architecture

This document is intended for developers who want to understand the architecture of cvm-runtime and/or actively develop on the project. This page is organized as follows:

• The System Architecture introduces all the important details of system design. To get started, please read this section first.

• The Example Inference Flow gives an overview of the steps that CVM takes to load a hard-disk model into CPU/GPU memory for running the deterministic result.

• The Operator Math Formalization section describes the ideal process logic for specific input data with strict mathematical description, guiding the source code.

• System Architecture
  • Integer Inference
  • Assertion and Log
  • NDArray Module
  • Graph Runtime
  • Precision Schema
  • Shape Inference
  • Operator Gas Table
• Example Inference Flow
  • Library API
  • CVM Model
  • Graph Runtime
  • Operators
• Operator Math Formalization
  • Reduce Operators
  • Broadcast Operators
  • NN Operators
  • Elemwise Operators
  • Transform Operators
  • Vision Operators