tcim_lite.runtime
Functions
get_device_num | Retrieves the number of Houmo devices with the specified backend name. |
|---|---|
get_supported_backend | Retrieves the list of backend names supported by the current Houmo device. |
get_version | Gets the version and release date of the TCIM library. |
load | Loads a built TCIM model with the specified model file. |
load_model_info | Loads and returns the model information as a JSON string from a binary model file (.hmm or .hmms). |
Classes
Buffer | Represents a buffer that is used to save data on host CPU and Houmo device. |
|---|---|
DevManager | Describes the device set on which the target model runs. |
Device | The device type where the data is stored. |
Module | Represents a module instance used for model inference in runtime. |
Option | Static configuration options for loading models. |
RunOption | Dynamic options when the module run. |
Stream | Represents a stream that is used by the module for inference. |
Tensor | Represents an input, output, or intermediate computation result. |
TensorInfo | Represents information about a tensor, including its shape, data type, memory layout, and other relevant attributes. |
WeightManager | Represents weight manager reference for Module. |