Option
_class _Option(option: [<class 'tcim_lite.runtime.WeightManager'>, < class 'tcim_lite.runtime.DevManager'>, < class 'int'>] = 0)
Static configuration options for loading models.
Constructor for the Option class.
Parameters:
option (int or WeightManager) --
Initialization options:
-
The logical ID of the Houmo device used for loading and inferring a model. The device 0 is used by default.
-
The
WeightManagerobject to manage the shared weight memory.
Methods
__init__ | Constructor for the Option class. |
|---|---|
enable_host_lazy_loading | Controls lazy buffer allocation strategy during model loading phase. |
enable_io_lazy_mode | Controls when input and output buffers used during inference are allocated on the host. |
enable_profile | Enable profiling mode. |
set_dummy_tensors | Sets a list of tensor names of a model. |
set_model_offset | Sets the byte offset and size of the model data within the file or buffer. |