Supports CPU and disk offload to allow generation on consumer setups When using CPU offload, weights are stored in system RAM and transferred to the GPU as needed for processing When using disk ...