The most efficient approach for a local installation is leveraging Docker containers. Carefully read and apply the steps described below. The installer automatically pulls the model (could be multiple GBs). You don’t need to tweak… gemma-4-31B-it-FP8-block on AMD/Nvidia GPU Fully Jailbroken Windows