Fails to load (OOM) models that I can load fine in LMStudio - probably related to worse (or potentially nonexistent?) automatic handling of how many GPU layers to offload
April 6, 2026 ยท #4870
Python
Difficulty: Medium
Parent Repository
unslothai/unsloth
Python repository
60,135 5,153