Credit/source: here
how to use unsloth grad checkpointing
To integrate the provided monkey patch for offloading gradient checkpointing into the Hugging Face transformers
library, you need to follow these steps:
{ config, pkgs, ... }: | |
{ | |
# Fingerprint | |
services.fprintd = { | |
enable = true; | |
package = pkgs.fprintd-tod; | |
tod.enable = true; | |
tod.driver = pkgs.libfprint-2-tod1-goodix; | |
}; |
Credit/source: here
how to use unsloth grad checkpointing
To integrate the provided monkey patch for offloading gradient checkpointing into the Hugging Face transformers
library, you need to follow these steps: