FEI Hao suxue

suxue / llama_torchao_compile.py

Created August 29, 2024 09:01 — forked from SunMarc/llama_torchao_compile.py

`transformers` + `torchao` quantization + `torch.compile` on Llama3.1 8B

	# REQUIRES torchao, torch nightly (or torch 2.5) and transformers

	from transformers import AutoTokenizer, AutoModelForCausalLM, TorchAoConfig
	from transformers import TextStreamer
	import torch
	from tqdm import tqdm
	import os
	os.environ["TOKENIZERS_PARALLELISM"] = "false" # To prevent long warnings :)

	torch.set_float32_matmul_precision('high')

suxue / FXApplet.java

Last active August 29, 2015 14:14 — forked from mucaho/FXApplet.java

	import javafx.application.Platform;
	import javafx.embed.swing.JFXPanel;
	import javafx.scene.Group;
	import javafx.scene.Scene;

	import javax.swing.*;

	/**
	* A custom {@link java.applet.Applet Applet} that sets-up a JavaFX environment.
	*/