FEI Hao suxue

suxue / llama_torchao_compile.py

Created August 29, 2024 09:01 — forked from SunMarc/llama_torchao_compile.py

`transformers` + `torchao` quantization + `torch.compile` on Llama3.1 8B

	# REQUIRES torchao, torch nightly (or torch 2.5) and transformers

	from transformers import AutoTokenizer, AutoModelForCausalLM, TorchAoConfig
	from transformers import TextStreamer
	import torch
	from tqdm import tqdm
	import os
	os.environ["TOKENIZERS_PARALLELISM"] = "false" # To prevent long warnings :)

	torch.set_float32_matmul_precision('high')

suxue / trt-bert.ipynb

Created March 11, 2020 12:06

Sorry, something went wrong. Reload?

Sorry, we cannot display this file.

Sorry, this file is invalid so it cannot be displayed.

suxue / wrk.py

Created May 30, 2019 12:45

	#!/usr/bin/env python
	# coding: utf-8
	# module for http benchmarking using wrk
	# example command like
	# ./wrk.py --connections '[1,2,3,4]' --filename ./benchmark_qa/query.json --url http://x.y.z.k/hello.php --output 1.csv --duration 600

	import subprocess
	import tempfile
	import urlparse
	from contextlib import contextmanager

suxue / 1.cpp

Created October 22, 2018 11:12

multi_index

	#include <boost/flyweight.hpp>
	#include <boost/multi_index_container.hpp>
	#include <boost/multi_index/member.hpp>
	#include <string>
	#include <cstdint>
	#include <vector>
	#include <iostream>
	#include <tuple>

	typedef std::tuple<short, std::uint8_t, std::uint8_t> Date;

suxue / multi_index.cpp

Created October 22, 2018 11:11

multi_index

	#include <boost/flyweight.hpp>
	#include <boost/multi_index_container.hpp>
	#include <boost/multi_index/member.hpp>
	#include <string>
	#include <cstdint>
	#include <vector>
	#include <iostream>
	#include <tuple>

	typedef std::tuple<short, std::uint8_t, std::uint8_t> Date;

suxue / multi_index_example.cpp

Created October 22, 2018 11:10

Boost multiple-index example

	#include <boost/flyweight.hpp>
	#include <boost/multi_index_container.hpp>
	#include <boost/multi_index/member.hpp>
	#include <string>
	#include <cstdint>
	#include <vector>
	#include <iostream>
	#include <tuple>

	typedef std::tuple<short, std::uint8_t, std::uint8_t> Date;

suxue / det4.prototxt

Created February 16, 2017 03:30

suxue / lightencnn.prototxt

Created February 16, 2017 02:00

suxue / FXApplet.java

Last active August 29, 2015 14:14 — forked from mucaho/FXApplet.java

	import javafx.application.Platform;
	import javafx.embed.swing.JFXPanel;
	import javafx.scene.Group;
	import javafx.scene.Scene;

	import javax.swing.*;

	/**
	* A custom {@link java.applet.Applet Applet} that sets-up a JavaFX environment.
	*/

suxue / .gitignore

Last active August 29, 2015 14:05

qemu qcow2 format kernel testing image