Skip to content

Instantly share code, notes, and snippets.

View kratzert's full-sized avatar

Frederik Kratzert kratzert

View GitHub Profile
@oskopek
oskopek / README.adoc
Last active January 10, 2025 13:38
Automatic Jupyter Notebook Python cell formatting. Runs YAPF on individual notebook cells using yapf_api.

yapf_nbformat

Runs YAPF on individual notebook cells using yapf_api.

  • To skip a cell formatting (for example with jupyter-custom syntax, add # noqa to the first line of the cell.

  • Remove newlines at end of cells.

  • Uses the style_format file .style.yapf.

  • Has a dry run option for checking proper formatting (f.e. in a Git hook).

@karpathy
karpathy / pg-pong.py
Created May 30, 2016 22:50
Training a Neural Network ATARI Pong agent with Policy Gradients from raw pixels
""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
import numpy as np
import cPickle as pickle
import gym
# hyperparameters
H = 200 # number of hidden layer neurons
batch_size = 10 # every how many episodes to do a param update?
learning_rate = 1e-4
gamma = 0.99 # discount factor for reward