Skip to content

Instantly share code, notes, and snippets.

@sleepingcat4

sleepingcat4/main_body.py

Created November 24, 2023 12:47
Show Gist options
  • Save sleepingcat4/83ba3cfa77ec63451f24b2d0f762d936 to your computer and use it in GitHub Desktop.
Save sleepingcat4/83ba3cfa77ec63451f24b2d0f762d936 to your computer and use it in GitHub Desktop.
Download ZIP
main body code (4 lines)
Raw
main_body.py
from torchscale.architecture.config import EncoderConfig
from torchscale.architecture.encoder import Encoder
config = EncoderConfig(
vocab_size=64000,
hidden_size=1000,
num_layers=10
)
model = Encoder(config)
print(model)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment