Skip to content

Instantly share code, notes, and snippets.

@chrishwiggins

chrishwiggins/transformer_embeddings_pca.tsv

Created September 2, 2025 16:43
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save chrishwiggins/8602b9ed831f085caa5c6d609c5bc5d2 to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save chrishwiggins/8602b9ed831f085caa5c6d609c5bc5d2 to your computer and use it in GitHub Desktop.
Download ZIP
PCA of transformer embeddings for student survey responses
Raw
transformer_embeddings_pca.tsv
student_id year pc1 pc2 interests_preview
0 Junior -0.21022303 0.03742918 Math modeling applications in clinical research, probabilistic modeling, drug regimen optimization a
1 Senior 0.053690534 0.023714403 I'd be curious to hear more about LLMs and the math behind them in order to better understand how th
2 Junior -0.40536395 0.14798523 pure math: stochastic topics, topological topics, how to do pure math in industry (i.e. research pos
3 Junior 0.37337518 -0.11617733 Combinatorics, algebraic topology
4 Junior 0.03895838 0.21787016 LLMs, machine learning, stochastics, probability, finance
5 Senior 0.103232145 -0.51578295 Biophysics
6 Junior -0.16043551 -0.20623785 visual arts, especially animation! quantitative finance. aerospace / air traffic control (?). crypto
7 Junior -0.37778497 -0.25229186 anything adjacent to natural sciences, and limitations of applied math/mathematical modeling (i.e. t
8 Senior -0.04851603 0.17333017 maybe something similar to topics from Persuasion at Scale -- use of stats or computing in contempor
9 Junior -0.26514775 -0.25202826 I would really enjoy learning more about topics in systems biology!! (I feel like my other classes d
10 Senior -0.021524252 0.11672477 Sports Analytics (I really enjoyed last year's) Quantitative Finance
11 Senior 0.23486677 -0.037358757 Physics and AI and Quantum
12 Junior -0.377305 -0.15684758 Probably more mathematical modeling. I am especially interested in the cross section between applied
13 Senior 0.005368349 0.133644 Math & Gaming, like how u structure game data to balance the system
14 Senior 0.3559245 -0.07134831 AI, ML, NLP, DL, NN, LLMs
15 Junior -0.30044624 -0.22662523 Climate science: especially oceanography, remote sensing, earth system modeling. I'd be especially e
16 Senior -0.10949608 -0.32517248 climate, geophysics, earth science
17 Junior -0.23836668 0.29655868 Applied math in quant trading (how it’s used), applied math in real world contexts (the question of
18 Senior 0.26176316 -0.27991286 Data Driven Science and Engineering, Deep Learning Convolutional Neural Networks, Graph Neural Netwo
19 Junior 0.15408272 -0.03045194 Actuarial science, machine learning, real-world modeling applications
20 Senior 0.22312433 -0.13275191 I was wondering if it might be possible to invite some guest lecturers from CBS, like Michael Gatto,
21 Junior 0.12651142 0.2225965 Machine learning focused topics. Probability ideas and AI. Numerical methods
22 Junior -0.27540728 0.18138576 Applied math in finance, further explaining how an AMath degree provides career/focus options separa
23 Junior 0.62800956 -0.021339646 No
24 Senior -0.18984064 -0.31072754 Computational biologists, using math in healthcare
25 Junior -0.42348242 0.11407513 I would love to realize what applied mathematics is really about and how I can use it in a financial
26 Senior 0.5306678 0.30484107 Deep Learning in Realtime Strategy Games
27 Junior -0.034200136 -0.13016315 Helen Moore, University of Florida College of Medicine. Research interests in mechanism-based mathem
28 Junior -0.20953318 0.034717344 Anything related to statistics
29 Junior 0.49204114 -0.033131935 Adam Sobel
30 Senior 0.34712338 -0.45380947 functional (epi)genomics, protein engineering
31 Junior 0.017245673 -0.0026307446 Number theory/cryptography, chaos theory, topology.
32 Junior 0.29984996 0.14232486 Determinism & time sync, Performance modeling:
33 Junior -0.29632664 -0.12644777 data analytics, mathematical biology, operations research, computational science, and mathematical f
34 Senior -0.07016835 -0.24888298 Differential geometry, biophysics, cell structure modeling, ML in finance
35 Senior -0.17298564 0.35601515 Game theory, cool applications of math in finance (like options pricing models or risk models)
36 Junior -0.39200416 0.2047038 I would be more interested in hearing about applying mathematics in the industry rather than in the
37 Junior -0.0873114 0.13163686 Discrete Mathematics & Algorithms, Data Science and ML, Probability & Stochastic Processes
38 Senior 0.2232799 -0.11418587 Transit Planning (Train, Bus, Plane etc.) Shipping Logistics
39 Junior -0.04357042 -0.17289774 Mathematical physics
40 Senior -0.19608761 0.12511738 I am particularly interested in mathematical applications to the energy sector (more generally anyth
41 Junior -0.24773294 0.13345423 The topics that I am particularly interested in hearing about this semester include: financial mathe
42 Senior -0.09131852 0.18023314 Topics: i) Forecasting algorithms (of the Markovian type, multivariate regression extensions and us
43 Senior -0.027128419 -0.43802723 data science, data visualization, design, biotech
44 Junior -0.31048477 0.14993756 Applied Math as it pertains to the math of machine learning (the theory of forward-mode automatic di
45 Senior 0.4076178 0.03317027 staying up to date on machine learning advances
46 Senior 0.14739862 0.33934838 Financial Modelling/Trading/Markov Processes/Machine Learning Applications in Finance
47 Senior 0.07507716 0.44087744 Quantitative finance, statistics/probability theory in betting (like the Mark Broadie talk)
48 Senior 0.44143784 0.31831217 game theory, network games, probability
49 Senior 0.041546524 0.095226526 blockchain and crypto(although a bit deviate from math)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment