Skip to content

Instantly share code, notes, and snippets.

@sleepingcat4
Created January 1, 2025 16:05
Show Gist options
  • Save sleepingcat4/b96138b2b82a8a9e6d5fae80ee581bb7 to your computer and use it in GitHub Desktop.
Save sleepingcat4/b96138b2b82a8a9e6d5fae80ee581bb7 to your computer and use it in GitHub Desktop.

We have to change the following files:

  1. Navigator/Subtopic_Query_Expansion.py
  2. Navigator/get_paper_embeddings.py
  3. Navigator/google_scholar_api.py
  4. Navigator/outline_creation.py
  5. Navigator/run_full_subtopic_expansion_process.py
  6. Navigator/search_api.py
  7. Navigator/subtopic_aspect_generation.py

These are files, we need to change among which except for file google_scholar_api.py. For this file use pip install scholarly this library.

for other files, it is simple API call changes from OpenAI or Anthropic to HF. If you see text-generation task use HF's smolLM-360M param model. For generating the embeddings use Model2Vec's https://www.google.com/url?q=https://huggingface.co/minishlab/potion-science-32M&sa=D&source=docs&ust=1735750943570206&usg=AOvVaw3fB1uN4JpdB5TJd-2YDsJT

Model2Vec Embedding Model

Except for get_paper_embedding.py file, you don't need Model2Vec and I am going to change that for you guys.

Files assigned to myself:

  1. get_paper_embedding.py
  2. outline_creation.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment