Skip to content

Instantly share code, notes, and snippets.

## Using Gemini CLI for Large Codebase Analysis
When analyzing large codebases or multiple files that might exceed context limits, use the Gemini CLI with its massive
context window. Use `gemini -p` to leverage Google Gemini's large context capacity.
### File and Directory Inclusion Syntax
Use the `@` syntax to include files and directories in your Gemini prompts. The paths should be relative to WHERE you run the
gemini command:
@kellemar
kellemar / train.py
Last active January 14, 2024 08:43
Train.py for mistral
from datetime import datetime
import secrets
import modal
import os
from .common import (
stub,
axolotl_image,
VOLUME_CONFIG,
)
@kellemar
kellemar / common.py
Last active January 14, 2024 08:39
Common.py for Mitral
from modal import Stub, Image, Volume, Secret
import os
APP_NAME = "example-axolotl"
# Latest image hash of winglian/axolotl:main-py3.10-cu118-2.0.1 (2023-12-11)
AXOLOTL_REGISTRY_SHA = (
"59ec55880c8870147150dfb37646fb405d8926ea39d0ba3999ccdcdd79f968af"
)
# Need to patch transformers to an older version to avoid checkpointing errors.
@kellemar
kellemar / config.yaml
Last active January 14, 2024 08:38
axolotl config.yaml for MIstral
base_model: teknium/OpenHermes-2.5-Mistral-7B
model_type: MistralForCausalLM
tokenizer_type: LlamaTokenizer
is_mistral_derived_model: true
load_in_8bit: true
load_in_4bit: false
strict: false
rl: true
{
"background": "MetalCore is a Free-to-Play NFT-based open world first-person/third-person MMO mechanized combat game built by a team of veteran developers and designers.MetalCore is an award-winning game that won the award for best shooter game at the 2022 GAM3 Awards.Engage in mechanized combats as you fight alongside your faction in MetalCore's large scale PvP territorial battles. Get a preview of MetalCore's mineral rich alien planet by trying out the game's PvE mode through its Open World Alpha playtests. Play-to-Earn with MetalCore's collection of infantry, tanks and aircrafts NFTs with rarity levels ranging from uncommon to legendary.",
"statement": "AvocadoDAO had the privilege to game test MetalCore from 1 - 8 May 2023. Let's hear what our game testers have to say! How much time per day did you spend on the game and how far did you get? What are you thoughts on the general look and feel of MetalCore including the aspects of the game's (1) background story i.e. its lore (2) graphics quality and s
14:59:53.131: CPU Name: Apple M1
14:59:53.131: CPU Speed: 2400MHz
14:59:53.131: Physical Cores: 8, Logical Cores: 8
14:59:53.131: Physical Memory: 16384MB Total
14:59:53.131: OS Name: Mac OS X
14:59:53.131: OS Version: Version 11.3 (Build 20E232)
14:59:53.131: Kernel Version: 20.4.0
14:59:53.138: hotkeys-cocoa: Using layout 'com.apple.keylayout.ABC'
14:59:53.138: Current Date/Time: 2021-05-08, 14:59:53
14:59:53.138: Browser Hardware Acceleration: true