Skip to content

Instantly share code, notes, and snippets.

@link89
link89 / build.sh
Created March 25, 2025 07:40
Script to build libbeef and its modulefile
#!/bin/bash
set -e
[ -f build.done ] || {
module purge
module add compiler/2022.0.1
./configure CC=icc --prefix=/data/share/lib/libbeef/latest --enable-optmax
make
sudo make install
@link89
link89 / cuda-troubleshoot.sh
Created February 8, 2025 02:07
A quick test for troubleshooting CUDA enviornment issue
#/bin/bash
set -e
# Hello world test
cat <<EOF > hello.cu
#include <stdio.h>
__global__ void helloFromGPU(void) {
printf("Hello World from GPU!\n");
}
@link89
link89 / build.sh
Created January 9, 2025 03:28
An example of building deempd 3.0+ with conda & cuda 12 on rocky linux 8.5+
#!/bin/bash
set -e
# reset environment
conda deactivate || true
module purge
export OPENBLAS_NUM_THREADS=16
SCRIPT_PATH=$(realpath $0)
@link89
link89 / st_ext.py
Last active December 9, 2024 02:36
Cookie based session for Streamlit
from streamlit.web.server.websocket_headers import _get_websocket_headers
from streamlit.components.v1 import html
import streamlit as st
from http.cookies import SimpleCookie
from uuid import uuid4
from time import sleep
def get_cookie():
@link89
link89 / scow-db.md
Created October 31, 2024 08:33
Modify SCOW database

SCOW 数据表修改

通过数据库操作支持一些目前暂不支持在界面操作的 SCOW 功能。 以下操作需在 mis 的 db 容器中完成。

docker exec -it <container-id> bash
mysql -p 
<enter password>

Summary

  • build a new deepmd-kit plugin for an existed LAMMPS
  • export new LD_LIBRARY_PATH and LAMMPS_PLUGIN_PATH properly

Build

bash build.sh

Test

@link89
link89 / build-deepmd-3.0.0b-with-conda.md
Last active January 2, 2025 06:39
Build DeepMD-3.0.0b with Conda

Note

  • It's for CentOS 7, so the conda version have to be limited to cuda 11.8

Steps

CONDA_OVERRIDE_CUDA=11.8 nohup conda create -y -p ./3.0.0b0-cuda118 pytorch=2.1.2=cuda118*  python=3.11.* cudatoolkit=11.8  zlib cudnn cusparselt -c conda-forge --override-channels &
cd ./3.0.0b0-cuda118
source activate ./
pip install tensorflow==2.14.1
ln -s <path to source> source
@link89
link89 / use-conda-to-build-deepmd-with-lammps.md
Last active September 26, 2024 09:12
Use a conda envionment to build deepmd with lammps support

Summary

  • Use conda to install pytorch will have less trouble than with pip
  • Install lammps with openmpi support from conda-forge channel (or you can build your own lammps if you like)
  • Install lammps from source or else your conda environemnt will be messed up!
  • Install tensorflow with pip instead of conda as it is slow to resolve environment!
  • Install pytorch and tensorflow with conda at the same time to avoid abi incompatible issue!
  • For the sake of C++ABI compatibility, use conda to install tensorflow and pip for pytorch
  • Don't use full oneapi with openmpi, just use mkl or else there will be segmentation fault

Steps

@link89
link89 / rclone-backup.md
Created April 28, 2024 06:59
Use rclone to backup directory

Use copy to backup files

rclone copy ikkem-hpc-fq:/public/home/fqgong666/pretrained-model/all-test/dataset-2nd/2nd_data office:/public/dynacat/2nd_data --check-first  --verbose --dry-run

FQA

400 error of minio

If you see the following error

@link89
link89 / build-lammps-mace.md
Last active March 3, 2025 00:55
Script to build LAMMPS with MACE support

Summary

  • Use rocky8 singularity container to build and run to work around legacy glibc issue.

Build

 singularity exec -B /public,/etc --nv /public/groups/ai4ec/libs/images/rocky8.sif /bin/bash -l build_lammps.sh

Run