COLMAP on Leonhard

COLMAP_Leonhard.md

Compiling COLMAP on Leonhard

This is a short tutorial for compiling COLMAP on Leonhard with GCC 6.3.0. Qt installation is quite large so COLMAP cannot be compiled in the home directories.

Modules and Paths

Create a file called colmap_startup.sh in your home directory containing the following:

export DATA=/cluster/project/infk/cvg/$USER

# COLMAP
module load gcc/6.3.0

module load cmake/3.4.3

module load boost eigen glog gflags glew

module load cgal openblas suite-sparse atlas

module load mpfr

module load mesa/12.0.3 mesa-glu

module load libxcb

module load cuda/10.0.130

export FREEIMAGE_DIR=/cluster/project/infk/cvg/$USER/dev/FreeImage/Dist
export Qt5_DIR=/cluster/project/infk/cvg/$USER/dev/qt5-build/qtbase/lib/cmake/Qt5

export COLMAP_PATH=/cluster/project/infk/cvg/$USER/dev/colmap/build/src/exe

Navigate to the project storage and create a folder for development:

source colmap_startup.sh
cd $DATA
mkdir dev
cd dev

Qt5

This part is adapted from the official tutorial.

git clone git://code.qt.io/qt/qt5.git
cd qt5
git checkout 5.9.8
perl init-repository --module-subset=qtbase
cd ..
mkdir qt5-build
cd qt5-build
../qt5/configure -developer-build -opensource -nomake examples -nomake tests
bsub -I -n 8 -R "rusage[mem=4096]" "make -j 8"
# Check that the compilation finished successfully.
cd ..

Ceres Solver

wget "http://ceres-solver.org/ceres-solver-1.14.0.tar.gz"
tar xvzf ceres-solver-1.14.0.tar.gz
rm ceres-solver-1.14.0.tar.gz
cd ceres-solver-1.14.0
mkdir build
cd build
cmake -DCMAKE_BUILD_TYPE=Release -DBUILD_EXAMPLES=Off -DEXPORT_BUILD_DIR=On ..
bsub -I -n 8 -R "rusage[mem=4096]" "make -j 8"
# Check that the compilation finished successfully.
bsub -I -n 8 -R "rusage[mem=4096]" "make test"
# Check that all tests pass.
cd ../..

FreeImage

wget "https://sourceforge.net/projects/freeimage/files/Source Distribution/3.18.0/FreeImage3180.zip"
unzip FreeImage3180.zip
rm FreeImage3180.zip
cd FreeImage
bsub -I -n 8 -R "rusage[mem=4096]" "make -j 8"
# Check that the compilation finished successfully.
cd ..

COLMAP

git clone https://github.com/colmap/colmap.git
cd colmap
mkdir build
cd build
cmake .. -DFREEIMAGE_INCLUDE_DIR_HINTS=$FREEIMAGE_DIR -DFREEIMAGE_LIBRARY_DIR_HINTS=$FREEIMAGE_DIR -DTESTS_ENABLED=ON -DCUDA_ARCHS="Pascal;Turing;Volta"
bsub -I -n 8 -R "rusage[mem=4096,ngpus_excl_p=1]" "make -j 8"
# Check that the compilation finished successfully.
bsub -I -n 8 -R "rusage[mem=4096,ngpus_excl_p=1]" "ctest"
# Check that tests pass. Currently known to fail: sift_test, opengl_utils_test.
cd ../..

Please note that currently there is no 30XX support on the cluster (no CUDA 11).

Comments

• Known issue The matcher is currently not working - it seems to prefer OpenGL to CUDA even when OpenGL is disabled during compilation (-DOPENGL_ENABLED=OFF). I have tried multiple versions of CUDA and OpenGL, but the two tests mentioned above were always failing. I suggest using a custom matcher (i.e., PyTorch based) and running GV without GPU (--SiftMatching.use_gpu 0 option for matches_importer).
• While I am around, you can probably use the compiled version of Qt / FreeImage available on my project storage. Try changing the following lines of colmap_startup.sh:

export FREEIMAGE_DIR=/cluster/project/infk/cvg/dusmanum/dev/FreeImage/Dist
export Qt5_DIR=/cluster/project/infk/cvg/dusmanum/dev/qt5-build/qtbase/lib/cmake/Qt5

You need to pass them directly to cmake as above cmake .. -DFREEIMAGE_INCLUDE_DIR_HINTS=$FREEIMAGE_DIR -DFREEIMAGE_LIBRARY_DIR_HINTS=$FREEIMAGE_DIR -DTESTS_ENABLED=ON -DCUDA_ARCHS="Pascal;Turing;Volta"

Unfortunately, the problem continues even after the following steps:

1. Loaded Modules: - StdEnv - cmake/3.16.5 - glog/0.3.5 - glew/2.0.0 - openblas/0.3.7 - atlas/3.10.2 - libxcb/1.13 - boost/1.69.0
   - gcc/6.3.0 - eigen/3.3.4 - gflags/2.1.2 - cgal/4.11 - suite-sparse/5.1.0 - mpfr/4.0.1 - mesa/17.2.3 - cuda/11.2.2
2. export FREEIMAGE_DIR=/cluster/directory/to/shared/space/dev/FreeImage/Dist
   export Qt5_DIR=/cluster/directory/to/shared/space/dev/qt5-build/qtbase/lib/cmake/Qt5
   export COLMAP_PATH=/cluster/directory/to/shared/space/dev/colmap/build/src/exe
   export COLMAP_DIR = /cluster/directory/to/shared/space/dev/colmap/build/
3. Reinstall COLMAP

Best,
Oguzhan

Hello. I also had this issue. The problem is the cmake directory is not created in the expected place. You can fix this by running make install after building. You will need to specify a target directory and then use it as your "COLMAP_DIR" for building pycolmap. I did this a couple weeks ago let me know if you want more details.

@oguzhanilter I am replying here instead of email so others can also see it.
After building COLMAP I also ran this to install it to an arbitrary location.

COLMAP_INSTALL_TARGET="/cluster/home/$USER/colmap"  # or what you prefer as long as you can r/w
mkdir $COLMAP_INSTALL_TARGET
bsub -I -n 8 -R "rusage[mem=4096,ngpus_excl_p=1]" "make DESTDIR=$COLMAP_INSTALL_TARGET install -j 8"

Then you will need to

export COLMAP_PATH=$COLMAP_INSTALL_TARGET/usr/local/bin/colmap
export COLMAP_DIR=$COLMAP_INSTALL_TARGET/usr/local/share/colmap

before building pycolmap