Skip to content

Instantly share code, notes, and snippets.

@OrsoEric
Created February 16, 2025 12:22
Show Gist options
  • Save OrsoEric/25f12fd8d2e89d5c13c81ae93465d896 to your computer and use it in GitHub Desktop.
Save OrsoEric/25f12fd8d2e89d5c13c81ae93465d896 to your computer and use it in GitHub Desktop.
C:\Program Files\AMD\ROCm\5.7\bin>hipcc --version
HIP version: 5.7.32000-193a0b56e
clang version 17.0.0 ([email protected]:Compute-Mirrors/llvm-project 6e709f613348e5258188527d11ee8d78376f26b7)
Target: x86_64-pc-windows-msvc
Thread model: posix
InstalledDir: C:\Program Files\AMD\ROCm\5.7\\bin
C:\Program Files\AMD\ROCm\5.7\bin>hipinfo
--------------------------------------------------------------------------------
device# 0
Name: AMD Radeon RX 7900 XTX
pciBusID: 3
pciDeviceID: 0
pciDomainID: 0
multiProcessorCount: 48
maxThreadsPerMultiProcessor: 2048
isMultiGpuBoard: 0
clockRate: 2482 Mhz
memoryClockRate: 1250 Mhz
memoryBusWidth: 0
totalGlobalMem: 23.98 GB
totalConstMem: 2147483647
sharedMemPerBlock: 64.00 KB
canMapHostMemory: 1
regsPerBlock: 0
warpSize: 32
l2CacheSize: 4194304
computeMode: 0
maxThreadsPerBlock: 1024
maxThreadsDim.x: 1024
maxThreadsDim.y: 1024
maxThreadsDim.z: 1024
maxGridSize.x: 2147483647
maxGridSize.y: 65536
maxGridSize.z: 65536
major: 11
minor: 0
concurrentKernels: 1
cooperativeLaunch: 0
cooperativeMultiDeviceLaunch: 0
isIntegrated: 0
maxTexture1D: 16384
maxTexture2D.width: 16384
maxTexture2D.height: 16384
maxTexture3D.width: 2048
maxTexture3D.height: 2048
maxTexture3D.depth: 2048
isLargeBar: 0
asicRevision: 0
maxSharedMemoryPerMultiProcessor: 64.00 KB
clockInstructionRate: 1000.00 Mhz
arch.hasGlobalInt32Atomics: 1
arch.hasGlobalFloatAtomicExch: 1
arch.hasSharedInt32Atomics: 1
arch.hasSharedFloatAtomicExch: 1
arch.hasFloatAtomicAdd: 1
arch.hasGlobalInt64Atomics: 1
arch.hasSharedInt64Atomics: 1
arch.hasDoubles: 1
arch.hasWarpVote: 1
arch.hasWarpBallot: 1
arch.hasWarpShuffle: 1
arch.hasFunnelShift: 0
arch.hasThreadFenceSystem: 1
arch.hasSyncThreadsExt: 0
arch.hasSurfaceFuncs: 0
arch.has3dGrid: 1
arch.hasDynamicParallelism: 0
gcnArchName: gfx1100
peers:
non-peers: device#0
memInfo.total: 23.98 GB
memInfo.free: 23.86 GB (99%)
@OrsoEric
Copy link
Author

LM Studio llama.cpp rocm runtime 1.15.3

🥲 Failed to load the model
Failed to load LLM engine from path: C:\Users\FatherOfMachines.cache\lm-studio\extensions\backends\llama.cpp-win-x86_64-amd-rocm-avx2-1.15.3\llm_engine_rocm.node. \?\C:\Users\FatherOfMachines.cache\lm-studio\extensions\backends\llama.cpp-win-x86_64-amd-rocm-avx2-1.15.3\llm_engine_rocm.node is not a valid Win32 application.
\?\C:\Users\FatherOfMachines.cache\lm-studio\extensions\backends\llama.cpp-win-x86_64-amd-rocm-avx2-1.15.3\llm_engine_rocm.node

@OrsoEric
Copy link
Author

C:\Program Files\AMD\ROCm\6.2\bin

execute
hipcc --version

missing perl
https://strawberryperl.com/

install

close reopen cmd

first attempt was with HIP6.2

C:\Program Files\AMD\ROCm\6.2\bin>hipcc --version
HIP version: 6.2.41512-db3292736
clang version 19.0.0git ([email protected]:Compute-Mirrors/llvm-project 5353ca3e0e5ae54a31eeebe223da212fa405567a)
Target: x86_64-pc-windows-msvc
Thread model: posix
InstalledDir: C:\Program Files\AMD\ROCm\6.2\bin

add
C:\Program Files\AMD\ROCm\6.2\bin to path

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment