Use cuda v11 for driver 525 and older (ollama#6620)

It looks like driver 525 (aka, cuda driver 12.0) has problems with the cuda v12 library we compile against, so run v11 on those older drivers if detected.
lbrando · Sep 4, 2024 · f29b167 · f29b167
1 parent 037a4d1
commit f29b167
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/gpu/cuda_common.go b/gpu/cuda_common.go
@@ -57,7 +57,7 @@ func cudaVariant(gpuInfo CudaGPUInfo) string {
 		}
 	}
 
-	if gpuInfo.computeMajor < 6 || gpuInfo.DriverMajor < 12 {
+	if gpuInfo.computeMajor < 6 || gpuInfo.DriverMajor < 12 || (gpuInfo.DriverMajor == 12 && gpuInfo.DriverMinor == 0) {
 		return "v11"
 	}
 	return "v12"