I followed the instructions below.\u00a0<\/p>\n
\u00a0<\/p>\n
(129) Force Ollama to Use Your AMD GPU (even if it’s not officially supported) – YouTube<\/a><\/p>\n \u00a0<\/p>\n Issues Running Ollama on Windows 10 with AMD Radeon RX 6700 XT and ROCm 6.1 : r\/ollama<\/a><\/p>\n \u00a0<\/p>\n Running ollama with an AMD Radeon 6600 XT \u00b7 Major Hayden<\/a><\/p>\n \u00a0<\/p>\n likelovewant\/ollama-for-amd: Get up and running with Llama 3, Mistral, Gemma, and other large language models.by adding more amd gpu support.<\/a><\/p>\n \u00a0<\/p>\n It was quite promising, but it failed in the end. Maybe my graphics cards was too old. \ud83d\ude41\u00a0<\/p>\n \u00a0<\/p>\n and the, I found a way to utilize my old GPU, which is using LM Studio instead of ollama.\u00a0<\/p>\n This just worked.\u00a0<\/p>\n However, the performance improvement is not that impressive. It was 5.x token\/s with GPU while 3.x token\/s with CPU only.\u00a0<\/p>\n GPU did it’s role quite fast but when generating output still heavily used CPU, which ended up slow total response time.\u00a0<\/p>\n","protected":false},"excerpt":{"rendered":" I followed the instructions below.\u00a0 \u00a0 (129) Force Ollama to Use Your AMD GPU (even if it’s not officially supported) – YouTube \u00a0 Issues Running Ollama on Windows 10 with AMD Radeon RX 6700 XT and ROCm 6.1 : r\/ollama \u00a0 Running ollama with an AMD Radeon 6600 XT \u00b7 Major Hayden \u00a0 likelovewant\/ollama-for-amd: Get… Continue reading Running ollama on RX 5600M<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4306","post","type-post","status-publish","format-standard","hentry","category-uncategorized","entry"],"_links":{"self":[{"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/posts\/4306","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/comments?post=4306"}],"version-history":[{"count":2,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/posts\/4306\/revisions"}],"predecessor-version":[{"id":4323,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/posts\/4306\/revisions\/4323"}],"wp:attachment":[{"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/media?parent=4306"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/categories?post=4306"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/moneystock.net\/wp\/wp-json\/wp\/v2\/tags?post=4306"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}