Key Points It seems likely that finding a laptop under AU$3000 capable of running a 20B parameter model for inferencing is challenging due to memory constraints. Research suggests that such models typically require at least 15 GB of GPU memory, but most laptops in this price range have GPUs with 8 GB, like the RTX… Continue reading Laptop that can run 20B parameter model inferencing. under AU$3000
Author: rocker8942
Desktop pc that can run 20B parameter model inferencing. under au$3000
Key Points It seems likely that building a desktop PC with a GPU having at least 16 GB of memory is necessary for running a 20B parameter model, with research suggesting around 15 GB is needed for weights and activations. The evidence leans toward recommending an AMD RX 7900 XT with 20 GB memory for… Continue reading Desktop pc that can run 20B parameter model inferencing. under au$3000
A DotNet developer’s note on Technology Radar V31
As a new Technology Radar release with many interesting techs, a few drew my attention. I picked a few looked interesting for dotnet developer. Surprised by so many tools, frameworks around LLM application. It is definitely exploding. Techniques Adopt 1% canary: can achieve the similar results by alpha, beta testing. Azure cloud deployment slot… Continue reading A DotNet developer’s note on Technology Radar V31
DDD Perth 2024
There was again DDD Perth 10th event at beautiful Optus Stadium in 2024. The event was the biggest ever as I remember. Below are the talks I joined. I skipped all the 20 minutes or shorter talks as these are just scratching the surface session. Exploring the Latest in Multimodal Generative AI Presented general idea… Continue reading DDD Perth 2024
HangFire Anti-Pattern – Having independent HangFire instance
It is my experience of anti-pattern of HangFire implementation. We have multiple applications that needs HangFire feature. The idea was to be scalable and centralized at the same time. We figured out that it’s possible to install a HangFire as a separate windows service having its own database. We set up Hangfire Dashborad as a… Continue reading HangFire Anti-Pattern – Having independent HangFire instance