Category: Uncategorized

Key Points It seems likely that finding a laptop under AU$3000 capable of running a 20B parameter model for inferencing is challenging due to memory constraints. Research suggests that such models typically require at least 15 GB of GPU memory, but most laptops in this price range have GPUs with 8 GB, like the RTX… Continue reading Laptop that can run 20B parameter model inferencing. under AU$3000

Key Points It seems likely that building a desktop PC with a GPU having at least 16 GB of memory is necessary for running a 20B parameter model, with research suggesting around 15 GB is needed for weights and activations. The evidence leans toward recommending an AMD RX 7900 XT with 20 GB memory for… Continue reading Desktop pc that can run 20B parameter model inferencing. under au$3000

  As a new Technology Radar release with many interesting techs, a few drew my attention. I picked a few looked interesting for dotnet developer. Surprised by so many tools, frameworks around LLM application. It is definitely exploding. Techniques Adopt 1% canary: can achieve the similar results by alpha, beta testing. Azure  cloud deployment slot… Continue reading A DotNet developer’s note on Technology Radar V31