Not the Pi5, but some recent ARM based and Intel processors come with a builtin neural processing unit (NPU).I think the point is that running neural networks with billions of parameters on the desktop is a daily use for some people. From what I can tell that sort of thing is likely to be more common as local AI gets built into desktop applications.I have no idea what you are writing about.The only things I found so far that push my Pi5 to the redline has been running LLMs and Stable Diffusion.
But the three old PCs in the house are going to need a decent GPU card to do any better.
To go from one SD image in 3minute to 12 images per minute I will need a better PC that can run a RTX3060.
That's about $1500-2000 AUD.
I could just get another Pi5 and run it overnight to give me 300-500 images.
Online images are cheaper than new PC but running locally gives me more control.
Statistics: Posted by lurk101 — Sun Mar 24, 2024 2:33 am
