1070 has only 8GB VRAM thats very low but maybe you can load the llama2_7B into it or some smaller model, I recommend to join and ask this on reddit.com/r/LocalLLaMA maybe someone has tried on 1070. Worst case it does not run but at least you will have everything else ready other then getting a newer GPU. Basic steps are:
install proxmox
enable the GPU pass thru to the virtual machine (ubuntu 22.04)
enable CPU AVX flags pass thru to the virtual machine (many ppl miss this part) just change the VM settings for CPU to âHOSTâ
Install nvidia GPU driver , CUDA version 12.x nowadays
check if the GPU is available on the VM with command nvidia-smi
Install ollama or if you want to use the GPU for other things like Frigate, then install frigate in a docker and pass thru the virtual GPU to the container.
will take time to figure out and setup all these but once running it runs âforeverâ
Iâm looking on the internet to buy 3x NCR18650B Panasonic for the BOX-3. Viewed some vids on YouTube and there seems to be a lot of FAKE manufactured batteries sold on Amazone / Ebay / Ali etc.
What are the best websites for the genuine NCR18650B Panasonic for a sound price? Might want to share a link? Thanks
You might want to narrow that question down to an individual country. Shipping batteries isnt cheap and its best to start your search closer and then move out. I know a couple in the US but if your in EU, my places wont be very helpful.
Prices are sky high on amazon and if you use ebay or especially aliexpress, you must do due diligence and ask around for reputable vendors. That place is full of scammers who and vendors selling fake, damaged or rewrapped batteries to make them appear to be something its not. You cant even use the ratings system there because its all fake.
Batteries are targeted heavily by scammers on aliexpress too. Buying lipo or lifepo4 cells is like playing in traffic. Your gonna get hit by someone sooner than later.
Iâve bought an 18650 battery recently, and it didnât fit into the socket either.
I noticed, that the batteries you can buy are simulating the design of a type AA or AAA battery (especially on the + pole)âŚ
Also, with their additional electronic, they are a bit larger than a standard 18650 which Iâve removed from a small and cheap solar-powered garden lamp âŚ
The battery will fit into the socket if the protection electronic will be removed, but I would not do that - at least, as long I would have another type 18650 battery that does fit.
Now, I am considering a use-case for the other one
Mine was a normal 18650 without the IC protection but it did have the bump on the +'ve end like an AA or AAA. True 18650âs donât have this bump nor any IC protection. With the bump, mine just fits with a wee bulge in the case on the +'ve end.
I bought mine at a local DIY shop Bunnings. Two for $13 (NZD).
The Sensor Dock for the S3-Box-3 has the IC protection built into the unit. The chip is in the schematics is an AP5056 and this provides the protection that you are looking for.
I think the 18650 you have is designed for something more consumer grade that has no protection on the charging circuit.
In my humble opinion, youâre best to use the âmanufactured batteries sold on Amazon / Ebay / Aliâ as that is what it is designed to use.
Sorry, prob not what you wanted to hear.
However, having said this, the 18650 spec describes the physical shape and dimensions and I see your spec sheet lists the length as 65.3mm. This is only 0.3mm longer than the spec. I think the chip is built inside the cell by subtracting a little of the active material so that the length is still the same. So it should still fit with some effort and care. No expert, but I donât think the chip inside the Panasonic cell will interfere with the AP5056 charging chip.
Thanks a bunch for your detailed reply and pointing out and explaining that the Sensor Dock for the S3-Box-3 has the IC protection built into the unit. Thatâs a great relieve. TBH; I canât read electronic schematics, so your post is a great addition to this thread, much appreciated.
Thank you John. This works for me as well with the radar. I guess the temperature and humidity sensors canât work without the I2C bus? You mentioned above you will recode it without the i2c.