I do have an ESP32-S3-BOX, installed using Windows. Unfortunately, not with a full setup guide. As I recall, I found some reasonable guides to install WSL2 & docker, then the Willow Application Server installed as documented. At that point, I could get to the WAS application from the host machine (http://172.17.39.174:8502, IP address from WSL command line: ip route get 1.1.1.1 | grep -oP 'src \K\S+' ). To make this available from the rest of the local network (and in particular the ESP32 box!), I needed to forward the port - from an admin command prompt:
netsh interface portproxy add v4tov4 listenport=8502 listenaddress=0.0.0.0 connectport=8502 connectaddress=172.17.39.174
And I had to open the port in Windows firewall.
I haven’t tried a local inference server yet (mostly because my graphics card is AMD rather than NVidia)
2 Likes