Smart bulb with Smart Relay

There is not much to it.
Put them into a smart socket, but be aware that the smart socket might use nearly as much power as the light bulbs and the light bulbs will not be controllable by HA until they are fully up and running and connected to HA again.
How they react to the power coming back on is up to the firmware in the bulb. Philips Hue bulbs can be set to a preset state for power back situation and others might just go to full brightness.