Hi Keith,
just so you have another pinout to confuse matters even more ! This is my goto for the ESP32-S3-N16R8
i2s_audio:
- id: va_mic
i2s_lrclk_pin: GPIO3
i2s_bclk_pin: GPIO2
- id: va_spk
i2s_lrclk_pin: GPIO6
i2s_bclk_pin: GPIO7
microphone:
platform: i2s_audio
id: mic
adc_type: external
i2s_audio_id: va_mic
i2s_din_pin: GPIO4
channel: left
pdm: false
speaker:
platform: i2s_audio
id: spk
dac_type: external
i2s_audio_id: va_spk
i2s_dout_pin: GPIO8
that is with an inmp441 mic and the Max98357 DAC
No issue with noise and get clear audio input from the mic 
Cheers
Rob