Esphome rttl passiv buzzer

Hi,
I’m building a workshop door sensor with rttl buzzer, temp/humidity sensor and a reed sensor. I am using Wemos d1 mini and my config is as follows:

substitutions:
  # Device Names
  friendly_name: "workshop"

esphome:
  name: workshop-sensor
  platform: ESP8266
  board: d1_mini

# Enable logging
logger:

# Enable Home Assistant API
api:
  encryption:
    key: "top_secret_code"
  services:
    - service: workshhop_play_rtttl
      variables:
        song_str: string
      then:
        - rtttl.play:
            rtttl: !lambda 'return song_str;'
ota:
  password: "top_secret"

wifi:
  networks:
  - ssid: !secret wifi_ssid
    password: !secret wifi_password
  - ssid: !secret wifi2_ssid
    password: !secret wifi_password
  manual_ip:
    static_ip: 192.168.x.x
    gateway: 192.168.x.x
    subnet: 255.255.255.0
    dns1: 192.168.x.x
    dns2: 192.168.x.x

captive_portal:

sensor:
#WiFi Signal
  - platform: wifi_signal
    name: ${friendly_name} WiFi Signal Sensor
    update_interval: 180s
  - platform: dht
    pin: 5
    temperature:
      name: ${friendly_name} Temperature
    humidity:
      name: ${friendly_name} Humidity
    update_interval: 60s

binary_sensor:
#Reed sensor
  - platform: gpio
    pin:
      number: 4
      mode: INPUT_PULLUP
    name: ${friendly_name}
    device_class: door

time:
  - platform: homeassistant
    id: homeassistant_time

output:
  - platform: esp8266_pwm
    pin: 14
    id: buzzer

rtttl:
  output: buzzer

Everything works fine but the buzzer seems to be picking up line noise or wifi noise and you can hear very faint clicking from the buzzer.
I have another similar sensor setup in my other workshop but based on nodemcu 32 and there is no problems like that
Is that something that is caused by wemos d1 mini? (this is my first project based on this board) Any way of eliminating it?
Thanks

This must be wemos d1 related - as I had fresh delivery of wemos s2 boards I tried one of them and voila no annoying buzzing and clicking.