Project Summary – ESP32-S3 Door Viewer (peephole) with Local Display and Home Assistant Integration

I am wondering if it would be even possible to build a DIY smart door viewer using an ESP32-S3 module.
The goal is to have both a local display and remote access through Home Assistant (via web server or RTSP streaming).

Goals / Requirements

  1. Simultaneous use of camera and TFT display via the ESP32-S3 LCD/CAM controller
  2. Motion detection trigger: when motion is detected by the camera, the local display turns on and shows the live image; when no motion is detected, the display turns off to save power.
  3. Efficient use of PSRAM for frame buffers and JPEG decoding
  4. Pin mapping that avoids conflicts with USB, SD card, or other peripherals
  5. High refresh rate for the display (~20 MHz pixel clock)
  6. Stable power delivery for camera + TFT + Wi-Fi streaming

What I’m looking for:

  • Advice or examples for connecting OV2640 and a parallel TFT display to ESP32-S3 simultaneously
  • Recommendations for display driver libraries and ESP-IDF setup
  • Any schematics or pin mappings that already work for a similar setup

Initially i thought of buying one of EZVIZ peephole but looks like they stopped supporting RTSP.
Any help is welcome.