I’ve used caldav with nextcloud successfully in the past for calendars. Tasks will show up as todo list entities. I didn’t use any custom yaml config.
You can try to enabling debug log Troubleshooting your configuration - Home Assistant and it will probably give you more details about what its doing with the server.