It seems values are already in list mode, so replace and split is not needed.
This worked for me:
{% set VOLTAGES = state_attr('sensor.sp05b2312190075_delta_voltage', 'cell_voltages') %}
{% for voltage in VOLTAGES %}
voltage {{ loop.index }}: {{ voltage }}
{% endfor %}