AVM Integration issues since 2021.11.0

I seem some strange things about my disk usages after the latest update. Has something been changed dramatically with the recorder integration? I have nothing special setup, just local on my SD card and only excluded a bunch of entities. However, I all of a sudden see this dramatic increase in usage and apparently a lot more write actions to the SD card, which makes me worry a lot about SD Card life (and actually running out of space really soon…)

Any ideas what is going on here?

1 Like

What is the current size of the db? It is possible something other than the db is using space.

It is the db file. It is now 600 MB and increasing dramatically

There are several changes to recorder that may increase size:

There are others but I do not believe that will have a drastic effect (or any)

My db with 2021.09 is a whopping 7GB, so yours seems minuscule by comparison, but the write amplification to an SD card is a huge concern no matter the size. Do you have any way to measure host writes to the card?

I really don’t understand what may cause this effect. I did browse the changes to the recorder as well, but do not see anything in there which would cause this effect for me.

I know the DB size is still pretty small, but as you mentioned, I am not too concerned about the size more the amounts of commits to the SD Card. I do not know how I could measure this, besides see the updates on the disk size usage.

Can you get to a terminal and run:

cat /proc/diskstats | grep mmcblk0

Then do it again about 5 minutes later

Wait a sec…just looking at it more detailed…it is the LOG file which explodes…

This is an extract from this:

<scpd xmlns="urn:schemas-upnp-org:service-1-0">
<specVersion>
<major>1</major>
<minor>0</minor>
</specVersion>
<actionList>
<action>
<name>SetConnectionType</name>
<argumentList>
<argument>
<name>NewConnectionType</name>
<direction>in</direction>
<relatedStateVariable>ConnectionType</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetConnectionTypeInfo</name>
<argumentList>
<argument>
<name>NewConnectionType</name>
<direction>out</direction>
<relatedStateVariable>ConnectionType</relatedStateVariable>
</argument>
<argument>
<name>NewPossibleConnectionTypes</name>
<direction>out</direction>
<relatedStateVariable>PossibleConnectionTypes</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetAutoDisconnectTime</name>
<argumentList>
<argument>
<name>NewAutoDisconnectTime</name>
<direction>out</direction>
<relatedStateVariable>AutoDisconnectTime</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetIdleDisconnectTime</name>
<argumentList>
<argument>
<name>NewIdleDisconnectTime</name>
<direction>out</direction>
<relatedStateVariable>IdleDisconnectTime</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>RequestConnection</name>
</action>
<action>
<name>RequestTermination</name>
</action>
<action>
<name>ForceTermination</name>
</action>
<action>
<name>GetStatusInfo</name>
<argumentList>
<argument>
<name>NewConnectionStatus</name>
<direction>out</direction>
<relatedStateVariable>ConnectionStatus</relatedStateVariable>
</argument>
<argument>
<name>NewLastConnectionError</name>
<direction>out</direction>
<relatedStateVariable>LastConnectionError</relatedStateVariable>
</argument>
<argument>
<name>NewUptime</name>
<direction>out</direction>
<relatedStateVariable>Uptime</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetNATRSIPStatus</name>
<argumentList>
<argument>
<name>NewRSIPAvailable</name>
<direction>out</direction>
<relatedStateVariable>RSIPAvailable</relatedStateVariable>
</argument>
<argument>
<name>NewNATEnabled</name>
<direction>out</direction>
<relatedStateVariable>NATEnabled</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetGenericPortMappingEntry</name>
<argumentList>
<argument>
<name>NewPortMappingIndex</name>
<direction>in</direction>
<relatedStateVariable>PortMappingNumberOfEntries</relatedStateVariable>
</argument>
<argument>
<name>NewRemoteHost</name>
<direction>out</direction>
<relatedStateVariable>RemoteHost</relatedStateVariable>
</argument>
<argument>
<name>NewExternalPort</name>
<direction>out</direction>
<relatedStateVariable>ExternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewProtocol</name>
<direction>out</direction>
<relatedStateVariable>PortMappingProtocol</relatedStateVariable>
</argument>
<argument>
<name>NewInternalPort</name>
<direction>out</direction>
<relatedStateVariable>InternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewInternalClient</name>
<direction>out</direction>
<relatedStateVariable>InternalClient</relatedStateVariable>
</argument>
<argument>
<name>NewEnabled</name>
<direction>out</direction>
<relatedStateVariable>PortMappingEnabled</relatedStateVariable>
</argument>
<argument>
<name>NewPortMappingDescription</name>
<direction>out</direction>
<relatedStateVariable>PortMappingDescription</relatedStateVariable>
</argument>
<argument>
<name>NewLeaseDuration</name>
<direction>out</direction>
<relatedStateVariable>PortMappingLeaseDuration</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetSpecificPortMappingEntry</name>
<argumentList>
<argument>
<name>NewRemoteHost</name>
<direction>in</direction>
<relatedStateVariable>RemoteHost</relatedStateVariable>
</argument>
<argument>
<name>NewExternalPort</name>
<direction>in</direction>
<relatedStateVariable>ExternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewProtocol</name>
<direction>in</direction>
<relatedStateVariable>PortMappingProtocol</relatedStateVariable>
</argument>
<argument>
<name>NewInternalPort</name>
<direction>out</direction>
<relatedStateVariable>InternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewInternalClient</name>
<direction>out</direction>
<relatedStateVariable>InternalClient</relatedStateVariable>
</argument>
<argument>
<name>NewEnabled</name>
<direction>out</direction>
<relatedStateVariable>PortMappingEnabled</relatedStateVariable>
</argument>
<argument>
<name>NewPortMappingDescription</name>
<direction>out</direction>
<relatedStateVariable>PortMappingDescription</relatedStateVariable>
</argument>
<argument>
<name>NewLeaseDuration</name>
<direction>out</direction>
<relatedStateVariable>PortMappingLeaseDuration</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>AddPortMapping</name>
<argumentList>
<argument>
<name>NewRemoteHost</name>
<direction>in</direction>
<relatedStateVariable>RemoteHost</relatedStateVariable>
</argument>
<argument>
<name>NewExternalPort</name>
<direction>in</direction>
<relatedStateVariable>ExternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewProtocol</name>
<direction>in</direction>
<relatedStateVariable>PortMappingProtocol</relatedStateVariable>
</argument>
<argument>
<name>NewInternalPort</name>
<direction>in</direction>
<relatedStateVariable>InternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewInternalClient</name>
<direction>in</direction>
<relatedStateVariable>InternalClient</relatedStateVariable>
</argument>
<argument>
<name>NewEnabled</name>
<direction>in</direction>
<relatedStateVariable>PortMappingEnabled</relatedStateVariable>
</argument>
<argument>
<name>NewPortMappingDescription</name>
<direction>in</direction>
<relatedStateVariable>PortMappingDescription</relatedStateVariable>
</argument>
<argument>
<name>NewLeaseDuration</name>
<direction>in</direction>
<relatedStateVariable>PortMappingLeaseDuration</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>DeletePortMapping</name>
<argumentList>
<argument>
<name>NewRemoteHost</name>
<direction>in</direction>
<relatedStateVariable>RemoteHost</relatedStateVariable>
</argument>
<argument>
<name>NewExternalPort</name>
<direction>in</direction>
<relatedStateVariable>ExternalPort</relatedStateVariable>
</argument>
<argument>
<name>NewProtocol</name>
<direction>in</direction>
<relatedStateVariable>PortMappingProtocol</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>GetExternalIPAddress</name>
<argumentList>
<argument>
<name>NewExternalIPAddress</name>
<direction>out</direction>
<relatedStateVariable>ExternalIPAddress</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>X_AVM_DE_GetExternalIPv6Address</name>
<argumentList>
<argument>
<name>NewExternalIPv6Address</name>
<direction>out</direction>
<relatedStateVariable>ExternalIPv6Address</relatedStateVariable>
</argument>
<argument>
<name>NewPrefixLength</name>
<direction>out</direction>
<relatedStateVariable>PrefixLength</relatedStateVariable>
</argument>
<argument>
<name>NewValidLifetime</name>
<direction>out</direction>
<relatedStateVariable>ValidLifetime</relatedStateVariable>
</argument>
<argument>
<name>NewPreferedLifetime</name>
<direction>out</direction>
<relatedStateVariable>PreferedLifetime</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>X_AVM_DE_GetIPv6Prefix</name>
<argumentList>
<argument>
<name>NewIPv6Prefix</name>
<direction>out</direction>
<relatedStateVariable>IPv6Prefix</relatedStateVariable>
</argument>
<argument>
<name>NewPrefixLength</name>
<direction>out</direction>
<relatedStateVariable>PrefixLength</relatedStateVariable>
</argument>
<argument>
<name>NewValidLifetime</name>
<direction>out</direction>
<relatedStateVariable>ValidLifetime</relatedStateVariable>
</argument>
<argument>
<name>NewPreferedLifetime</name>
<direction>out</direction>
<relatedStateVariable>PreferedLifetime</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>X_AVM_DE_GetDNSServer</name>
<argumentList>
<argument>
<name>NewIPv4DNSServer1</name>
<direction>out</direction>
<relatedStateVariable>IPv4DNSServer1</relatedStateVariable>
</argument>
<argument>
<name>NewIPv4DNSServer2</name>
<direction>out</direction>
<relatedStateVariable>IPv4DNSServer2</relatedStateVariable>
</argument>
</argumentList>
</action>
<action>
<name>X_AVM_DE_GetIPv6DNSServer</name>
<argumentList>
<argument>
<name>NewIPv6DNSServer1</name>
<direction>out</direction>
<relatedStateVariable>IPv6DNSServer1</relatedStateVariable>
</argument>
<argument>
<name>NewValidLifetime1</name>
<direction>out</direction>
<relatedStateVariable>ValidLifetime1</relatedStateVariable>
</argument>
<argument>
<name>NewIPv6DNSServer2</name>
<direction>out</direction>
<relatedStateVariable>IPv6DNSServer2</relatedStateVariable>
</argument>
<argument>
<name>NewValidLifetime</name>
<direction>out</direction>
<relatedStateVariable>ValidLifetime2</relatedStateVariable>
</argument>
</argumentList>
</action>
</actionList>
<serviceStateTable>
<stateVariable sendEvents="no">
<name>ConnectionType</name>
<dataType>string</dataType>
<defaultValue>Unconfigured</defaultValue>
</stateVariable>
<stateVariable sendEvents="yes">
<name>PossibleConnectionTypes</name>
<dataType>string</dataType>
<allowedValueList>
<allowedValue>Unconfigured</allowedValue>
<allowedValue>IP_Routed</allowedValue>
<allowedValue>IP_Bridged</allowedValue>
</allowedValueList>
</stateVariable>
<stateVariable sendEvents="yes">
<name>ConnectionStatus</name>
<dataType>string</dataType>
<defaultValue>Unconfigured</defaultValue>
<allowedValueList>
<allowedValue>Unconfigured</allowedValue>
<allowedValue>Connecting</allowedValue>
<allowedValue>Authenticating</allowedValue>
<allowedValue>Connected</allowedValue>
<allowedValue>PendingDisconnect</allowedValue>
<allowedValue>Disconnecting</allowedValue>
<allowedValue>Disconnected</allowedValue>
</allowedValueList>
</stateVariable>
<stateVariable sendEvents="no">
<name>Uptime</name>
<dataType>ui4</dataType>
<defaultValue>0</defaultValue>
<allowedValueRange>

It is coming from the AVM FritzBox integration…don’t know what happened there, again…I really only updated to the latest HASS core…

2 Likes

Thanks for the link. That solved it…!