I have HA running on a Raspberry Pi 4, and I have set up an OpenAI Conversation Agent to process my commands with a little more ‘intelligence’. I’ve set the voice assistant to prefer local processing for simple commands.
I’ve found the processing time to be very slow, with a simple “turn on the living room and office lights” taking 27 seconds!
I am trying to diagnose where the slowdown is occurring, has anyone else had similar experience with this?
Here is the log of my command:
stage: done
run:
pipeline: [redacted]
language: en
conversation_id: [redacted]
tts_output:
token: hiONVZIiyCDOn-5fYsRyZg.flac
url: /api/tts_proxy/hiONVZIiyCDOn-5fYsRyZg.flac
mime_type: audio/flac
stream_response: false
events:
- type: run-start
data:
pipeline: [redacted]
language: en
conversation_id: [redacted]
tts_output:
token: hiONVZIiyCDOn-5fYsRyZg.flac
url: /api/tts_proxy/hiONVZIiyCDOn-5fYsRyZg.flac
mime_type: audio/flac
stream_response: false
timestamp: "2025-06-14T19:20:03.887178+00:00"
- type: stt-start
data:
engine: stt.home_assistant_cloud
metadata:
language: en-CA
format: wav
codec: pcm
bit_rate: 16
sample_rate: 16000
channel: 1
timestamp: "2025-06-14T19:20:03.888697+00:00"
- type: stt-vad-start
data:
timestamp: 1060
timestamp: "2025-06-14T19:20:04.957459+00:00"
- type: stt-vad-end
data:
timestamp: 3580
timestamp: "2025-06-14T19:20:07.490804+00:00"
- type: stt-end
data:
stt_output:
text: Turn on the living room and office lights.
timestamp: "2025-06-14T19:20:07.524787+00:00"
- type: intent-start
data:
engine: conversation.chatgpt
language: en-CA
intent_input: Turn on the living room and office lights.
conversation_id: [redacted]
device_id: [redacted]
prefer_local_intents: true
timestamp: "2025-06-14T19:20:07.525502+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:10.947848+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
area: Living Room
domain:
- light
id: call_YxlIMYkwTcTbBON6l9qzSa44
timestamp: "2025-06-14T19:20:11.488117+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_YxlIMYkwTcTbBON6l9qzSa44
tool_name: HassTurnOn
tool_result:
error: MatchFailedError
error_text: >-
<MatchFailedError result=MatchTargetsResult(is_match=False,
no_match_reason=<MatchFailedReason.ASSISTANT: 8>, states=[],
no_match_name=None, areas=[], floors=[]),
constraints=MatchTargetsConstraints(name=None, area_name='Living
Room', floor_name=None, domains={'light'}, device_classes=None,
features=None, states=None, assistant='conversation',
allow_duplicate_names=False, single_target=False),
preferences=MatchTargetsPreferences(area_id='living_room',
floor_id=None)>
timestamp: "2025-06-14T19:20:11.596272+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:21.222180+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
area: Office
domain:
- light
id: call_BWe6stfeh3Vb9jhCqOeloUye
timestamp: "2025-06-14T19:20:21.730628+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_BWe6stfeh3Vb9jhCqOeloUye
tool_name: HassTurnOn
tool_result:
error: MatchFailedError
error_text: >-
<MatchFailedError result=MatchTargetsResult(is_match=False,
no_match_reason=<MatchFailedReason.AREA: 2>, states=[],
no_match_name=None, areas=[AreaEntry(name='Office',
normalized_name='office', created_at=datetime.datetime(1970, 1, 1,
0, 0, tzinfo=datetime.timezone.utc),
modified_at=datetime.datetime(1970, 1, 1, 0, 0,
tzinfo=datetime.timezone.utc), aliases=set(), floor_id=None,
humidity_entity_id=None, icon=None, id='office', labels=set(),
picture=None, temperature_entity_id=None, _cache={'json_fragment':
<orjson.Fragment object at 0x7fa46880f0>})], floors=[]),
constraints=MatchTargetsConstraints(name=None, area_name='Office',
floor_name=None, domains={'light'}, device_classes=None,
features=None, states=None, assistant='conversation',
allow_duplicate_names=False, single_target=False),
preferences=MatchTargetsPreferences(area_id='living_room',
floor_id=None)>
timestamp: "2025-06-14T19:20:21.865861+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:22.999821+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
area: Living Room
domain:
- light
id: call_HHGG7TIlzt3hTop5i25n37Px
timestamp: "2025-06-14T19:20:23.201685+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_HHGG7TIlzt3hTop5i25n37Px
tool_name: HassTurnOn
tool_result:
error: MatchFailedError
error_text: >-
<MatchFailedError result=MatchTargetsResult(is_match=False,
no_match_reason=<MatchFailedReason.ASSISTANT: 8>, states=[],
no_match_name=None, areas=[], floors=[]),
constraints=MatchTargetsConstraints(name=None, area_name='Living
Room', floor_name=None, domains={'light'}, device_classes=None,
features=None, states=None, assistant='conversation',
allow_duplicate_names=False, single_target=False),
preferences=MatchTargetsPreferences(area_id='living_room',
floor_id=None)>
timestamp: "2025-06-14T19:20:23.220164+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:24.411853+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
area: Living Room
domain:
- light
id: call_yKvfDztzcWZ9r0ibMm0GceSc
timestamp: "2025-06-14T19:20:24.648683+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_yKvfDztzcWZ9r0ibMm0GceSc
tool_name: HassTurnOn
tool_result:
error: MatchFailedError
error_text: >-
<MatchFailedError result=MatchTargetsResult(is_match=False,
no_match_reason=<MatchFailedReason.ASSISTANT: 8>, states=[],
no_match_name=None, areas=[], floors=[]),
constraints=MatchTargetsConstraints(name=None, area_name='Living
Room', floor_name=None, domains={'light'}, device_classes=None,
features=None, states=None, assistant='conversation',
allow_duplicate_names=False, single_target=False),
preferences=MatchTargetsPreferences(area_id='living_room',
floor_id=None)>
timestamp: "2025-06-14T19:20:24.753129+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:25.716352+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
name: Living Room Lights
domain:
- light
id: call_x2WUW2mzBHGvecS8gqj6L3Z5
timestamp: "2025-06-14T19:20:25.994872+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_x2WUW2mzBHGvecS8gqj6L3Z5
tool_name: HassTurnOn
tool_result:
speech: {}
response_type: action_done
data:
targets: []
success:
- name: Living Room Lights
type: entity
id: light.living_room_lights
failed: []
timestamp: "2025-06-14T19:20:26.029130+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:31.634348+00:00"
- type: intent-progress
data:
chat_log_delta:
tool_calls:
- tool_name: HassTurnOn
tool_args:
name: Desk lamp
domain:
- switch
id: call_0ECpuao0yPQyYahAOLz7zK2q
timestamp: "2025-06-14T19:20:31.745739+00:00"
- type: intent-progress
data:
chat_log_delta:
role: tool_result
agent_id: conversation.chatgpt
tool_call_id: call_0ECpuao0yPQyYahAOLz7zK2q
tool_name: HassTurnOn
tool_result:
speech: {}
response_type: action_done
data:
targets: []
success:
- name: Desk lamp
type: entity
id: switch.desk_lamp_2
failed: []
timestamp: "2025-06-14T19:20:31.807001+00:00"
- type: intent-progress
data:
chat_log_delta:
role: assistant
timestamp: "2025-06-14T19:20:32.877669+00:00"
- type: intent-progress
data:
chat_log_delta:
content: The
timestamp: "2025-06-14T19:20:32.884778+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " living"
timestamp: "2025-06-14T19:20:32.886310+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " room"
timestamp: "2025-06-14T19:20:32.890062+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " lights"
timestamp: "2025-06-14T19:20:32.890823+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " are"
timestamp: "2025-06-14T19:20:32.971853+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " now"
timestamp: "2025-06-14T19:20:32.975348+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " on"
timestamp: "2025-06-14T19:20:32.980266+00:00"
- type: intent-progress
data:
chat_log_delta:
content: ","
timestamp: "2025-06-14T19:20:32.983508+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " and"
timestamp: "2025-06-14T19:20:32.986465+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " the"
timestamp: "2025-06-14T19:20:32.988758+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " desk"
timestamp: "2025-06-14T19:20:32.991392+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " lamp"
timestamp: "2025-06-14T19:20:32.992148+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " in"
timestamp: "2025-06-14T19:20:32.998022+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " the"
timestamp: "2025-06-14T19:20:32.998751+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " office"
timestamp: "2025-06-14T19:20:33.044991+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " is"
timestamp: "2025-06-14T19:20:33.047320+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " also"
timestamp: "2025-06-14T19:20:33.049812+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " turned"
timestamp: "2025-06-14T19:20:33.051593+00:00"
- type: intent-progress
data:
chat_log_delta:
content: " on"
timestamp: "2025-06-14T19:20:33.062814+00:00"
- type: intent-progress
data:
chat_log_delta:
content: .
timestamp: "2025-06-14T19:20:33.065014+00:00"
- type: intent-end
data:
processed_locally: false
intent_output:
response:
speech:
plain:
speech: >-
The living room lights are now on, and the desk lamp in the
office is also turned on.
extra_data: null
card: {}
language: en-CA
response_type: action_done
data:
targets: []
success: []
failed: []
conversation_id: [redacted]
continue_conversation: false
timestamp: "2025-06-14T19:20:33.128093+00:00"
- type: tts-start
data:
engine: tts.elevenlabs
language: en
voice: 1SM7GgM6IMuvQlz2BwM3
tts_input: >-
The living room lights are now on, and the desk lamp in the office is
also turned on.
timestamp: "2025-06-14T19:20:33.129072+00:00"
- type: tts-end
data:
tts_output:
media_id: media-source://tts/-stream-/hiONVZIiyCDOn-5fYsRyZg.flac
token: hiONVZIiyCDOn-5fYsRyZg.flac
url: /api/tts_proxy/hiONVZIiyCDOn-5fYsRyZg.flac
mime_type: audio/flac
timestamp: "2025-06-14T19:20:33.135746+00:00"
- type: run-end
data: null
timestamp: "2025-06-14T19:20:33.136924+00:00"
stt:
engine: stt.home_assistant_cloud
metadata:
language: en-CA
format: wav
codec: pcm
bit_rate: 16
sample_rate: 16000
channel: 1
done: true
stt_output:
text: Turn on the living room and office lights.
intent:
engine: conversation.chatgpt
language: en-CA
intent_input: Turn on the living room and office lights.
conversation_id: [redacted]
device_id: [redacted]
prefer_local_intents: true
done: true
processed_locally: false
intent_output:
response:
speech:
plain:
speech: >-
The living room lights are now on, and the desk lamp in the office
is also turned on.
extra_data: null
card: {}
language: en-CA
response_type: action_done
data:
targets: []
success: []
failed: []
conversation_id: [redacted]
continue_conversation: false
tts:
engine: tts.elevenlabs
language: en
voice: 1SM7GgM6IMuvQlz2BwM3
tts_input: >-
The living room lights are now on, and the desk lamp in the office is also
turned on.
done: true
tts_output:
media_id: media-source://tts/-stream-/hiONVZIiyCDOn-5fYsRyZg.flac
token: hiONVZIiyCDOn-5fYsRyZg.flac
url: /api/tts_proxy/hiONVZIiyCDOn-5fYsRyZg.flac
mime_type: audio/flac```