Matrix Voice, Snips & Home Assistant working together

#41

ok I got it installed following the top part of the thread and got the demo going but no reply is tts not working?

#42

pi@raspberrypi:~ $ snips-watch -vvv
[17:47:32] Watching on localhost:1883 (MQTT)
[17:47:35] [Hotword] detected on site default, for model default
[17:47:35] [Asr] was asked to stop listening on site default
[17:47:35] [Hotword] was asked to toggle itself ‘off’ on site default
[17:47:35] [Dialogue] session with id ‘1242416f-6a3a-4c9a-b6ac-3981790931bf’ was started on site default
[17:47:35] [Asr] was asked to listen on site default
[17:47:40] [Asr] captured text “what’s the weather” in 5.0s
[17:47:40] [Asr] was asked to stop listening on site default
[17:47:40] [Nlu] was asked to parse input what’s the weather
[17:47:40] [Nlu] detected intent searchWeatherForecast with probability 0.993 for input “what’s the weather”
[17:47:40] [Dialogue] New intent detected searchWeatherForecast with probability 0.993
[17:47:46] [Dialogue] session with id ‘1242416f-6a3a-4c9a-b6ac-3981790931bf’ was ended on site default. The session was ended because one of the component didn’t respond in a timely manner
[17:47:46] [Asr] was asked to stop listening on site default
[17:47:46] [Hotword] was asked to toggle itself ‘on’ on site default

#43

That is absolute correct, you only need a client to actually respond to that intent :slight_smile:

How to do that, is more a thing of snips, https://snips.ai/
They have a discord channel as well, with a lively chat :slight_smile:

For Home Assistant integration, I advise you to check to component Snips.
On the discord of snips, there is also a home-assistant channel

#44

Just a little question about controller a light with Matrix ,Snips ,HOME ASSISTANT. Should I need a special light bulb(bluetooth,zwave ,zigbee…) or just a Ordinary lamp?

If an ordinary lamp ,how to connect it with the home assistant? Need to Re-wiring ?

#45

Well, you need some sort of connectivity in your lamp.
This can be a wifi light bulb or you can change your switch to a smart switch of sort (if you google you will find tons of options like https://getden.co.uk/ or SonOff and you could use all sorts of 433hz devices, just too many to list all of them here :wink: ) No need to rewire though, in the majority of cases you just replace some old part with a connected one or put a device in between the switch and the bulb

#46

Thanks for your answer. You said this can be a wifi light bulb. So it also could be a Zigbee light bulb or Z-wave or even a bluetooth light bulb? Just connect this light with Home assistant and matrix .Right?

#47

Yes, but you should make sure that you first can control your light within Home Assistant.
I mean without any voice control.

The forum for Home Assistant is also very alive, you can find a lot of help there.
After that, you need to add voice control to Home Assistant, i.e. Snips.
The input for the voice control (a.k.a. Microphone) can then be the Matrix Voice or Creator.

So “Just connect this light with Home assistant and matrix” is too simply said.

#48

Thanks for your answer. I’d like followed your full steps.
But after I run sudo apt install matrixio-kernel-modules

It show the error message

Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gyp libjs-inherits libjs-node-uuid libuv1-dev lxkeymap node-abbrev node-ansi node-ansi-color-table node-archy node-async
  node-balanced-match node-block-stream node-brace-expansion node-builtin-modules node-combined-stream node-concat-map
  node-cookie-jar node-delayed-stream node-forever-agent node-form-data node-fs.realpath node-fstream node-fstream-ignore
  node-github-url-from-git node-glob node-graceful-fs node-hosted-git-info node-inflight node-inherits node-ini
  node-is-builtin-module node-isexe node-json-stringify-safe node-lockfile node-lru-cache node-mime node-minimatch
  node-mkdirp node-mute-stream node-node-uuid node-nopt node-normalize-package-data node-npmlog node-once node-osenv
  node-path-is-absolute node-pseudomap node-qs node-read node-read-package-json node-request node-retry node-rimraf
  node-semver node-sha node-slide node-spdx-correct node-spdx-expression-parse node-spdx-license-ids node-tar
  node-tunnel-agent node-underscore node-validate-npm-package-license node-which node-wrappy node-yallist python-cairo
  python-gobject python-gobject-2 python-gtk2 python-xklavier
Use 'sudo apt autoremove' to remove them.
The following NEW packages will be installed:
  matrixio-kernel-modules
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B/16.2 kB of archives.
After this operation, 100 kB of additional disk space will be used.
(Reading database ... 171559 files and directories currently installed.)
Preparing to unpack .../matrixio-kernel-modules_0.1.4_armhf.deb ...
Unpacking matrixio-kernel-modules (0.1.4) ...
dpkg: error processing archive /var/cache/apt/archives/matrixio-kernel-modules_0.1.4_armhf.deb (--unpack):
 unable to make backup link of './boot/overlays/matrixio.dtbo' before installing new version: Operation not permitted
Errors were encountered while processing:
 /var/cache/apt/archives/matrixio-kernel-modules_0.1.4_armhf.deb
E: Sub-process /usr/bin/dpkg returned an error code (1)

Do you know the solution?

And I did sudo apt-key adv --keyserver pgp.mit.edu --recv-keys D4F50CDCA10A2849
OR
sudo apt-key adv --keyserver pgp.surfnet.nl --recv-keys D4F50CDCA10A2849
But it showed gpg: keyserver receive failed: No data

Is there other server?

#49

I do not know, those were working fine before…

#50

I’ve removed DUMMY from matrix-mics.conf ,but why it still show these errors?

Jun 18 13:14:51 raspb snips-audio-server[4332]: ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM bluealsa
Jun 18 13:14:51 raspb snips-audio-server[4332]: ALSA lib pcm_hw.c:1713:(_snd_pcm_hw_open) Invalid value for card
Jun 18 13:14:51 raspb snips-audio-server[4332]: ALSA lib pcm_hw.c:1713:(_snd_pcm_hw_open) Invalid value for card
Jun 18 13:14:51 raspb snips-audio-server[4332]: ALSA lib pcm_hw.c:1713:(_snd_pcm_hw_open) Invalid value for card
Jun 18 13:14:51 raspb snips-audio-server[4332]: ALSA lib pcm_hw.c:1713:(_snd_pcm_hw_open) Invalid value for card
Jun 18 13:14:51 raspb snips-audio-server[4332]: connect(2) call to /tmp/jack-115/default/jack_0 failed (err=No such file or directory)
Jun 18 13:14:51 raspb snips-audio-server[4332]: attempt to connect to server failed
Jun 18 13:14:51 raspb snips-audio-server[4332]: INFO:snips_audio_portaudio: Use input device: "default"
Jun 18 13:14:56 raspb snips-audio-server[4332]: ERROR:snips_audio_server   : Source stopped. Bailing out.
Jun 18 13:14:56 raspb systemd[1]: snips-audio-server.service: Main process exited, code=exited, status=1/FAILURE
Jun 18 13:14:56 raspb systemd[1]: snips-audio-server.service: Unit entered failed state.
Jun 18 13:14:56 raspb systemd[1]: snips-audio-server.service: Failed with result 'exit-code'.
#51

Why run " snips-watch” ，it just show

“Watching on localhost:1883 (MQTT)” ,then the cursor stop there and show nothing .

#52

what is your output of arecord -l

snips-watch shows only logs, so when nothing is to be done no lines will be shown

#53

The output of arecord -l

**** List of CAPTURE Hardware Devices ****
card 1: SOUND [MATRIXIO SOUND], device 0: matrixio.mic.0 snd-soc-dummy-dai-0 []
  Subdevices: 1/1
  Subdevice #0: subdevice #0

Do we need configure /etc/snips.toml file or just keep original ?

#55

Try sudo apt-key adv --keyserver hkp://pgp.mit.edu:80 --recv-keys D4F50CDCA10A2849

#56

Microphones from Matrix Voice worked with Snips as long as I did first “apt-get upgrade” on Raspberry. After that update, Matrix Voice did not work any more.

#57

Hi @milode,

Please, take a look to this Hackster post MATRIX Voice and MATRIX Creator Running Snips.ai

Are LEDs working? or is just the mics?
Ultimately you could use this guide - Hardware Test: Microphones , to check for hardware issues.

Let us know the results

Yoel

#58

Hi @yoelrc88,
thanks a lot for reply.
At the moment I have stopped working with Matrix Voice, because the audio output of Matrix Voice does not work either. I have the impression Matrix Voice isn’t really finished yet.

I am currently trying ReSpeaker 2-Mic/4-Mic/6-Mic Pi HAT from Seeed. The microphones and the audio output work here without problems with snips.

Maybe I’ll try the Matrix Voice again later if it should work stable.
The description on Hackster “MATRIX Voice and MATRIX Creator Running Snips.ai” seems to be very similar to the description of Romkabouter.

Unfortunately I wasted a lot of time with Matrix Voice, in contrast to that ReSpeaker works right away for my purposes.

#59

Hi @milode,

Thanks for the feedback, its always welcomed.

You shouldn’t have any issues with the microphones with Snips, if you have, please post the error and we for sure help you. The output in the kernel modules is currently being worked on due to some bugs, so its not ready yet. We are on that and should be fixed in 1 or 2 weeks max. In the meantime you can use the 3.5mm audio output from the Pi.

Let us know if you need help with the microphones.

-Yoel

#60

Hi Yoel,
thanks for reply.
I’m curious to see if audio output works in two weeks.
if this realy works, I will try Matrix Voice again :wink:

#61

Please include an example app as well!