Matrix Voice & Alexa

helenina · February 21, 2018, 1:40pm

Hi,
I have followed all the instructions given on the following website: https://www.hackster.io/matrix-labs/matrix-voice-running-alexa-demo-in-hands-free-mode-404aa3?f=1#comments
Unfortunately nothing happens when I say Alexa. Can you help? Do you have other instruction material?
I have: Rapsberry pi 3 with SD CARD Noobs
Matrix Voice
External speaker
created developer account

Thank you,

H.

yoelrc88 · February 21, 2018, 3:36pm

Can you check if you have MALOS service running?
ps aux | grep malos

Can you also share the packages you have installed, please use:
sudo dpkg --list | grep matrix

Thanks

helenina · February 21, 2018, 5:06pm

Everything seems to be place and this is why i do not understand what is wrong.
After runing the 3rd command for the wake word, I have the following message:
INFO:SensoryWakeWordEngine: mainLoop thread started
INFO:WakeWordAgent: State set to IDLE(2)

The device is not responding at all to my voice
I have installed all the packages that were in the instructions. I do not know of anymore
Can you help?

Thank you

helenina · February 21, 2018, 5:12pm

Also I do not know which package I have or do not have. How do i know what i have?

yoelrc88 · February 21, 2018, 5:30pm

You can open the terminal and type:
sudo dpkg --list | grep matrix

Please also share the output when you type
ps aux | grep malos

Thank you

helenina · February 21, 2018, 6:03pm

Hi!

For sudo dpkg --list | grep matrix, this is what i have:
ii libmatrixio-creator-hal:armhf 0.2.2 armhf Hardware Abstraction Layer for MATRIX.
ii libmatrixio-creator-hal-dev 0.2.2 armhf Hardware Abstraction Layer for MATRIX (headers)
ii libmatrixio-malos:armhf 0.1.2 armhf Libraries of MATRIX abstraction layer for MOS
ii libmatrixio-protos:armhf 0.1.1 armhf Protocolbuffers for MATRIX abstraction layer
ii libswresample2:armhf 7:3.2.10-1~deb9u1+rpt1 armhf FFmpeg library for audio resampling, rematrixing etc. - runtime files
ii matrixio-creator-init 0.4.4 armhf Install scripts that can program the MATRIX Creator FPGA and SAM3 IMU.
ii matrixio-malos 0.3.1 armhf Allows queries to MATRIX Creator hardware via ZMQ.
ii matrixio-openocd 1.0.1 armhf Open on-chip JTAG debug solution for ARM and MIPS systems
ii matrixio-protobuf 3.4.0 armhf Protocol Buffers - Google’s data interchange format. (From GRPC 3.4.0)
ii matrixio-xc3sprog 1.1.1 armhf Spartan3, XCF and CPLD JTAG programmer and other utilities.
ii r-cran-matrix 1.2-7.1-1 armhf GNU R package of classes for dense and sparse matrices

For:ps aux | grep malos this is the result:
root 587 6.6 1.0 763616 9100 ? Ssl 16:46 5:02 /usr/bin/malos
pi 5515 0.0 0.0 4372 556 pts/0 S+ 18:02 0:00 grep --color=auto malos

yoelrc88 · February 21, 2018, 7:11pm

Can you share the outputs of

companionService
javaclient
wakeWordAgent app

You should run them following the step 7 in from the alexa-avs-sample-app documentation.

Thank you

helenina · February 21, 2018, 7:26pm

Hi,

Output for companion:

cd /home/pi/Desktop/alexa-avs-sample-app/samples/companionService && npm start

> alexa-voice-service-sample-companion-service@1.0.0 start /home/pi/Desktop/alexa-avs-sample-app/samples/companionService
> node ./bin/www

This node service needs to be running to store token information memory and vend them for the AVS app.

Listening on port 3000

Output for javaclient

cd /home/pi/Desktop/alexa-avs-sample-app/samples/javaclient && mvn exec:exec
[INFO] Scanning for projects...
[INFO]                                                                         
[INFO] ------------------------------------------------------------------------
[INFO] Building Alexa Voice Service Sample Java Client 20160207.8
[INFO] ------------------------------------------------------------------------
[INFO] 
[INFO] --- exec-maven-plugin:1.2.1:exec (default-cli) @ sample-java-client ---

Output for wakeword

cd /home/pi/Desktop/alexa-avs-sample-app/samples/wakeWordAgent/src && ./wakeWordAgent -e sensory
INFO:main: Starting Wake Word Agent
INFO:WakeWordAgent: State set to IDLE(2)
INFO:Initializing Sensory library | library name: TrulyHandsfree | library version: 5.0.0-beta.10.2 | model file: ../ext/resources/spot-alexa-rpi.snsr
WARNING:Library expires on: License expires on 28 May 2018 00:00:00 GMT
INFO:SensoryWakeWordEngine: mainLoop thread started
INFO:WakeWordIPCSocket::mainLoop thread started
INFO:WakeWordIPCSocket: init socket on port:5123
INFO:===> Connected to AVS client <===
INFO:WakeWordAgent: thread started

yoelrc88 · February 21, 2018, 7:43pm

Can you share the content of the asound file?
more /etc/asound.conf

Thank you

helenina · February 21, 2018, 7:45pm

Hi,
Content of the asoundfile:

pcm.sc {
type hw
card 1
}

pcm.mic_channel0 {
type file
file "/tmp/matrix_micarray_channel_0"
infile "/tmp/matrix_micarray_channel_0"
format "raw"
slave {
pcm sc
}
}

pcm.mic_channel1 {
type file
file "/tmp/matrix_micarray_channel_1"
infile "/tmp/matrix_micarray_channel_1"
format "raw"
slave {
–More–(19%)

helenina · February 22, 2018, 7:17pm

Hi Any reply from yesterday?

yoelrc88 · February 22, 2018, 8:45pm

Everything looks good. Can you test the microphones by recording using

arecord --device=mic_channel0 -r 16000 -c 1 -f S16_LE test.wav

… and then playing it using

aplay ./test.wav

Thank you

helenina · February 22, 2018, 9:00pm

Nothing is happening when i do it

helenina · February 22, 2018, 9:11pm

Sorry the microphone test works. What do i do next?

yoelrc88 · February 22, 2018, 9:15pm

If mics are working good then the wakeword app should be working. Can you double check if the wakeWordAgent app is doing something when you say “Alexa” ?

helenina · February 22, 2018, 9:20pm

Nothing is happening when i do the below command:
cd /home/pi/Desktop/alexa-avs-sample-app/samples/wakeWordAgent/src && ./wakeWordAgent -e sensory

helenina · February 22, 2018, 9:22pm

Thsi is what i have on the terminal:

INFO:main: Starting Wake Word Agent
INFO:WakeWordAgent: State set to IDLE(2)
INFO:Initializing Sensory library | library name: TrulyHandsfree | library version: 5.0.0-beta.10.2 | model file: …/ext/resources/spot-alexa-rpi.snsr
WARNING:Library expires on: License expires on 28 May 2018 00:00:00 GMT
INFO:SensoryWakeWordEngine: mainLoop thread started
INFO:WakeWordIPCSocket::mainLoop thread started
INFO:WakeWordIPCSocket: init socket on port:5123
INFO:===> Connected to AVS client <===
INFO:WakeWordAgent: thread started

yoelrc88 · February 22, 2018, 9:30pm

Ok, lets check one thing. Can you make sure you cloned the matrix-io repository instead of the alexa repo?

matrix-io repo: git clone https://github.com/matrix-io/alexa-avs-sample-app

alexa repo: git clone https://github.com/alexa/alexa-avs-sample-app

You can check that with :

cd alexa-avs-sample-app/
git remote show origin

you should get the following :

$ git remote show origin
* remote origin
  Fetch URL: https://github.com/matrix-io/alexa-avs-sample-app.git
  Push  URL: https://github.com/matrix-io/alexa-avs-sample-app.git
  HEAD branch: master
  Remote branch:
    master tracked
  Local branch configured for 'git pull':
    master merges with remote master
  Local ref configured for 'git push':
    master pushes to master (up to date)

helenina · February 22, 2018, 9:32pm

I have error message:
pi@xxx:~ $ cd alexa-avs-sample-app/
bash: cd: alexa-avs-sample-app/: No such file or directory
pi@xxx:~ $ git remote show origin
fatal: Not a git repository (or any of the parent directories): .git
What should i do?

yoelrc88 · February 22, 2018, 9:38pm

Sorry, with the correct address for your folder would be:

cd ~/Desktop/alexa-avs-sample-app/
git remote show origin