[Solved] Kitt_ai wakeword engine still not working on Matrix VOICE

OPK · April 11, 2018, 8:06pm

CMakeFiles/Makefile2:8100: recipe for target ‘SampleApp/src/CMakeFiles/SampleApp.dir/rule’ failed
make[1]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/rule] Error 2
Makefile:2084: recipe for target ‘SampleApp’ failed
make: *** [SampleApp] Error 2

OPK · April 13, 2018, 12:14am

Tried:

GCC 4.8
In /home/pi/avs-device-sdk/SampleApp/CMakeLists.txt add last line:
“add_definitions(-D_GLIBCXX_USE_CXX11_ABI=0)” without quotes
In /home/pi/avs-device-sdk/KWD/KittAi/src/KittAiKeyWordDetector.cpp,
change:

m_maxSamplesPerPush{(audioFormat.sampleRateHz / HERTZ_PER_KILOHERTZ) * msToPushPerIteration.count()}
to:
m_maxSamplesPerPush{(audioFormat.sampleRateHz / HERTZ_PER_KILOHERTZ) * static_cast<unsigned int>(msToPushPerIteration.count())}

But nothing helped to prevent the same end result:

[ 93%] Linking CXX executable SampleApp
../../KWD/KittAi/src/libKITTAI.so: undefined reference to `snowboy::SnowboyDetect::SetSensitivity(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)'
../../KWD/KittAi/src/libKITTAI.so: undefined reference to `snowboy::SnowboyDetect::SnowboyDetect(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)'
collect2: error: ld returned 1 exit status
SampleApp/src/CMakeFiles/SampleApp.dir/build.make:358: recipe for target 'SampleApp/src/SampleApp' failed
make[3]: *** [SampleApp/src/SampleApp] Error 1
CMakeFiles/Makefile2:8088: recipe for target 'SampleApp/src/CMakeFiles/SampleApp.dir/all' failed
make[2]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/all] Error 2
CMakeFiles/Makefile2:8100: recipe for target 'SampleApp/src/CMakeFiles/SampleApp.dir/rule' failed
make[1]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/rule] Error 2
Makefile:2084: recipe for target 'SampleApp' failed
make: *** [SampleApp] Error 2

yoelrc88 · April 18, 2018, 11:35pm

@OPK Sorry for the late reply,

I haven’t finished with a full clean script for sensory/snowboy functions by I am close to do it. In the mean time check if you checkout the kitt_ai branch in the avs-device-sdk repo. Maybe was a error from the previous script.
You can also take a look to some changes I have made in that repo. If not just wait a bit for the final version :). You can be training you own wakeword in the snowboy website too !

-Yoel

OPK · April 20, 2018, 3:07pm

Yep - I had correct script.
Result:

../../KWD/KittAi/src/libKITTAI.so: undefined reference to `snowboy::SnowboyDetect::SetSensitivity(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)'
../../KWD/KittAi/src/libKITTAI.so: undefined reference to `snowboy::SnowboyDetect::SnowboyDetect(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)'
collect2: error: ld returned 1 exit status
SampleApp/src/CMakeFiles/SampleApp.dir/build.make:358: recipe for target 'SampleApp/src/SampleApp' failed
make[3]: *** [SampleApp/src/SampleApp] Error 1
CMakeFiles/Makefile2:8088: recipe for target 'SampleApp/src/CMakeFiles/SampleApp.dir/all' failed
make[2]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/all] Error 2
CMakeFiles/Makefile2:8100: recipe for target 'SampleApp/src/CMakeFiles/SampleApp.dir/rule' failed
make[1]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/rule] Error 2
Makefile:2084: recipe for target 'SampleApp' failed
make: *** [SampleApp] Error 2```

OPK · April 23, 2018, 8:15pm

So this works on my 3B (some booting here & there):

firstly do a fresh Stretch install

curl https://apt.matrix.one/doc/apt-key.gpg | sudo apt-key add -
echo "deb https://apt.matrix.one/raspbian $(lsb_release -sc) main" | sudo tee /etc/apt/sources.list.d/matrixlabs.list
sudo apt-get update -y
sudo apt-get upgrade -y
sudo apt-get autoremove -y
echo "dtoverlay=matrixio" | sudo tee -a /boot/config.txt
echo "matrixio-everloop" | sudo tee -a /etc/modules
echo "audio_pwm_mode=1" | sudo tee -a /boot/config.txt
sudo apt install -y matrixio-creator-init
sudo apt install matrixio-kernel-modules
wget https://raw.githubusercontent.com/matrix-io/avs-device-sdk/yc/kitt_ai/tools/MatrixLabs/setup.sh
wget https://raw.githubusercontent.com/matrix-io/avs-device-sdk/ada5a8c0222e4af5a3310ffe49e306d6903b0be1/tools/MatrixLabs/config.txt
sudo bash setup.sh config.txt
sudo bash startauth.sh
open browser to finnish the authentication on local 3000
sudo bash startsample.sh

but I have not been able to change the wakeword or add sounds for recognising (or not) the wakeword…
Kitt_ai website talks about modifying “KittAiSnowboyWakeWordEngine.cpp”, but I dont seem to have it.

EDIT: this setup still uses Sensory… that is not my goal; so title valid: Kitt_ai still not working.

yoelrc88 · April 24, 2018, 1:19pm

This shouldn’t be needed:

echo "dtoverlay=matrixio" | sudo tee -a /boot/config.txt
echo "matrixio-everloop" | sudo tee -a /etc/modules
echo "audio_pwm_mode=1" | sudo tee -a /boot/config.txt

Is great to hear it worked!

I will take a look at the adding sounds part.

-Yoel

OPK · April 24, 2018, 1:42pm

Without
echo “audio_pwm_mode=1” | sudo tee -a /boot/config.txt
It doesnt work for me.

Any hints on how to change the wakeword?

OPK · May 2, 2018, 10:23pm

@yoelrc88 Hi, any updates to get kitt_ai to work?

yoelrc88 · May 3, 2018, 3:40pm

Yes, https://github.com/matrix-io/avs-device-sdk has been updated with latest 1.7SDk from amazon and Kitt_ai wakeword engine is added as an option.

Follow here: https://github.com/matrix-io/avs-device-sdk/blob/master/tools/MatrixLabs/README.md

Is setup by defaut to use Sensory but to change it to Kitt_ai modify /tools/MatrixLabs/setup.sh line 46 before running this script:

github.com

matrix-io/avs-device-sdk/blob/5799187f1029a98cdfcca9d83a53f5f3973159e6/tools/MatrixLabs/setup.sh#L46


SOURCE_PATH="$INSTALL_BASE/$SOURCE_FOLDER"
THIRD_PARTY_PATH="$INSTALL_BASE/$THIRD_PARTY_FOLDER"
BUILD_PATH="$INSTALL_BASE/$BUILD_FOLDER"
SOUNDS_PATH="$INSTALL_BASE/$SOUNDS_FOLDER"
DB_PATH="$INSTALL_BASE/$DB_FOLDER"
CONFIG_DB_PATH="$DB_PATH"
UNIT_TEST_MODEL_PATH="$INSTALL_BASE/avs-device-sdk/KWD/inputs/SensoryModels/"
UNIT_TEST_MODEL="$THIRD_PARTY_PATH/alexa-rpi/models/spot-alexa-rpi-31000.snsr"
CONFIG_FILE="$BUILD_PATH/Integration/AlexaClientSDKConfig.json"


WAKE_WORD_ENGINE="sensory" # "kitt_ai" or  "sensory" wake word engines
SENSORY_PATH="$THIRD_PARTY_PATH/alexa-rpi"
SENSORY_MODELS_PATH="$SENSORY_PATH/models"
KITT_AI_PATH="$THIRD_PARTY_PATH/snowboy"
KIT_AI_MODELS_PATH="$KITT_AI_PATH/resources/alexa/alexa-sdk-resources"
KIT_AI_WAKEWORD="snowboy" # "alexa" or "snowboy" wake words
SOUND_CONFIG="$HOME/.asoundrc"
START_SCRIPT="$INSTALL_BASE/startsample.sh"
TEST_SCRIPT="$INSTALL_BASE/test.sh"
GSTREAMER_AUDIO_SINK="autoaudiosink"

Let me know how it goes.

-Yoel

OPK · May 3, 2018, 7:59pm

Hi @yoelrc88,
First of all thank you for your efforts, secondly have you ever tested this from scratch?
I did and besides another lost evening, the result was utter failure - again:
“CMakeFiles/Makefile2:3687: recipe for target ‘SampleApp/src/CMakeFiles/SampleApp.dir/rule’ failed
make[1]: *** [SampleApp/src/CMakeFiles/SampleApp.dir/rule] Error 2
Makefile:992: recipe for target ‘SampleApp’ failed
make: *** [SampleApp] Error 2”
If you start from a fresh Stretch image and follow the instructions to the letter, it fails.
I posted the full output in your fork, issue 1, build issues (https://github.com/matrix-io/matrixio-alexa-sdk-guide/issues)

Main error: [ 56%] Building CXX object CapabilityAgents/PlaybackController/src/CMakeFiles/PlaybackController.dir/PlaybackController.cpp.o
c++: internal compiler error: Killed (program cc1plus).

Please test from scratch - I assume you have upgraded/downgraded the gcc etc…

yoelrc88 · May 3, 2018, 8:32pm

Yes, I tested it. Just maybe not from complete scratch, I will try to reproduce this error starting from an empty SdCard.

Thank for the feedback.

OPK · May 3, 2018, 9:10pm

Please check the output I posted, this compiler error is strange (new stretch image). Just tested again. Same result - it hangs at 56%

yoelrc88 · May 3, 2018, 9:32pm

I am on it … using 2018-04-18 Raspbian Stretch.

gapdev · May 3, 2018, 9:47pm

Mine hung at the same point. Same percentage of build, but different file. Mine was hung at settings.cpp. I cancelled, and rebooted. 2nd time it said it ran out of Virtual Memory. Rebooted again and it compiled just fine.

I’m not using a fresh install of Stretch.

yoelrc88 · May 3, 2018, 10:25pm

@OPK, You are right, it stops around 56% I think is related to using -j4 (using all processors) when building, Virtual Memory issue probably. I am double-checking everything but if this is the problem you have to options:

using -j2 as the official repo does (i just changed this at some point to make it faster ).
increase the swapfile size, see here.

After the test I will be changing it to -j2 too in master.
-Yoel

yoelrc88 · May 3, 2018, 10:26pm

@gapdev,

Thanks for testing too ! Did it finally work?

gapdev · May 3, 2018, 10:41pm

I was getting authorization errors and traced it back to not generating a new Client ID (can’t use the one from the device, have to generate a new one “Security Profiles - Other devices and platforms” ).

At least I’m hoping that is what the problem was.

I’m re-compiling now with the -j2 option instead of -j4.

The sampe config.txt file does not have a line for CLIENT_SECRET. I put mine in, assuming that it needs it.

Kenny

yoelrc88 · May 3, 2018, 10:47pm

Thanks for pointing that out @gapdev.

You can also try to build your own models and use it, just need few changes in the script.

-Yoel

OPK · May 3, 2018, 11:54pm

Hmm, maybe the Rpi overheated while using j4. Ive seen that before.
@yoelrc88 Question: when using a new wakeword model, do you need to run setup.sh again?
Btw I also put the Client_Secret in.

OPK · May 4, 2018, 10:26am

@gapdev any luck with the authorisation? I get errors also (with the new Other Devices and Platforms codes):

DeviceInfo:createFailed:reason=missingClientId,key=clientId

CBLAuthDelegate:requestToken
HttpPost:doPostSucceeded:code=400
CBLAuthDelegate:receiveTokenResponse:code=400,body={“error_description”:“The code pair has not been authorized”,“error”:“authorization_pending”}
CBLAuthDelegate:mapHTTPStatusToError:code=400,error=INVALID_REQUEST
CBLAuthDelegate:errorInLwaResponseBody:error=authorization_pending,errorCode=AUTHORIZATION_PENDING
CBLAuthDelegate:setAuthError:authError=AUTHORIZATION_PENDING
CBLAuthDelegate:receiveTokenResponseFailed:result=AUTHORIZATION_PENDING