Voice Command Module
Using this module, you can control the Petoi robot to do various skills through voice without using wake words. Currently, the module supports 40 fixed voice commands in two languages (English and Chinese) and ten customized commands that you can record any sound clips.
Connecting to the NyBoard with wire as shown in the following picture, connect to the NyBoard Grove interface which include D8, D9:
The module code is integrated into the OpenCat project. Uncomment the line
#define VOICE in the OpenCat.ino, as shown in the figure below. Then use Arduino IDE to upload the sketch to the robot main board. Robot will work in Voice mode. This sketch will allow the robot to behave under voice commands. 
You can speak "BingBing" to switch to English or "Di-Di" to switch to Chinese.
Speak "Play sound" to turn on the audio response or "Be quiet" to turn off the audio response.
You can refer to the list of available voice commands.
The command list is as below:
The_Command_List_En.xlsx
14KB
Binary
When the robot works in English mode, you can speak "Start learning" (or send the command "XAe" in the serial monitor) into the custom voice command mode and record your voice commands in order.
If the module is not in English mode, you can speak "Bing-Bing" (or send the command "XAa" in the serial monitor) into English mode.
You can record up to 10 voice commands.
You can speak "Stop learning" (or send the command "XAf" in the serial monitor) to exit the custom voice command mode in the middle.
After exiting the custom voice command mode, speak one of the recorded voice commands to trigger the reaction.
Speak "Clear the learning data" to delete all the recordings at once (you cannot delete a specific recording).
There are 10 skill strings as custom replies already defined (but only the first four can see the actual demonstration effect of the robot because they are predefined serial commands ) in the
voice.h:const char voice1[] PROGMEM = "kpu1"; //single-handed pushup
const char voice2[] PROGMEM = "m0 80 0 -80"; //move head
const char voice3[] PROGMEM = "kmw"; //moonwalk
const char voice4[] PROGMEM = "b14,8,14,8,21,8,21,8,23,8,23,8,21,4"; //twinkle star
const char voice5[] PROGMEM = "5th";
const char voice6[] PROGMEM = "6th";
const char voice7[] PROGMEM = "7th";
const char voice8[] PROGMEM = "8th";
const char voice9[] PROGMEM = "9th";
const char voice10[] PROGMEM = "10th";
The response actions ("
kpu1" means single-handed pushup, "kmw" means moonwalk) are already defined in the program. Other serial commands are also supported as responses, such as joint movements(e.g. "
m0 80 0 -80" means shake head left and right) and playing a melody(e.g. "b14,8,14,8,21,8,21,8,23,8,23,8,21,4")To use these custom replies above, you need to enter the custom voice command mode and record 10 voice commands (such as "single-handed pushup", "shake head", "moonwalk", "twinkle star") first, and then exit the custom voice command mode.
If you have recorded a voice command and the corresponding custom reply is not predefined serial command((e.g. "
5th"), there is no actual demonstration effect, it only prints a simple message in the serial monitor when you speak the corresponding voice command.- 1.Convert the voice command collected by the microphone in the module into a serial command
- 2.Send the serial command to the mainboard MCU through the soft serial port Serial2
- 3.After receiving the serial command, the MCU parses it into the corresponding skill command, and finally the reaction module according to the skill command controls the robot to respond accordingly
Upload the demo sketch testVoiceCommander.ino, you can see every serial command which is sent to MCU(including the custom voice command if you have recorded)
After you speak the voice command to the robot, the Returned value ("XA11" or "XA21kup") is the corresponding serial command which is sent to the mainboard MCU. In fact, the third number("11" or "21") is an invisible character, for understanding, we convert it to a numeric value and print it out.
The test sketch is in the OpenCat repository on GitHub (specific path: OpenCat/ModuleTests/testVoiceCommander). You can visit our GitHub repository https://github.com/PetoiCamp/OpenCat to download the complete code, as shown in the following picture:
Command | Function |
|---|---|
XAa | Switch to English |
XAb | Switch to Chinese |
XAc | Turn on the reply tone |
XAd | Turn off the reply tone |
XAe | Enter custom voice command mode |
XAf | Exit custom voice command mode |
XAg | Delete all the custom voice commands |
After inputting the command above in the message box, press Enter to send the command to the robot.
For the robot in Voice mode, in order to improve the utilization rate of custom voice control commands, you can modify the last 6 skill strings to the skill names with actual action responses.
- Using the task queue to create a sequence of motions, please refer to the source code in the
voice.has below:
if (index < 61) {
token = raw[3]; //T_SKILL;
shift = 4; //3;
}
const char *cmd = raw.c_str() + shift;
tQueue->addTask(token, shift > 0 ? cmd : "", 2000);
char end = cmd[strlen(cmd) - 1];
if (!strcmp(cmd, "bk") || !strcmp(cmd, "x") || end >= 'A' && end <= 'Z' || end == 'x') {
tQueue->addTask('k', "up");
tQueue is the task queue defined in OpenCat.h, using the method "addTask" of this object, the robot can do some simple skills sequentially as a custom voice command response.
- 1.
- 2.Modify voice.h to bind the customized voice command to the new skills: just insert 'k'+the new skill name into the string variable（e.g.
voice1[], if you want to bind the first customized voice command )const char voice1[] PROGMEM = "kskill1"; // "k" is the token for skill, skill1 is the new skill name.
Last modified 6d ago