Skip to content

mingram8/Butler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

13 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Butler

What is it?

Butler is a voice assistant that takes in text and executes matching commands. Also uses Buttler Assistant to use other raspberry pis (or anything running pocketsphinx) as Butler relays. It also spins up a web server that can be navigated to on Chrome/Chromium and will use web speech api to send commands.

Raspberry Pi Use

You either need a raspberry pi 2 with chromium installed (zeros and first gen can't run Chromium) or a raspberry pi with pocketsphinx. I have an image with Butler/ButlerAssistant, Jessie, Node v5, and pocketsphinx installed. I could probably figure out how to share it if there is a demand for it. If you are using Chromium, just navigate to localhost:2001.

Run pocketsphinx with:

pocketsphinx_continuous -hmm /usr/local/share/pocketsphinx/model/en-us/en-us -lm ~/YOUR_LANGUAGE_MODEL.lm -dict ~/YOUR_DICTIONARY.dic -topn 2 -ds 2 -maxwpf 5 -samprate 16000/8000/48000 -fwdflat no -pl_window 10 -maxhmmpf 50 -bestpath no -adcdev plughw:1,0 -inmic yes > ~/Butler/words.log

Or you can stream the audio to your desktop or beefier computer to do the pocketpshinx processing on with:

arecord -D plughw:1,0 -f S16_LE -r 16000 | ssh -C YOUR_USERNAME@YOUR_IP pocketsphinx_continuous -hmm /usr/local/share/pocketsphinx/model/en-us/en-us -dict YOUR_DICTIONARY.dic -lm YOUR_LANGUAGE_MODEL.lm -infile /dev/stdin > ~/Butler/words.log

Create a language model and dictionary Here by uploading a text file with your commands, with 1 command per line

Replace plughw:1,0 with your card number, so if arecord -l says your microphone is on card 2, change it to plughw:2,0 . This allows you to avoid fiddling with getting the microphone to card 0. That will allow pocketsphinx to throw the words into a file that Butler watches to check for commands

Now run a NPM install and let it run. It sits on 2001 and runs https so that the mic doesn't have to keep being approved

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published