-
 KDE-Apps.org Applications for the KDE-Desktop 
 GTK-Apps.org Applications using the GTK Toolkit 
 MeeGo-Central.org Applications for MeeGo 
 CLI-Apps.org Command Line Applications 
 Qt-Apps.org Free Qt Applications 
 Qt-Prop.org Proprietary Qt Applications 
 Maemo-Apps.org Applications for the Maemo Plattform 
 Java-Apps.org Free Java Applications 
 eyeOS-Apps.org Free eyeOS Applications 
 Wine-Apps.org Wine Applications 
 Server-Apps.org Server Applications 
--
-
 KDE-Look.org Artwork for the KDE-Desktop 
 GNOME-Look.org Artwork for the GNOME-Desktop 
 Xfce-Look.org Artwork for the Xfce-Desktop 
 Box-Look.org Artwork for your Windowmanager 
 E17-Stuff.org Artwork for Enlightenment 
 Beryl-Themes.org Artwork for the Beryl Windowmanager 
 Compiz-Themes.org Artwork for the Compiz Windowmanager 
 EDE-Look.org Themes for your EDE Desktop 
--
-
 Debian-Art.org Stuff for Debian 
 Gentoo-Art.org Artwork for Gentoo Linux 
 SUSE-Art.org Artwork for openSUSE 
 Ubuntu-Art.org Artwork for Ubuntu 
 Kubuntu-Art.org Artwork for Kubuntu 
 LinuxMint-Art.org Artwork for Linux Mint 
 Arch-Stuff.org Art And Stuff for Arch Linux 
 Frugalware-Art.org Themes for Frugalware 
 Fedora-Art.org Artwork for Fedora Linux 
 Mandriva-Art.org Artwork for Mandriva Linux 
--
-
 KDE-Files.org Files for KDE Applications 
 OpenTemplate.org Documents for OpenOffice.org
 GIMPStuff.org Files for GIMP
 InkscapeStuff.org Files for Inkscape
 ScribusStuff.org Files for Scribus
 BlenderStuff.org Textures and Objects for Blender
--
-
 KDE-Help.org Support for your KDE Desktop 
 GNOME-Help.org Support for your GNOME Desktop 
 Xfce-Help.org Support for your Xfce Desktop 
--
openDesktop.orgopenDesktop.org:   Applications   Artwork   Linux Distributions   Documents    LinuxDaily.com    Linux42.org    OpenSkillz.com    Open-PC.com   
Apps
News
Groups
Knowledge
Events
Forum
People
Jobs
Register
Login
APPS
-


Sponsoring


-
- Content .- Fans (12) .- Knowledge Base  . 

simon (Speech Interaction Daemon)

   0.3-alpha-3  

KDE Accessibility Application

bedahrbedahr
simon
simon (Speech Interaction Daemon)
zoom

simon (Speech Interaction Daemon)
zoom

simon (Speech Interaction Daemon)
zoom

Homepage:  http://simon-listens.org
Blog:  Link
Depends on  KDE 4.x
Downloads:  3423
Submitted:  Jan 18 2008
Updated:  Jul 3 2010
Score: 
score93%93%score
 93% good
bad   good

Description:

The project provides a ready-to-use interface for the julius speech recognition engine. It integrates into X11 and Windows.

simon can import dictionaries, grammar structures and compile a language model with the help of the HTK toolkit of the university of cambridge.

With the recognition results it can type texts, simulate shortcut sequences, start programs control your mouse and more.

simon comes with a complete manual describing the system. This manual and setup instructions are also available from our wiki: http://simon-listens.org/wiki

Please don't hesitate to contact me if you need help!




Changelog:

0.3-alpha-3:
Changelog: http://sourceforge.net/projects/speech2text/files/simon/0.3-alpha-3/Changelog/view

0.3-alpha-2:
Changelog: http://sourceforge.net/projects/speech2text/files/simon/0.3-alpha-2/Changelog/view

Warning: You might need experimental packages on OpenSUSE from your distribution as this release requires KDE 4.4! (Included by default in Ubuntu 10.04)


0.3-alpha-1:
Changelog: http://sourceforge.net/projects/speech2text/files/simon/0.3-alpha-1/Changelog/view

Warning: You might need experimental packages from your distribution as this release requires KDE 4.4!

0.2:
Fixed the remaining known issues and added the manual.


0.2 rc1:

We've done a _lot_ of testing. Basically we tested every feature as well as we could and came up with a lot of bugs.
Well those are all fixed now :)

There are two issues left which are sadly quite bad: One crashes simon and one causes the recognition to stop without any error or warning what so ever. Both only get triggered when re-initializing the recognition and are related to Juliuslib. I hope to get that fixed soon.

But all in all, simon should be quite stable and ready for some productive use!

0.2-beta-3:

Introducing three new command plug-ins:
* List
A list of other simon commands; The user selects one of the commands using numbers 1-9; If there are more than 8 commands in the list, the list only goes from 1-8 and 0 and 9 are can be used for scrolling (0: up; 9: down).

* Composite
Combines other simon commands in one "Macro". The user can even define delays between the invocation of two sub-commands.

* Input Numbers
A calculator-like front-end to input long numbers with ease.

Also, the desktop-grid can now be completely controlled by voice.

The recording widget now displays the current "loudness" of the input while recording. This should help to weed out not working / badly configured microphones.

Updated Julius to the current SVN versions with minimal modifications.

Bug-Fixing all around - especially related to sound and recognition.

0.2-beta-2:

Fixed various bugs related to the grammar which caused it to not get saved most of the time. It is now again possible to add multiple words at once without losing samples. All input files to the importing functions (dictionary, texts, etc.) are now checked if they exist before the importing begins. simon now compiles also on Ubuntu Hardy Heron (KDE 4.0) Removed KDE-Includes when building julius (a lot of warnings due to strict compiler flags) All libraries are now installed correctly.

0.2-beta-1:

Bugfixing all around.
Fixed a whole lot of libjulius / sent related issues regarding stopping / starting of the sound-stream.
Fixing the Windows Version.
Introducing CPack support for quick package building.


0.2-alpha-1:

Porting to KDE 4
Removed Juliusd in favor of simond:
* Network audio streaming
* Recognition and model compilation on server
* No processor intensive calculations on the client (opens the door to development of solutions for embedded devices, etc.)
Revised and greatly improved command plugin architecture
* Individual triggers per plugin
* Runtime module loading / unloading (even the configuration of the modules)
Introduction of ksimond - a frontend to the simond recognition server
And much, much more...


0.1-alpha-2.1:

A lot of compatibility fixes.


0.1-alpha-2:

Too many changes to count - here the most important ones:

Fixed about a gazillion bugs.
Streamlined the interface.
The command-system has been completely rewritten.
A few performance optimizations.
Introduced a structured build-system.
Switched to portaudio backend for more compatibility.
Did I mention fixing bugs? Lots of them...

0.1-alpha-1:
Initial release




License: GPL
Ubuntu(simon 0.3-alpha-3 32-bit Ubuntu package)
(simon 0.3-alpha-3 source)
MS Windows(simon 0.3-alpha-3 precompiled Windows binary)
other(simon 0.3 alpha-3 32-bit generic binary package)
Ubuntu(simon 0.3-alpha-3 64-bit Ubuntu package)
other(simon 0.3-alpha-3 64-bit generic binary package)
Donate
Send to a friend
Subscribe
Other apps from bedahr



goto page: prev   1  2  3  4  5 

-

 Greek alphabet in simon

 
 by k8oylos on: Apr 3 2010  
k8oylosk8oylos

Hi,
a few months ago (and a few posts up) we had discussed an issue with trying to use greek in simon. I couldn't make it work then, but i gave it another try now.
I followed your instructions at the time, and replaced greek letters in the phonetic transcription with latin letters, and just kept greek letters in the actual words. (see video)
The program seems to do the recognition, and transcribes any word written with english letters, but when i speak out a word with greek letters which is recognised, the cursor just moves 2 spaces to the right and stops, without actual letters being written.
I 'm not sure if i could describe it correctly, so i just made a video.

In the beginning you will see the lexicon (greek words written either in greek or latin alphabet), then how simon recognizes words with english letters, and then what happens if i input a word written in greek
Please help!!!

http://www.youtube.com/watch?v=q_aaV2UealU


Reply to this

-

 Re: Greek alphabet in simon

 
 by bedahr on: Apr 4 2010  
bedahrbedahr
simon

Hi!

Well this is to be expected. While simon internally works using unicode (so you should be able to create commands with greek letters in them and be able to execute them) the simulation of keystrokes is quite complicated.

How do you write greek letters when you need to type them yourself (manually)?

We would need to teach simon to mirror your exact actions. Of course this is even worse considering different keyboard layouts, etc...

Greetings,
Peter


Reply to this

-

 Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 4 2010  
k8oylosk8oylos

well, that's really unfortunate, as i think that, when i initially heard about simon, it was said that, due to the fact that there is no pre-made speech database, it could be trained to work with any language. If there is such an issue, how can simon work with anything except english? Even other languages which use latin letters, do have some special characters, such as the accented e in French?

Is there anything we can do about this?

How do i change keyboards?
I normally have two keyboards installed in my computer, a greek one and an english one. Simply pressing shift+alt switches between the two keyboards.


Reply to this

-

 Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 4 2010  
bedahrbedahr
simon

Hi!

> when i initially heard about simon, it was said that, due to the fact that there is no pre-made speech database, it could be trained to work with any language.
Yes this is true. simon internally uses only UTF-8 and will work with any language that uses UTF-8 characters.

To send key presses we need to know which keys to press. As there is no way to determine that from a given UTF-8 Character, we need to do some guessing at this stage.

It is simply not possible to tell X to "just write character X". You need to tell him which keys to press (i.e.: press "Shift", press "´", release "`", press "e", release "e", release "Shift" to produce È).

> If there is such an issue, how can simon work with anything except english?
We did our best to teach simon as many special characters as possible. You can find an overview of special characters that can be simulated with simon:
http://simon-listens.blogspot.com/2009/06/overcoming-limitations.html


> Is there anything we can do about this?
Yes. Please tell me what keys you need to press to get to those special characters and we can look into integrating them into the simon event simulation layer.


Greetings,
Peter


Reply to this

-

 Re: Re: Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 4 2010  
k8oylosk8oylos

Thank you so much for your quick reply.
I will send you a list of all greek characters and keys needed to be pressed, provided that the greek keyboard is selected (should there probably be a system check by simon or some way to check if the correct keyboard is selected?).
Also, should i send capital letters separately?


Reply to this

-

 Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 5 2010  
k8oylosk8oylos

Hi,
please find attached an excel file with all (i think) greek characters
http://cmfrenzy.com/Greek_characters_for_simon.xls


Reply to this

-
.

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 5 2010  
bedahrbedahr
simon

Thanks for the list!

I will add that to the event simulation layer.

However, I don't think the check to confirm the greek keyboard layout is necessary. Users who want to use use greek letters will know what to do anyways.

I'll post an update here when I am done (will probably get to it around Thursday).

Greetings,
Peter



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 6 2010  
bedahrbedahr
simon

Hi!

Ok I looked into this and it looks quite complicated.

As far as I see, X doesn't _really_ switch keyboard layouts when using setxkbmap (which is what the keyboard layout switcher from KDE uses). Instead, it only translates the output associated with the keycodes to the appropriate localized symbols.

For example:
When simulating the Key "α", simon needs to request the key code from the input string. I introduced a middle step that translates "α" to "a", etc. which in turn becomes, the keycode for the "a" key, which is then translated to "α" key by the xkb map.

This, however, only works when your "real" keymap uses "a" for the key which will then become "α". There is no way of knowing which keymap this is and to anticipate all combinations.

In my test setup (german keyboard layout, switched to greek with setxkbmap) simon can now simulate α, β, ψ,... and Α, Β, Ψ,... but this _breaks_ the simulation on greek "native" setups (where the X keymap is set to greek).

Do you use a native greek layout or do you switch between layouts? Is a "pure" greek setup even usable?

Greetings,
Peter



-

 Re: Re: Re: Re: Re: Re: Greek

 
 by k8oylos on: Apr 7 2010  
k8oylosk8oylos

Hi Peter,
I don't really understand the technical details, but i get the general meaning.
For greek, there is no native keyboard (i guess that by this you mean a keyboard we use exclusively). Half greek characters are different compared to the latin alphabet, it's not like french or spanish, where there are just a couple of differences. So the only way to get around this is, we have an english keyboard and a greek keyboard installed. You can't even write a url or an email address without switching to the english keyboard (you can't imagine how many times my parents forget the combination of keys to do the switch!)

As i said above, i don't really understand the technical details, but X does output info about the keyboard being used (it shows in the switch language widget, for example). Couldn't you get the keyboard info from this?

I did some further testing. In my lexicon, i had spelled some words with greek e.g δημήτρης, and some with english characters (trofi). Ι then switched the keyboard to greek, and then said these words. Nothing happens when i dictate the words written in Greek (cursor just moves two places, as in the video i had originally posted, whereas when i dictate the word trofi, it is spelled out by simon in greek, τροφι. The spelling is wrong (simon just presses the i key, as it would have done in the english keyboard, but this word is written in greek with a different kind of i, and no accent is present, obviously).
So i guess that this just confirms your initial description of how simon simulates keystrokes and that, provided that the greek keyboard is preselected and the key strikes sequence has been programmed, simon should work fine with greek,



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 7 2010  
bedahrbedahr
simon

Hi!

> I don't really understand the technical details, but i get
> the general meaning.
Sorry, I didn't mean to make it so complicated.

> For greek, there is no native keyboard (i guess that by
> this you mean a keyboard we use exclusively).
Yes I know that. But as it is completely different to implement between exclusive keyboard layout and switching keyboard layout I wanted to make sure before investing any more time into it.


> As i said above, i don't really understand the technical
> details, but X does output info about the keyboard being
> used (it shows in the switch language widget, for
> example). Couldn't you get the keyboard info from this?
Yes, but the problem, apparently, is a limitation in X's implementation (or better setxmbmap implementation) that doesn't switch the layout on ALL levels. simon doesn't press physical "keys" per se but rather virtual keys like a fictional "a" key that is later mapped to a physical "a" key. This mapping is done by asking X what this physical key is. Sadly this part of X - apparently - doesn't adjust itself when you switch layouts on the fly. That's why the mapping fails. You could try it: Set X's keyboard layout to "gr" (in your xorg.conf) and you'll see that writing greek texts will work in simon just as you'd expect. English text won't work, tough. It all depends on the "base" keyboard layout - not the one you are currently switched to.

> I did some further testing. In my lexicon, i had spelled
> some words with greek e.g δημήτρης, and some with english
> characters (trofi). Ι then switched the keyboard to
> greek, and then said these words. Nothing happens when
> i dictate the words written in Greek (cursor just moves
> two places, as in the video i had originally posted,
> whereas when i dictate the word trofi, it is spelled
> out by simon in greek, τροφι. The spelling is wrong
> (simon just presses the i key, as it would have done in
> the english keyboard, but this word is written in greek
> with a different kind of i, and no accent is present,
> obviously).
Yes this is exactly what I meant. simon then trys to map "t" to a key. As this part of X doesn't adjust itself to the greek layout, it still gets mapped to the physical "t" key of the English layout. It then presses this key which causes the adjusted keymap (the one you are switched to - greek) to kick in and output the greek character.

I can't really confirm where this problem occurs in the X stack but I am pretty sure that it isn't simons fault as everything is fine when switching the layout the hard way (restarting X). I can add workarounds (I did already - still having problems with the dead keys - limitations there are even worse because these keys are never on the same place in different layouts; It's basically impossible to anticipate all "base" keymaps) but in my opinion this has to be fixed in the X stack before it will work reliably.

I already asked in the X IRC but got no answer.

Greetings,
Peter



-

 Re: Re: Re: Re: Re: Re: Greek

 
 by k8oylos on: Apr 7 2010  
k8oylosk8oylos

Do you think you could send me a copy of simon (opensuse 11.2 32 bit, with the list I sent you added, for me to test? I think you said you have made it export Greek characters.
Or is anything else I can do to help?



-
.

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 8 2010  
bedahrbedahr
simon

Hi!

No I implemented a workaround that makes the base characters functional (no dead key support).

I only realized the major limitation that the keyboard layout change is not taken into account from the Xlib base functions.

I will send you a test version if / when this is completely implemented.

I reported the issue on the freedesktop x.org bugtracker: https://bugs.freedesktop.org/show_bug.cgi?id=27543

Greetings,
Peter



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 11 2010  
k8oylosk8oylos

Thanks for your reply
It seems that i 'll have to wait!
In the meanwhile, I am preparing a phonetic word list for greek and i 'll be doing some tests and training
I have a couple of questions
1) While in training mode, i give simon a sentence, or a series of words
e.g.
Dimitris trains simon
Should i pronounce these words separately, with a pause in between
Dimitris - pause - trains - pause- simon
or as a full sentence?
2) When training simon, does every word need to be trained, or do i have to train an adequate number of words, so that all phonemes are covered and then simon will "guess" how the words are pronounced?
Greek is a very complex language, with nouns and verbs being conjugated, and thus has a huge number of forms a word can be in (openoffice dictionary has more than half a million, could simon handle a model with this number of words?) but has a clean advantage when comes to pronounciation: You read exactly what is written, there is no specific pronounciation of phonemes.
So if i spell out the word dimitris in the phonetic word list as
d i m i t r i s
do i have to train it in simon, or will simon fetch the phoneme d, i etc from other words, where it is present, and finally compile them to understand dimitris?



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 11 2010  
bedahrbedahr
simon

Hi!

1.) Pronunce them as full sentences.

2.) Yes, simon will understand words that have never been recorded. However, in order to do that you need to use sam instead of simon because simon(d) will remove unrecorded words from the dictionary before compiling the model to avoid the common mistake to not record words with undefined phonemes (triphones).

sam does not do this but rather expects that you know what you are doing :)

To use the resulting models just set simon to use them as static base models.

May I ask what sample corpus you are going to use and what you would want simon to do with 500k words? simon supports no dictation as of yet so I don't really see the point...

Greetings,
Peter



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 12 2010  
k8oylosk8oylos

What do you mean exactly by sample corpus?
I have not chosen a lexicon of 500k words, it's just what the openoffice lexicon contains. Since in greek words are conjugated, it might contain 10 or more different forms of each word, and the actual word count is many times smaller.
Basically, last year i tried dragon in windows, but i could get moderate results when dictating in english, since my pronounciation is not that of a native speaker. Then i tried a couple of commercial greek applications for speech recognition. Results were from medium to awful, and unfortunately neither of them had model adaptation for the actual user's voice.
Then i came along simon, and i decided to test it. I know it's a long road till being dictation ready, i just see it as a bit of a hobby, and would really like to see what its potential would be in the future.
Besides, mum and dad go into retirement this June, and as they will be having lots of time and they are greek language teachers, we were thinking of recording some greek classic for librivox. Wouldn't it be possible to use this recording, in combination with the text and a phonetic lexicon, to train a basic model for simon?



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 13 2010  
bedahrbedahr
simon

Well this sounds like an excellent idea. I just wanted to know that you don't expect to dictate with simon after importing such huge lexicons.



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 13 2010  
bedahrbedahr
simon

With the helpful pointer of the X.org people I now implemented a clean way to simulate greek characters.

This feature is already included in the current git master branch.

If you don't like to build from source, it will of course also be included in the next release.



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by k8oylos on: Apr 14 2010  
k8oylosk8oylos

that's great news! Thank you!
i tried to compile but i got the following
(opensuse 11.2 with kde 4.4.2)
(might be something stupid i did, i 've only done this a couple of times in my life)
-- The CXX compiler identification is GNU
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
CMake Error at cmake/FindPortaudio.cmake:63 (message):
Could not find Portaudio
Call Stack (most recent call first):
julius/libsent/CMakeLists.txt:2 (find_package)


-- Configuring incomplete, errors occurred!
touch: cannot touch `./julius/gramtools/mkdfa/mkfa-1.44-flex/*': No such file or directory

When do you expect the next version to be officially built?



-

 Re: Re: Re: Re: Re: Re: Greek alphabet in simon

 
 by bedahr on: Apr 15 2010  
bedahrbedahr
simon

You are missing some development libraries.

Have a look here:
http://www.simon-listens.org/wiki/index.php/Development_Environment#Requirements

The next release will probably be uploaded in the next week or two.

Greetings,
Peter



goto page: prev   1  2  3  4  5 

Add commentBack




-
My KDE-Apps.org
-
STATUS MESSAGE
-
all messages
openDesktop.org Facebook App

NEWS
-
Linux42.org
-
Popular Groups
-
Newest Groups
-
FORUM
-
Partners
Place Your Link Here!
online casino bonus
Online Roulette

POLL
-
Favorite Distribution 2010?
 Debian
 Gentoo
 SuSE
 Ubuntu
 Kubuntu
 Linux Mint
 Arch Linux
 Frugalware
 Fedora
 Mandriva
 PC Linux OS
 Other Distribution
 I'm a *BSD user
 Using Windows
 Using Mac OS X
 Other OS
 I don't use Computers and have asked another user to check this option for me.

resultmore
KDE-LOOK.ORG
-
 
 Who we are
Contact
More about us
Frequently Asked Questions
Register
Twitter
Blog
Explore
Apps
Jobs
Knowledge
Events
People
Updates on identi.ca
Updates on Twitter
Facebook App
Content RSS   
Events RSS   

Participate
Groups
Forum
Add App
Public API
About KDE-Apps.org
Legal Notice
Spreadshirt Shop
CafePress Shop
Advertising
Sponsor us
Report Abuse
 

Copyright 2003-2010 KDE-Apps.org Team  
All rights reserved. KDE-Apps.org is not liable for any content or goods on this site.
All contributors are responsible for the lawfulness of their uploads.
KDE and K Desktop Environment are trademarks of KDE e.V.