CHMlib Logo Leading Translation Management System for Translation Agencies, Top Translation Management Software for Freelance Translators, Time Tracking Software, Word Count, Character Count and Line Count Software, Computer Assisted Translation Tool for Easy Word Count, Clipboard Character Count Software, User-Friendly Translation Memory Software, Terminology Management Software, Terminology Management Server, Microsoft Glossary Software, Dictionary of Acronyms, Social Network for Translators and Translation Agencies, Acronyms and Abbreviations Search Engine, Russian Translation Lab, Ukrainian Translation Lab.
You are reading help file online using chmlib.com
CrisisHelper - First Aid in Tough Times of World Economic Crisis


Intelligent Interface Technologies Home Page Microsoft Speech SDK

Speech Automation 5.1

Interface: ISpeechPhraseElement

ISpeechPhraseElement Code Example


The following Visual Basic form code displays the properties of the ISpeechPhraseElement object. The ISpeechPhraseElement object is contained in the ISpeechRecoResult object returned by a RecoContext's Recognition event. This code shows two ways to create a recognition result object:

  • Perform recognition directly
  • Emulate recognition using the EmulateRecognition method
  • The example also demonstrates the use of the SpFileStream object in conjunction with the AudioOutputStream of the voice and the AudioInputStream of the recognizer.

    To run this code, create a form with the following controls:

  • Two command buttons called Command1 and Command2
  • A list box called List1
  • A text box called Text1
  • Paste this code into the Declarations section of the form.

    The code will set the command button captions as shown in the illustration.

    The Form_Load procedure creates a recognizer, a recognition context, and a grammar object. It loads the grammar object with sol.xml, the Solitaire grammar from the SAPI sample code. It then activates the command and control (C and C) and dictation components of the grammar, and places a Solitaire command in the text box. Users can enter whatever text they like in the text box, but best recognition results will be obtained from phrases matching the rules in the C and C grammar; for example, sentences such as "Move the black ten to the jack of diamonds," or "Play the red queen."

    The command button captioned Recognition speaks text from the text box into an audio file, and then performs speech recognition of that file. The command button captioned EmulateRecognition simply calls the EmulateRecognition method.

    When the speech recognition (SR) engine has completed recognition, it generates a Recognition Event that returns an ISpeechRecoResult object. The Recognition procedure instantiates each ISpeechPhraseElement in the result object's Elements property (a collection of ISpeechPhraseElement objects), and displays selected phrase element properties in columns in the list box.

    AudioStreamOffset and AudioSizeBytes

    The first two columns show the AudioStreamOffset and AudioSizeBytes properties. These two properties indicate the boundaries of an element in the input audio stream. AudioStreamOffset points to the beginning of the element and AudioSizeBytes is the element's length. The sum of an element's AudioStreamOffset and AudioSizeBytes is the same as the AudioStreamOffset of the next element.

    In an ISpeechPhraseElement object created by the EmulateRecognition method, the AudioStreamOffset and AudioSizeBytes properties are zero.

    AudioTimeOffset and AudioSizeTime

    The next two columns are the AudioTimeOffset and AudioSizeTime properties, which delimit the phrase elements in 100-nanosecond units of time. AudioTimeOffset indicates the beginning time of the element, and AudioSizeTime is its time length. The sum of an element's AudioTimeOffset and AudioSizeTime is approximately the same as the AudioTimeOffset of the next element.

    In an ISpeechPhraseElement object created by the EmulateRecognition method, the AudioTimeOffset and AudioSizeTime properties are zero.

    DisplayAttributes

    The next column is the DisplayAttributes property, which defines how the text of the element is displayed relative to text from other phrase elements. The SpeechDisplayAttributes enumeration lists the possible values of this property. All elements in the example above have a DisplayAttributes property of two, which is the value of the SDA_One_Trailing_Space constant, indicating that the element should be displayed with a trailing space.

    EngineConfidence, ActualConfidence, and RequiredConfidence

    The three numbers in parentheses are the three property values involving confidence in the recognition of the phrase element. The first of these is the EngineConfidence property, which represents the SR engine's level of confidence in the recognition. The ActualConfidence property reduces the EngineConfidence to one of three confidence levels: low, normal or high. The RequiredConfidence property specifies the confidence level that the ActualConfidence property must equal or surpass.

    In an ISpeechPhraseElement object created by the EmulateRecognition method, the EngineConfidence and RequiredConfidence properties are zero. If the emulated phrase matches C and C rules, the ActualConfidence property is one; otherwise it is zero.

    DisplayText and LexicalForm

    The DisplayText property is the next column in the example. It consists of the recognized text of the phrase element, with normalization of numbers, ordinals, and currency values. The LexicalForm property, not shown in this example, returns the same text, but without normalization.

    Pronunciation

    To the right of the DisplayText is data from the Pronunciation property. Each number represents a phoneme, and the phonemes represent the pronunciation of the phrase element.

    In an ISpeechPhraseElement object created by the EmulateRecognition method, the Pronunciation property is Empty.

    RetainedStreamOffset and RetainedSizeBytes

    The RetainedStreamOffset and RetainedSizeBytes properties are not shown in this example. If the current recognition context is retaining audio data, then RetainedStreamOffset and RetainedSizeBytes are the same as AudioStreamOffset and AudioSizeBytes, respectively; otherwise, both properties are zero.

    In an ISpeechPhraseElement object created by the EmulateRecognition method, the RetainedStreamOffset and RetainedSizeBytes properties are zero.


    Option Explicit
    
    Const WAVEFILENAME = "C:\ISpeechPhraseElement.wav"
    
    Dim R As SpeechLib.SpInprocRecognizer
    Dim G As SpeechLib.ISpeechRecoGrammar
    Dim F As SpeechLib.SpFileStream
    Dim E As SpeechLib.ISpeechPhraseElement
    Dim V As SpeechLib.SpVoice
    
    Dim WithEvents C As SpeechLib.SpInProcRecoContext
    
    Private Sub Command1_Click()
        
        List1.Clear
        Call SpeakToFile(Text1.Text, WAVEFILENAME)
        F.Open WAVEFILENAME
        Set R.AudioInputStream = F
    
    End Sub
    
    Private Sub Command2_Click()
    
        List1.Clear
        C.Recognizer.EmulateRecognition Text1.Text
    
    End Sub
    
    Private Sub Form_Load()
    
        ' Create Recognizer, RecoContext, Grammar, and Voice
        Set R = New SpInprocRecognizer
        Set C = R.CreateRecoContext
        Set G = C.CreateGrammar(16)
        Set V = New SpVoice
        Set V.Voice = V.GetVoices("gender=male").Item(0)
        
        ' Load Grammar with solitaire XML, set active
        G.CmdLoadFromFile "c:\sol.xml", SLOStatic
        G.CmdSetRuleIdState 0, SGDSActive               'Set C & C active
        G.DictationSetState SGDSActive                  'Set Dictation active
    
        Text1.Text = "play the eight of clubs"
        Command1.Caption = "&Recognition"
        Command2.Caption = "&EmulateRecognition"
            
    End Sub
    
    Private Sub SpeakToFile(ByVal strText As String, ByVal strFName As String)
        Set F = New SpFileStream                    'Create stream
        F.Open strFName, SSFMCreateForWrite, True   'Open as the filename
        Set V.AudioOutputStream = F                 'Set voice output to file
        V.Speak strText, SVSFIsXML                  'Speak synchronously
        F.Close                                     'Close file
    End Sub
    
    Private Function PhonesToString(ByVal arrV As Variant) As String
        Dim ii As Integer, S As String
        If IsEmpty(arrV) Then
            PhonesToString = ""
        Else
            For ii = 0 To UBound(arrV)
                If Len(S) Then
                    S = S & "," & arrV(ii)
                Else
                    S = arrV(ii)
                End If
            Next ii
            PhonesToString = S
        End If
    End Function
    
    Private Sub C_Recognition(ByVal StreamNumber As Long, _
                        ByVal StreamPosition As Variant, _
                        ByVal RecognitionType As SpeechLib.SpeechRecognitionType, _
                        ByVal Result As SpeechLib.ISpeechRecoResult)
        Dim X As String
        Dim T As String
        Dim A1 As Long, A2 As Long
        Dim T1 As Long, T2 As Long
        Dim C1 As Single, C2 As Integer, C3 As Integer
        
        For Each E In Result.PhraseInfo.Elements
        
            'Audio data
            A1 = E.AudioStreamOffset
            A2 = E.AudioSizeBytes
            X = Format(A1, "000000") & " " & Format(A2, "000000") & "  "
            
            'Time data
            T1 = E.AudioTimeOffset
            T2 = E.AudioSizeTime
            X = X & Format(T1, "000000000") & " " & Format(T2, "000000000") & "  "
            
            'Display attributes
            X = X & Format(E.DisplayAttributes) & " "
            
            'Confidences
            C1 = E.EngineConfidence
            C2 = E.ActualConfidence
            C3 = E.RequiredConfidence
            T = "(" & Format(C1) & " " & Format(C2) & " " & Format(C3) & ")"
            X = X & Left(T & "         ", 14) 
        
            'Text and pronunciation
            X = X & Left(E.DisplayText & "              ", 14)
            X = X & PhonesToString(E.Pronunciation)
            
            List1.AddItem X
        Next
        
    End Sub
    
    Private Sub C_EndStream(ByVal StreamNumber As Long, _
                        ByVal StreamPosition As Variant, _
                        ByVal StreamReleased As Boolean)
                        
        'Recognition uses the Filestream, EmulateReco does not
        If ActiveControl.Caption = "&Recognition" Then F.Close
        List1.AddItem "<EndStream>"
    End Sub



    You are reading help file online using chmlib.com

    If you want your help file to be removed or added please send e-mail to chmlibcom@gmail.com
    Partner sites: Logo Design, Simple Anti-Crisis Accounting Software, Voice Search for Web