UC-A2

Latest revision as of 09:58, 17 April 2013

The UC-A2 is the second part of an experimental corpus used to prepare the initial versions of the grammar for sentence-based UNLization and NLization, using IAN and EUGENE, respectively. It comprises a list of 300 structures in UNL, and is supposed to cover very basic linguistic phenomena.

The corpus

• UC-A2 in one single file
  • UC-A2 in English, to be (manually) translated to your target language in order to be used as the input for the UNLization process (with IAN)
  • UC-A2 in UNL, to be used, "as is" (i.e., without any change), as the input for the NLization process (with EUGENE)
• UC-A2 in different files (the same as above, but divided according to the different classes)

*To be manually translated to your target language in order to be used as the input for UNLization (IAN)
**To be used as the input for NLization (EUGENE)
***Do not translate (or transliterate) the temporary entries

Goals

1. To provide the dictionary and grammars necessary to UNLize your translated version of UC-A2 (with IAN)
2. To provide the dictionary and grammars necessary to NLize, to your target language, the UNL version of UC-A2 (with EUGENE)

Methodology

In order to prepare the dictionaries and grammars to deal with UC-B1, follow the steps below for each text:

UNLization

1. Corpus
   1. Translate (manually) the sentences of UC-B1 from English into your native language. Be as close as possible to the original, and provide one single translation for each sentence. This will be your input document file, and your goal will be to provide (automatically, through IAN) the UNL graphs for each sentence
   2. Save the translated texts (without the English original) in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>NL FILES.
2. Dictionary
   1. Create the analysis dictionary corresponding to the word forms appearing in your translated version of the corpus. The dictionary must be created in compliance with the Dictionary Specs and may contain only tags available at the tagset. For an example of the English dictionary, see English Dictionary.
   2. Save the NL-UNL dictionary in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>DICTIONARIES.
   3. Upload the Default Dictionary to UNLWEB>UNLDEV>IAN>DICTIONARIES.
3. Grammar
   1. Create the NL-UNL (analysis) transformation grammar necessary to analyze, in UNL, the natural language sentences of the translated corpus. This grammar is the most difficult (and the actual goal) of the whole analysis task. In order to prepare the grammar, study the Grammar Specs. Next, take a look at the structure of the English Grammar for a detailed example. In many cases, it would be simpler just to localize the English grammar to your own locale rather than creating a whole grammar from the scratch. See the instructions at Localization. The grammar is normally developed inside IAN, because we have to test it every time. But you may also prepare a draft grammar, save it in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>T-RULES.
   2. Create the NL-UNL (analysis) disambiguation grammar in order to improve the results of the transformation and to control the process of tokenization. Again, this grammar is normally developed inside IAN (at the D-RULES tab), because we have to test it every time. Consult the English Grammar for a detailed example of a disambiguation grammar.
   3. Test the grammar against the corpus and provide the necessary changes.

NLization

1. Corpus
   1. Upload the UNL files corresponding to the 5 texts of UC-B1 to UNLWEB>UNLDEV>EUGENE>UNL DOCUMENT. Do not make any change to these files.
2. Dictionary
   1. Create the generation dictionary corresponding to the word forms appearing in your translated version of the corpus. The dictionary must be created in compliance with the Dictionary Specs and may contain only tags available at the tagset. For an example of the English dictionary, see English Dictionary.
   2. Save the UNL-NL dictionary in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>PROJECTS>EUGENE>DICTIONARIES.
   3. Upload the Default Dictionary to UNLWEB>UNLDEV>GENERATION>DICTIONARIES.
3. Grammar
   1. Export the inflectional grammar of your language from UNLARIUM>GRAMMAR>[YOUR LOCALE]>EXPORT. If the grammar of your language is not available yet, you may:
      1. Provide it through the UNLarium; or
      2. Create the inflectional paradigms only for the inflected forms appearing in the UNL-NL dictionary. In that case, follow the model available at English Inflectional Grammar. The documentation of the English grammar is available at English Inflectional Grammar (only for reference). For further information, see Inflectional paradigms.
   2. Save the inflectional grammar in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>PROJECTS>EUGENE>RULES.
   3. Provide the UNL-NL (generation) T-grammar and D-grammar necessary to generate natural language sentences from the UNL corpus. Follow the sample instructions available for the analysis grammar.

Assessment

The actual outputs must be evaluated against the expected outputs using the F-Measure, which can be automatically calcuated at UNLWEB>UNLARIUM>GRAMMAR>[LOCALE]>F-MEASURE

• UNLization
  • Actual output: the output provided by IAN, in your language, with the resources that you have provided, for the translated version of UC-A2
  • Expected output: UC-A2 in UNL
• NLization
  • Actual output: the output provided by EUGENE, in your language, with the resources that you have provided, for the input file UC-A2 in UNL
  • Expected output: the human-translated version of UC-A2 used as the input for the UNLization

Samples and Examples

The following resources have been used to deal with UC-A2 in English and may be used as a sample of what is expected to be provided

• UNLization
  • ENG-UNL Dictionary (English dictionary used for the UNLization of UC-A2) (Documentation available at English Dictionary)
  • Default Dictionary (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at Default Dictionary)
  • ENG-UNL T-Grammar (Transformation grammar used for the UNLization of UC-A2) (Documentation available at English Grammar)
  • ENG-UNL D-Grammar (Disambiguation grammar used for the UNLization of UC-A2) (Documentation available at English Grammar)
  • Default T-Grammar (Default transformation grammar for UNLization) (Documentation available at Default Grammar)
• NLization
  • UNL-ENG Dictionary (English dictionary used for the NLization of UC-A2) (Documentation available at English Dictionary)
  • Default Dictionary (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at Default Dictionary)
  • UNL-ENG T-Grammar (Transformation grammar used for the NLization of UC-A2) (Documentation available at English Grammar)
  • Default T-Grammar (Default transformation grammar for NLization) (Documentation available at Default Grammar)

Recommended Readings

Before starting the activity, and in order to fully understand what is expected to be done, it is important for you to be acquainted with the following documentation:

• Tagset, because you are expected to use only the tags included in the tagset
• UNL Dictionary Specs, which is essential to understand the dictionary structure
• UNL Grammar Specs, which is essential to understand the grammar structure

It is also interesting to make a test drive with IAN and EUGENE.