UC-B1

From UNL Wiki

(Difference between revisions)

Latest revision as of 17:51, 17 April 2013

UC-B1 is an experimental corpus used to refine the initial versions of the grammar for sentence-based UNLization and NLization, using IAN and EUGENE, respectively. It comprises 5 very short texts in English and their corresponding graphs in UNL.

The Corpus

UC-B1 consists of 5 texts, which are translations of Aesop's fables to English. Most of them have been derived from the standard version by George Fyler Townsend (available at The Project Gutenberg), but they have suffered slight changes in order to become more suitable for natural language processing.

Text	Title	English*	UNL**	Number of sentences
Text 1	The Hare and the Tortoise	UCB1_t1_eng.txt	UCB1_t1_unl.txt	13
Text 2	The Bat and The Weasels	UCB1_t2_eng.txt	to be provided soon	10
Text 3	The Father and his Sons	UCB1_t3_eng.txt	to be provided soon	11
Text 4	The Ants and the Grasshopper	UCB1_t4_eng.txt	to be provided soon	10
Text 5	The Man and the Lion	UCB1_t5_eng.txt	to be provided soon	11

*To be manually translated to your target language in order to be used as the input for UNLization (IAN)
**To be used as the input for NLization (EUGENE)
***To be used for the natural language generation dictionary

Goals

To provide the dictionary and grammars necessary to UNLize your translated version of UC-B1 (with IAN)
To provide the dictionary and grammars necessary to NLize, to your target language, the UNL version of UC-B1 (with EUGENE)

Samples and Examples

The following resources have been used to deal with UC-A1 in English and may be used as a sample of what is expected to be provided

UNLization
- ENG-UNL Dictionary (English dictionary used for the UNLization of UC-B1) (Documentation available at English Dictionary)
- Default Dictionary (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at Default Dictionary)
- ENG-UNL T-Grammar (Transformation grammar used for the UNLization of UC-B1) (Documentation available at English Grammar)
- ENG-UNL D-Grammar (Disambiguation grammar used for the UNLization of UC-B1) (Documentation available at English Grammar)
- Default T-Grammar (Default transformation grammar for UNLization) (Documentation available at Default Grammar)
NLization
- UNL-ENG Dictionary (English dictionary used for the NLization of UC-B1) (Documentation available at English Dictionary)
- Default Dictionary (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at Default Dictionary)
- UNL-ENG T-Grammar (Transformation grammar used for the NLization of UC-B1) (Documentation available at English Grammar)
- Default T-Grammar (Default transformation grammar for NLization) (Documentation available at Default Grammar)

@@ Line 1: / Line 1: @@
-UC-A2 is an experimental corpus used to refine the initial versions of the grammar for sentence-based [[UNLization]] and [[NLization]], using [[IAN]] and [[EUGENE]], respectively. It comprises 5 very short texts in English and their corresponding graphs in UNL.
+UC-B1 is an experimental corpus used to refine the initial versions of the grammar for sentence-based [[UNLization]] and [[NLization]], using [[IAN]] and [[EUGENE]], respectively. It comprises 5 very short texts in English and their corresponding graphs in UNL.
 == The Corpus ==
-UC-A2 consists of 5 texts: the first one (Text 1) will be used during the workshop;  the other four will be used for evaluation and certification. The five texts are translations of Aesop's fables to English. Most of them have been derived from the standard version by George Fyler Townsend (available at [http://www.gutenberg.org/cache/epub/21/pg21.txt The Project Gutenberg]), but they have suffered slight changes in order to become more suitable for natural language processing. <br />
+UC-B1 consists of 5 texts, which are translations of Aesop's fables to English. Most of them have been derived from the standard version by George Fyler Townsend (available at [http://www.gutenberg.org/cache/epub/21/pg21.txt The Project Gutenberg]), but they have suffered slight changes in order to become more suitable for natural language processing. <br />
 {|border=1 align=center cellpadding=2
@@ Line 9: / Line 9: @@
 !English*
 !UNL**
-!UWs***
 !Number of sentences
 |-
 |Text 1
 |align=center|The Hare and the Tortoise
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t1_eng.txt UCA2t1_eng.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t1_eng.txt UCB1_t1_eng.txt]
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t1_unl.txt UCA2t1_unl.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t1_unl.txt UCB1_t1_unl.txt]
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t1_uw.txt UCA2t1_uw.txt]
 |align=center|13
 |-
 |Text 2
 |align=center|The Bat and The Weasels
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t2_eng.txt UCA2t2_eng.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t2_eng.txt UCB1_t2_eng.txt]
-|align=center|to be provided soon
 |align=center|to be provided soon
 |align=center|10
@@ Line 28: / Line 25: @@
 |Text 3
 |align=center|The Father and his Sons
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t3_eng.txt UCA2t3_eng.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t3_eng.txt UCB1_t3_eng.txt]
-|align=center|to be provided soon
 |align=center|to be provided soon
 |align=center|11
@@ Line 35: / Line 31: @@
 |Text 4
 |align=center|The Ants and the Grasshopper
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t4_eng.txt UCA2t4_eng.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t4_eng.txt UCB1_t4_eng.txt]
-|align=center|to be provided soon
 |align=center|to be provided soon
 |align=center|10
@@ Line 42: / Line 37: @@
 |Text 5
 |align=center|The Man and the Lion
-|align=center|[http://www.unlweb.net/resources/A2/UCA2t5_eng.txt UCA2t5_eng.txt]
+|align=center|[http://www.unlweb.net/resources/corpus/UCB1/UCB1_t5_eng.txt UCB1_t5_eng.txt]
-|align=center|to be provided soon
 |align=center|to be provided soon
 |align=center|11
@@ Line 51: / Line 45: @@
 <nowiki>**</nowiki>To be used as the input for NLization (EUGENE)<br />
 <nowiki>***</nowiki>To be used for the natural language generation dictionary
-== Pre-workshop tasks ==
-The pre-workshop activities involve only Text 1. Participants in the workshop are expected to:
-*Translate the Text 1 into their own native languages
-*Provide the natural language analysis dictionary corresponding to the translated version of Text 1
-*Provide the natural language generation dictionary corresponding to the UNL version of the Text 1
-These activities should be concluded before September 30th 2012.
-The corresponding files must be sent by e-mail to r.martins@undlfoundation.org
 == Goals ==
-#To provide the dictionary and grammars necessary to '''UNLize''' your translated version of UC-A2 (with [[IAN]])
+#To provide the dictionary and grammars necessary to '''UNLize''' your translated version of UC-B1 (with [[IAN]])
-#To provide the dictionary and grammars necessary to '''NLize''', to your target language, the UNL version of UC-A2 (with [[EUGENE]])
+#To provide the dictionary and grammars necessary to '''NLize''', to your target language, the UNL version of UC-B1 (with [[EUGENE]])
-== Methodology ==
-In order to prepare the dictionaries and grammars to deal with UC-A2, follow the steps below for each text:
-=== UNLization ===
-#Corpus
-##Translate (manually) the sentences of UC-A2 from English into your native language. Be as close as possible to the original, and provide one single translation for each sentence. This will be your input document file, and your goal will be to provide (automatically, through [[IAN]]) the UNL graphs for each sentence
-##Save the translated texts (without the English original) in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>NL FILES.
-#Dictionary
-##Create the analysis dictionary corresponding to the word forms appearing in your translated version of the corpus. The dictionary must be created in compliance with the  [[Dictionary Specs]] and may contain only tags available at the [[tagset]]. For an example of the English dictionary, see [[English_dictionary|English Dictionary]].
-##Save the NL-UNL dictionary in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>DICTIONARIES.
-#Grammar
-##Create the NL-UNL (analysis) transformation grammar necessary to analyze, in UNL, the natural language sentences of the translated corpus. This grammar is the most difficult (and the actual goal) of the whole analysis task. In order to prepare the grammar, study the [[Grammar Specs]]. Next, take a look at the structure of the [[English_grammar|English Grammar]] for a detailed example. In many cases, it would be simpler just to localize the English grammar to your own locale rather than creating a whole grammar from the scratch. See the instructions at [[Localization]]. The grammar is normally developed inside IAN, because we have to test it every time. But you may also prepare a draft grammar, save it in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>IAN>T-RULES.
-##Create the NL-UNL (analysis) disambiguation grammar in order to improve the results of the transformation and to control the process of tokenization. Again, this  grammar is normally developed inside IAN (at the D-RULES tab), because we have to test it every time. Consult the [[English_grammar|English Grammar]] for a detailed example of a disambiguation grammar.
-##Test the grammar against the corpus and provide the necessary changes.
-=== NLization ===
-#Corpus
-##Upload the file [http://www.unlweb.net/resources/A1/UCA2_unl.txt UCA2_unl.txt] to UNLWEB>UNLDEV>EUGENE>UNL DOCUMENT. Do not do any change to this file.
-#Dictionary
-##Create the generation dictionary corresponding to the word forms appearing in your translated version of the corpus. The dictionary must be created in compliance with the  [[Dictionary Specs]] and may contain only tags available at the [[tagset]]. For an example of the English dictionary, see [[English_dictionary|English Dictionary]].
-##Save the UNL-NL dictionary in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>PROJECTS>EUGENE>DICTIONARIES.
-#Grammar
-##Export the inflectional grammar of your language from UNLARIUM>GRAMMAR>[YOUR LOCALE]>EXPORT. If the grammar of your language is not available yet, you may:
-###Provide it through the UNLarium; or
-###Create the inflectional paradigms only for the inflected forms appearing in the UNL-NL dictionary. In that case, follow the model available at [http://www.unlweb.net/unlarium/grammar/export_grammar.php?type=M&direction=G&lang=en English Inflectional Grammar]. The documentation of the English grammar is available at [http://www.unlweb.net/unlarium/grammar/export_grammar.php?type=M&lang=en English Inflectional Grammar (only for reference)]. For further information, see [[Inflectional paradigms]].
-##Save the inflectional grammar in a plain text (.txt) file with UTF-8 encoding and upload it to UNLWEB>UNLDEV>PROJECTS>EUGENE>RULES.
-##Provide the UNL-NL (generation) T-grammar and D-grammar necessary to generate natural language sentences from the UNL corpus. Follow the sample instructions available for the analysis grammar.
 == Samples and Examples ==
-To be provided
+The following resources have been used to deal with UC-A1 in English and may be used as a sample of what is expected to be provided
+*UNLization
+**[http://www.unlweb.net/resources/dic/UCB1/eng_unl_dic.txt ENG-UNL Dictionary] (English dictionary used for the UNLization of UC-B1) (Documentation available at [[English_dictionary|English Dictionary]])
+**[http://www.unlweb.net/resources/dic/default_dic.txt Default Dictionary] (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at [[Default Dictionary]])
+**[http://www.unlweb.net/resources/grammar/UCB1/eng_unl_tgrammar.txt ENG-UNL T-Grammar] (Transformation grammar used for the UNLization of UC-B1) (Documentation available at [[English_grammar|English Grammar]])
+**[http://www.unlweb.net/resources/grammar/UCB1/eng_unl_dgrammar.txt ENG-UNL D-Grammar] (Disambiguation grammar used for the UNLization of UC-B1) (Documentation available at [[English_grammar|English Grammar]])
+**[http://www.unlweb.net/resources/grammar/nl_unl_tgrammar.txt Default T-Grammar] (Default transformation grammar for UNLization) (Documentation available at [[Default Grammar]])
+*NLization
+**[http://www.unlweb.net/resources/dic/UCB1/unl_eng_dic.txt UNL-ENG Dictionary] (English dictionary used for the NLization of UC-B1) (Documentation available at [[English_dictionary|English Dictionary]])
+**[http://www.unlweb.net/resources/dic/default_dic.txt Default Dictionary] (Dictionary used to handle blank spaces, punctuation signs and other language-independent information) (Documentation available at [[Default Dictionary]])
+**[http://www.unlweb.net/resources/dic/UCB1/unl_eng_tgrammar.txt UNL-ENG T-Grammar] (Transformation grammar used for the NLization of UC-B1) (Documentation available at [[English_grammar|English Grammar]])
+**[http://www.unlweb.net/resources/grammar/unl_nl_tgrammar.txt Default T-Grammar] (Default transformation grammar for NLization) (Documentation available at [[Default Grammar]])
 == Recommended Readings ==

UC-B1

Latest revision as of 17:51, 17 April 2013

Contents

The Corpus

Goals

Samples and Examples

Recommended Readings

Views

Personal tools

Search

UNL

Lingware

Software

UNL Program

Navigation

Toolbox

Print/export