Onto.PT: integrating lexical-semantic knowledge to build a public

Transcrição

Onto.PT: integrating lexical-semantic knowledge to
build a public lexical ontology for Portuguese
Hugo Gonçalo Oliveira1
Leticia Antón Pérez
Paulo Gomes
[email protected], [email protected], [email protected]
Cognitive & Media Systems Group
CISUC, Universidade de Coimbra
Portugal
June 26, 2012
1
supported by the FCT scholarship grant SFRH/BD/44955/2008, co-funded by FSE
Gonçalo Oliveira et al. (CISUC)
Onto.PT
June 26, 2012
1 / 18
Introduction
Lexical Ontologies
Knowledge bases for natural language processing (NLP)
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
Lexicon + ontology [Hirst, 2004]
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
I
Words → lexicon
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
I
I
Words → lexicon
Meanings → concepts → ontology
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
I
I
Words → lexicon
Cover the whole language, not a specific domain
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
I
I
Words → lexicon
Essential in the development of NLP tools for a language
Onto.PT
June 26, 2012
2 / 18
Introduction
Lexical Ontologies
I
I
Words → lexicon
Essential in the development of NLP tools for a language
See Princeton WordNet [Fellbaum, 1998] for English!
I
Public, widely used, created manually...
Onto.PT
June 26, 2012
2 / 18
Contents
1
Introduction
2
Related resources
3
Goal
4
Approach
5
Onto.PT v.0.3.4
6
Concluding remarks
Onto.PT
June 26, 2012
3 / 18
Related resources
Portuguese Lexical Knowledge Bases
Wordnets
I
I
2
3
4
5
6
7
8
WordNet.PT2 [Marrafa, 2002]
MultiWordNet.PT3
http://www.clul.ul.pt/clg/eng/wordnetpt/index.html
http://mwnpt.di.fc.ul.pt/
http://www.nilc.icmc.usp.br/tep2/
http://openthesaurus.caixamagica.pt/
http://pt.wiktionary.org/
http://www.dicionario-aberto.net/search
http://www.linguateca.pt/PAPEL
Onto.PT
June 26, 2012
4 / 18
Related resources
Wordnets
I
I
MultiWordNet.PT3
Public thesauri
I
I
2
3
4
5
6
7
8
TeP4 [Maziero et al., 2008]
OpenThesaurus.PT5
Onto.PT
June 26, 2012
4 / 18
Related resources
Wordnets
I
I
MultiWordNet.PT3
Public thesauri
I
I
OpenThesaurus.PT5
Enhanced public dictionaries
I
I
2
3
4
5
6
7
8
Wiktionary.PT6
Dicionário Aberto7 [Simões and Farinha, 2011]
Onto.PT
June 26, 2012
4 / 18
Related resources
Wordnets
I
I
MultiWordNet.PT3
Public thesauri
I
I
OpenThesaurus.PT5
Enhanced public dictionaries
I
I
Wiktionary.PT6
Dicionário Aberto7 [Simões and Farinha, 2011]
Public term-based lexical-semantic network
I
2
3
4
5
6
7
8
PAPEL8 [Gonçalo Oliveira et al., 2010]
Onto.PT
June 26, 2012
4 / 18
Goal
Onto.PT
New lexical ontology for Portuguese
Onto.PT
June 26, 2012
5 / 18
Goal
Onto.PT
Wordnet model
I
I
Synsets: groups of synonym words → concepts
Connected by semantic relations
Onto.PT
June 26, 2012
5 / 18
Goal
Onto.PT
Wordnet model
I
I
Constructed automatically
Onto.PT
June 26, 2012
5 / 18
Goal
Onto.PT
Wordnet model
I
I
Constructed automatically
Exploitation and integration of public resources
I
I
I
Thesauri
Dictionaries/encyclopedias
Corpora
Three independent construction steps
Onto.PT
June 26, 2012
5 / 18
Approach
From textual definitions to a wordnet in three steps
1
gado s.m. conjunto de animais criados para diversos fins; rebanho
(cattle noun set of animals raised for various purposes; flock)
Onto.PT
June 26, 2012
6 / 18
Approach
1
I
I
tb triple1 = rebanho SINONIMO DE gado (flock SYNONYM OF cattle)
tb triple2 = animal MEMBRO DE gado (animal MEMBER OF cattle)
Onto.PT
June 26, 2012
6 / 18
Approach
1
I
I
2
synset1 = (manada, rebanho, mancheia, boiada)
I
+tb triple1 = (manada, rebanho, mancheia, boiada, gado)
Onto.PT
June 26, 2012
6 / 18
Approach
1
I
I
2
synset1 = (manada, rebanho, mancheia, boiada)
3
synset2 = (bicho, animal, alimal, béstia, minante)
I
I
+tb triple1 = (manada, rebanho, mancheia, boiada, gado)
sb triple1 = synset2 MEMBRO DE synset1
Onto.PT
June 26, 2012
6 / 18
Approach
Relation acquisition
Relation extraction from dictionaries –
CARTÃO [Gonçalo Oliveira et al., 2011]
Large lexical-semantic network for Portuguese
Onto.PT
June 26, 2012
7 / 18
Approach
Semantic relations extracted from three dictionaries
I
I
I
Dicionário PRO da Lı́ngua Portuguesa (DLP), through PAPEL
Dicionário Aberto (DA)
Wiktionary.PT
Onto.PT
June 26, 2012
7 / 18
Approach
I
I
I
Wiktionary.PT
About 155,000 lexical items
About 327,000 relational triples (e.g. animal hypernym-of gato)
Onto.PT
June 26, 2012
7 / 18
Approach
I
I
I
Wiktionary.PT
Same relations as PAPEL 3.0:
I
synonymy, hypernymy, part-of, causation, purpose-of, manner-of...
Onto.PT
June 26, 2012
7 / 18
Approach
I
I
I
Wiktionary.PT
I
Precision from 71% (property-of) to 99% (synonymy)
Onto.PT
June 26, 2012
7 / 18
Approach
I
I
I
Wiktionary.PT
I
Precision from 71% (property-of) to 99% (synonymy)
Arguments are lexical items identified by orthographical form
I
Ambiguity arises as a problem!
Onto.PT
June 26, 2012
7 / 18
Approach
Synset augmentation & discovery
Take advantage of public handcrafted thesauri
[Gonçalo Oliveira and Gomes, 2011b]
1
Integrate synonymy of CARTÃO in TeP synsets
Onto.PT
June 26, 2012
8 / 18
Approach
1
I
I
CARTÃO synonymy as a network N, with synonymy pairs p = (vx , vy )
TeP as a thesaurus T , with synsets S = {v1 , v2 , ..., vn }
Onto.PT
June 26, 2012
8 / 18
Approach
1
I
I
Synonymy pair
(alimentação, mantença)
→
(escravizar, servilizar )
→
Synset
{sustento, alimento, mantimento, alimentação, mantença}
{oprimir, tiranizar, escravizar, esmagar, servilizar}
Onto.PT
June 26, 2012
8 / 18
Approach
1
I
I
Synonymy pair
→
→
I
Synset
Evaluation
F
F
Random baseline: Precision = 60-68%, F0.5 = 61-70%
Best (cos(~p , ~
S) ≥ 0.15): Precision = 74%-82%, F0.5 = 73-83%
Onto.PT
June 26, 2012
8 / 18
Approach
1
I
I
Synonymy pair
→
→
I
Evaluation
F
F
2
Synset
Random baseline: Precision = 60-68%, F0.5 = 61-70%
Best (cos(~p , ~
S) ≥ 0.15): Precision = 74%-82%, F0.5 = 73-83%
Discover clusters in remaining synonymy pairs
I
Remaining pairs as a synonymy network N 0
Onto.PT
June 26, 2012
8 / 18
Approach
Clustering for new synsets
[Gonçalo Oliveira and Gomes, 2011a]
Synonymy network
Onto.PT
June 26, 2012
9 / 18
Approach
Synonymy network
Each node and its neighbourhood defines a potential cluster (synset)
Onto.PT
June 26, 2012
9 / 18
Approach
Synonymy network
Onto.PT
June 26, 2012
9 / 18
Approach
Synonymy network
Cluster estimated precision:
I
I
Whole network: 75% (nouns)
After pair assignment:
F
89% (nouns), 83-92% (verbs), 94-95% (adjectives)
Onto.PT
June 26, 2012
9 / 18
Approach
Ontologising semantic relations
From term to synset relations
Find suitable synsets for term arguments:
I
porta part-of carro → {porta, entrada, portão} part-of {carro, automóvel}
Onto.PT
June 26, 2012
10 / 18
Approach
I
Available information:
I
I
Thesaurus T , with synsets
Relational triples between terms, in a graph G
Onto.PT
June 26, 2012
10 / 18
Approach
I
I
I
Output: semantic graph, wordnet W
I
I
Same relations as in G
Between synsets
Onto.PT
June 26, 2012
10 / 18
Approach
I
I
I
Output: semantic graph, wordnet W
I
I
Same relations as in G
Between synsets
Several algorithms implemented [Gonçalo Oliveira and Gomes, 2012]
I
Random baseline:
F
F
I
Precision = 42.1% (hypernymy), 47.4% (part-of), 44.8% (purpose-of)
F0.5 = 25.5% (hypernymy), 30.6% (part-of), 25.0% (purpose-of)
Best results:
F
F
Precision = 60.1% (hypernymy), 63.3% (part-of), 63.4% (purpose-of)
F0.5 = 38.4% (hypernymy), 40.1% (part-of), 36.5% (purpose-of)
Onto.PT
June 26, 2012
10 / 18
Onto.PT v.0.3.4
Lexical items & synsets
Onto.PT v.0.3.4
I
Only items in term triples with at least one argument occurring in
AC/DC [Santos and Bick, 2000] are used
Onto.PT
June 26, 2012
11 / 18
Onto.PT v.0.3.4
Lexical items & synsets
Onto.PT v.0.3.4
I
Only items in term triples with at least one argument occurring in
AC/DC [Santos and Bick, 2000] are used
Organised in about 110,000 synsets
I
Synsets are ordered according to AC/DC frequency of their words
POS
Nouns
Verbs
Adjectives
Adverbs
size > 1
16.962
4.391
11.005
819
Onto.PT
Synsets
size = 1
44.924
21.502
7.941
1.293
Total
61.886
25.893
18.946
2.112
June 26, 2012
11 / 18
Onto.PT v.0.3.4
Relations
Relations (excluding inverse)
About 170,000 synset-based relational triples
Same relations as in PAPEL/CARTÃO
Relations
Predicates
Instances
Hypernym
n hiperonimoDe n
n parteDe n
n parteDeAlgoComProp adj
n membroDe n
n membroDeAlgoComProp adj
adj propDeAlgoMembroDe n
n contidoEm n
n contidoEmAlgoComProp adj
n materialDe n
n causadorDe n
n causadorDeAlgoComProp adj
adj propDeAlgoQueCausa n
n causadorDaAccao v
v accaoQueCausa n
n produtorDe n
n produtorDeAlgoComProp adj
adj propDeAlgoProdutorDe n
n localOrigemDe n
80,533
3,679
4,920
5,841
109
910
351
261
827
1,346
25
627
57
7,731
1,556
74
444
1,290
Part
Member
Contains
Material
Causation
Producer
Place
Relations
Purpose
Antonym
Quality
State
Manner
Manner
without
Property
Onto.PT
Predicates
Instances
n fazSeCom n
n fazSeComAlgoComProp adj
v finalidadeDe n
v finalidadeDeAlgoComProp adj
n antonimoNDe n
v antonimoVDe v
adj antonimoAdjDe adj
adv antonimoAdvDe adv
n temQualidade n
n devidoAQualidade adj
n temEstado n
n devidoAEstado adj
adv maneiraPorMeioDe n
adv maneiraComProp adj
adv maneiraSem n
adv maneiraSemAccao v
adj dizSeSobre n
adj dizSeDoQue v
6,601
82
7,129
328
1.915
1.828
2.131
110
959
1,083
326
197
1,859
1,595
224
17
9,743
25,070
June 26, 2012
12 / 18
Onto.PT v.0.3.4
RDF/OWL model
Onto.PT as a Semantic Web model
Adaptation of W3C WordNet RDF/OWL [van Assem et al., 2006]
Onto.PT
June 26, 2012
13 / 18
Onto.PT v.0.3.4
Querying Onto.PT
OntoBusca interface
Onto.PT
June 26, 2012
14 / 18
Concluding remarks
Concluding remarks
A flexible approach, that enables the integration of several resources
I
May be adapted to the construction/enrichment of wordnets in other
languages
Onto.PT
June 26, 2012
15 / 18
Concluding remarks
Concluding remarks
I
languages
Onto.PT, a new lexical ontology
I
I
Created automatically, higher growth potential
An addition or alternative to existing Portuguese LKBs
Onto.PT
June 26, 2012
15 / 18
Concluding remarks
Concluding remarks
I
languages
I
I
I
Freely available
F
Updates and other resources in http://ontopt.dei.uc.pt
Onto.PT
June 26, 2012
15 / 18
Concluding remarks
Concluding remarks
I
languages
I
Freely available
I
In constant development, future directions:
I
I
F
F
F
F
Updates and other resources in http://ontopt.dei.uc.pt
More evaluation (quality, coverage, utility)
Augmentation by exploiting other resources (e.g. Wikipedia)
Associate definitions/example sentences with synsets
Onto.PT
June 26, 2012
15 / 18
References
References I
[Fellbaum, 1998] Fellbaum, C., editor (1998).
WordNet: An Electronic Lexical Database (Language, Speech, and Communication).
The MIT Press.
[Gonçalo Oliveira et al., 2011] Gonçalo Oliveira, H., Antón Pérez, L., Costa, H., and Gomes, P. (2011).
Uma rede léxico-semântica de grandes dimensões para o português, extraı́da a partir de dicionários electrónicos.
Linguamática, 3(2):23–38.
[Gonçalo Oliveira and Gomes, 2011a] Gonçalo Oliveira, H. and Gomes, P. (2011a).
Automatic discovery of fuzzy synsets from dictionary definitions.
In Proceedings of 22nd International Joint Conference on Artificial Intelligence, IJCAI 2011, pages 1801–1806, Barcelona,
Spain. IJCAI/AAAI.
[Gonçalo Oliveira and Gomes, 2011b] Gonçalo Oliveira, H. and Gomes, P. (2011b).
Automatically enriching a thesaurus with information from dictionaries.
In Progress in Artificial Intelligence, Proceedings of 15th Portuguese Conference on Artificial Intelligence (EPIA 2011),
volume 7026 of LNCS, pages 462–475. Springer.
[Gonçalo Oliveira and Gomes, 2012] Gonçalo Oliveira, H. and Gomes, P. (2012).
Ontologising semantic relations into a relationless thesaurus (ECAI 2012).
In Proceedings of 20th European Conference on Artificial Intelligence (ECAI 2012), page forthcomming, Montpellier, France.
IOS Press.
[Gonçalo Oliveira et al., 2010] Gonçalo Oliveira, H., Santos, D., and Gomes, P. (2010).
Extracção de relações semânticas entre palavras a partir de um dicionário: o PAPEL e sua avaliação.
Linguamática, 2(1):77–93.
[Hirst, 2004]
Ontology
In Staab,
209–230.
Hirst, G. (2004).
and the lexicon.
S. and Studer, R., editors, Handbook on Ontologies, International Handbooks on Information Systems, pages
Springer.
Onto.PT
June 26, 2012
16 / 18
References
References II
[Marrafa, 2002] Marrafa, P. (2002).
Portuguese Wordnet: general architecture and internal semantic relations.
DELTA, 18:131–146.
[Maziero et al., 2008] Maziero, E. G., Pardo, T. A. S., Felippo, A. D., and Dias-da-Silva, B. C. (2008).
A Base de Dados Lexical e a Interface Web do TeP 2.0 - Thesaurus Eletrônico para o Português do Brasil.
In VI Workshop em Tecnologia da Informação e da Linguagem Humana (TIL), pages 390–392.
[Santos and Bick, 2000] Santos, D. and Bick, E. (2000).
Providing Internet access to Portuguese corpora: the AC/DC project.
In Proceedings of 2nd International Conference on Language Resources and Evaluation, LREC 2000, pages 205–210.
[Simões and Farinha, 2011] Simões, A. and Farinha, R. (2011).
Dicionário Aberto: Um novo recurso para PLN.
Vice-Versa, pages 159–171.
[van Assem et al., 2006] van Assem, M., Gangemi, A., and Schreiber, G. (2006).
RDF/OWL representation of WordNet.
W3c working draft, World Wide Web Consortium.
Onto.PT
June 26, 2012
17 / 18
The end
Thank you!
Check http://ontopt.dei.uc.pt
Onto.PT
June 26, 2012
18 / 18

Onto.PT: integrating lexical-semantic knowledge to build a public

Transcrição

Documentos relacionados

Exploring Onto.PT

Onto.PT: towards the automatic construction of a lexical ontology for

TQle63C4. c-4•4.

lista de alunos selecionados para estágio nos bastidores do black

Ginca Sabin Equipe Azul

2 - 2016 BWS NUCLEO

Equipes - Yara Clube

Nome 1) ABEL GALON TORRES 2) AFONSO FRADE CANUTO 3

Lista Final de Propostas Enquadradas e Não Enquadradas

emergencial - peb i