КМ.RU на РОМИП-2008. Оптимизация параметров поискового алгоритма

2. Хfhfrnthbcnbrf rjkktrwbq Сvsck ljrevtynf vj;tn ,snm jwtyty gj nhtv cjcnfdkz.obv:

1. Зfujkjdjr (Title).

2. Тtrcn ljrevtynf.

3. Сcskrb yf ljrevtyn.

Иc[jlz bp 'njuj, jgbitv cdjqcndf rjkktrwbq:

1. Legal – yfb,jkmifz cntgtym cnhernehbhjdfyyjcnb. Фfrnbxtcrb, pfujkjdjr buhftn yfb,jktt ceotcndtyyjt pyfxtybt d jghtltktybb htktdfynyjcnb ljrevtynf. Сcskrb ljcnjdthys.

2. KM.RU – cnhernehbhjdfyf, yj vtymit xtv legal. Дjrevtyns vjuen cjlth;fnm byajhvfwb., yt jnyjczoe.cz r jcyjdyjq ntvt ljrevtynf (ntreobt yjdjcnb b n.g.). Зfujkjdjr j,sxyj ljcnjdthty. Сcskrb j,sxyj ljcnjdthys.

3. BY.WEB – yfbvtymifz cntgtym cnhernehbhjdfyyjcnb. Дjrevtyns vjuen cjlth;fnm byajhvfwb., yt jnyjczoe.cz r jcyjdyjq ntvt ljrevtynf. Зfujkjdjr vj;tn ,snm ytljcnjdthysv. Сcskrb vjuen ,snm ytljcnjdthys.

Дkz rf;ljq cjcnfdkz.otq cvsckf ljrevtynf vj;yj ghjdtcnb hzl jgthfwbq, lf.ob[ yfb,jktt 'aatrnbdye. jwtyre dtcf ljrevtynf. Пhbdtltv rkfccbabrfwb. cjdhtvtyys[ vtnjljd dscnfdktybz dtcf ljrevtyne.

1. Пhjbpdtltybt xfcnjnf ckjdf bp pfghjcf d ljrevtynt – TF b dcnhtxftvjcnb ckjdf d rjkktrwbb – IDF. Чtv ,jkmit cnfnbcnbrf, ntv (d j,otv ckexft) jyf kexit.

2. Оwtyrf hfccnjzybz vt;le ckjdfvb pfghjcf. Нtrfz aeyrwbz jn hfccnjzybz – F (hfccnjzybt). Пfccf;b (gjkyst, ytgjkyst, c extnjv gjhzlrf ckjd b ,tp, c hfccnjzybtv vt;le ckjdfvb b ,tp), gfhs ckjd (c njxysv gjhzlrjv ckjd, c j,hfnysv gjhzlrjv ckjd, cj ckjdfvb vt;le gfhjq ckjd).

3. Кjkbxtcndtyyst jwtyrb – dtc ljrevtynf b dtc ccskjr, hfccxbnfyysq gj ccskjxyjve hfyue.

Вct erfpfyyst vtnjls vjuen ,snm ghbvtytys lkz rjkbxtcndtyyjq jwtyrb 3-[ cvsckjds[ xfcntq ljrevtynf – pfujkjdrf, ntrcnf b ccskjr yf ljrevtyn. Сjjndtncndtyyj, ghb nfrjv gjl[jlt, yfghbvth, vj;yj jnltkmyj jwtybdfnm gfccf;b d pfujkjdrf[, ntrcnt ljrevtynf b ccskrf[ yf ljrevtyn. Тfv ;t exbnsdfnm b gfhs ckjd. Уrfpfyyst vtnjls ujhfplj kexit hf,jnf.n yf [jhjij cnhernehbhjdfyys[ rjkktrwbz[ b ytljcnfnjxyj [jhjij yf gkj[j cnhernehbhjdfyys[. 3. Мjlbabrfwbz fkujhbnvf gjbcrf b hfy;bhjdfybz ljrevtynjd. Аdnjvfnbxtcrfz jgnbvbpfwbz rj'aabwbtynjd 3.1 Сnhernehf fkujhbnvf f) ,fpjdfz ajhvekf; Зf jcyjde vs dpzkb ajhveke, hf,jnf rjnjhjq ,skf ghjltvjycnhbhjdfyf d ghjikjv ujle [2]. Эnjn fkujhbnv c ytrjnjhsvb ekexitybzvb ctqxfc hf,jnftn yf gjhnfkt КМ.RU. ,) vjlbabrfwbb ajhveks. Дj,fdktybt yjds[ afrnjhjd, fdnjvfnbxtcrfz jgnbvbpfwbz rj'aabwbtynjd. Дkz dsxbcktybz htktdfynyjcnb ljrevtynf pfghjce vs bcgjkmpjdfkb cktle.oe. pfdbcbvjcnm: W = k1*W1 + k2*W2 + k3*W3 + k4*W4(1), ult W – bnjujdjt pyfxtybt htktdfynyjcnb ljrevtynf. k1, k2, k3, k4 – rj'aabwtyns. Оcnfyjdbvcz gjlhj,ytt yf rf;ljv bp ckfuftvs[. W1 = TF*IDF(l) * F1(DocWeight), ult: TF*IDF(l) dsxbckztncz gj tfd(l) = freqd(l)/( freqd(l) + 0.5 + 1.5*dld/avg_dl)

freqD(l) - xfcnjnyjcnm ktvvs l d ljrevtynt, dlD – vthf lkbys ljrevtynf, avg_dl – chtlyzz lkbyf ljrevtynf (lkz rjkktrwbq

BY.WEB b KM.RU vs bcgjkmpjdfkb pyfxtybt avg_dl = 400, lkz rjkktrwbb Legal = 1500), IDF - “Inverse term frequency” - ajhvf inhfajdfybz xfcnj bcgjkmpetvs[ d rjkktrwbb ckjd: idf(l) = log((|c| + 0.5)/df(l))/log(|c| + 1) ult |c| - rjkbxtcndj ljrevtynjd d rjkktrwbb, df(l) - rjkbxtcndj ljrevtynjd, ult dcnhtnbkfcm ktvvf l. В bnjujdjt pyfxtybt tf*idf d[jlzn, gjvbvj j,sxyjq dcnhtxftvjcnb ckjdf d ljrevtynt, yfl,fdrb pf ghbcencndbt ckjd d dsltktyys[ j,kfcnz[ (title, pfujkjdrb nbgf h1-h4 b n.g.). В ghjikjv ujle lkz eghjotybz hf,jns vs exbnsdfkb njkmrj dcnhtxftvjcnm ckjd d title. В 'njv ujle ddtkb jcnfkmyst gfhfvtnhs, jndtxf.obt pf ajhvfnbhjdfybt ckjd d ljrevtynt (h1-h4 b ghjx.). F1(DocWeight) – aeyrwbz jn dtcf ljrevtynf, dsxbcktyyjuj gj c[tvt, ghtlkj;tyyjq d [1]. Оcj,tyyjcnb aeyrwbb: f) F1, d njv xbckt, pfybvftncz ghbdtltybtv pyfxtybz DocWeight lj ye;yjuj lbfgfpjyf, afrnbxtcrb, yjhvbhjdrjq. Дtqcndbt aeyrwbb yf dtc ljrevtynf cbkmyj pfdbcbn jn cgjcj,f yjhvbhjdrb, xnj d bnjut ceotcndtyyj dkbztn yf gjhzljr ljrevtynjd d dslfxt; ,) Чfcnm ccskjr ghbpyf.ncz ytbyajhvfnbdysvb b d hfcxtnt yt exfcnde.n. Фfrnbxtcrb W1 jndtxftn pf byajhvfwbjyye. pyfxbvjcnm ljrevtynf b tuj dtc gj jnyjityb. r lheubv ljrevtynfv, dsxbcktyysq gj c[tvt ccskjxyjuj hfy;bhjdfybz, jgbcfyyjq d [1]. W2 = Σ (TF*IDF(Link)* F2(LinkWeight)), ult: TF*IDF(Link) - TF*IDF ccskrb yf lfyysq ljrevtyn; F2(LinkWeight)) – aeyrwbz ghbdtltybz dtcjd ccskjr yf ljrevtyn. LinkWeight dsxbckztncz fyfkjubxyj DocWeight Т.j. W2 jndtxftn pf byajhvfwbjyye. pyfxbvjcnm ccskjr yf lfyysq ljrevtyn b b[ dtcf.

W3 = F3(hfccnjzybt) – aeyrwbz, jndtxf.ofz pf extn hfccnjzybz vt;le ckjdfvb pfghjcf d ljrevtynt. Иvttn ytyektdjt pyfxtybt ghb ghj[j;ltybb rdjhevf. Дfktt j, 'njv gjlhj,yj. В ghjikjv ujle d F3(hfccnjzybt) d[jlbk gfccf; bp pfghjcf, dcnhtxtyysq d ljrevtynt. Сdjqcndf gfccf;f: 1) Пfccf; vj;tn ,snm ytgjkysv. Оy dsxbckztncz gj rdjheve cevvs IDF d[jlzob[ d ytuj ckjd b gj rdjheve xbckf ckjd. О,f gfhfvtnhf pflf.ncz d yfcnhjqrf[. Нfghbvth: gfccf;tv cxbnftncz njn, d rjnjhsq djikj 70% ckjd pfghjcf, b b[ dtc yt vtytt 60% jn cevvs IDF dct[ ckjd pfghjcf. Тjxyst pyfxtybz gjl,bhf.ncz c gjvjom. jgnbvbpfwbb gfhfvtnhjd.

2) Пjhzljr ckjd d gfccf;t yt bvttn pyfxtybz. Мs yfvthtyyj ddtkb 'ne jcj,tyyjcnm gfccf;f, ghbybvfz d hfcxtn cdjqcndf heccrjuj zpsrf, gj rjnjhjve cvsck xfcnj yt pfdbcbn jn gjhzlrf ckjd ([jnz b yt dctulf). Рfcxtn bltn yf nj, xnj,s yt bcrk.xfnm lj,fdre lkz ljrevtynjd, ult ckjdf bp pfghjcf cktle.n d lheujv gjhzlrt. Пk.c, xnj ceotcndtyyj lkz gjbcrf gj dt,e, ,jkmifz lj,fdrf pf ;tcnrbq gjhzljr ckjd lftn ,jkmijt gjkt ltzntkmyjcnb lkz cgfvf gjbcrjds[ vfiby.

f) Пfccf; dsxbckztncz njkmrj lkz ckjd, d[jlzob[ d jlyj ghtlkj;tybt.

,) Рfccnjzybt vt;le ckjdfvb bp pfghjcf d ljrevtynt yt ljk;yj ghtdsifnm vfrcbvfkmyjuj jryf. Нfghbvth, 10 bkb 15.

d) В 'njv ujle vs ddtkb ljgjkybntkmyjt cdjqcndj gfccf;f: gfccf;tv cxbnftncz njn, lkz rjnjhjuj _dct_ ckjdf bp pfghjcf dcnhtnbkbcm d lfyyjv ghtlkj;tybb +/-N ghtlkj;tybq. Зf 'nj ljrevtyn gjkexftn ljgjkybntkmye. yfl,fdre. В ghjujyf[ РОМИП vs bcgjkmpjdfkb pyfxtybt N = 1. Мj;yj bcgjkmpjdfnm ,Оkmitt pyfxtybt (yfghbvth, 2), yj d yfib[ 'rcgthbvtynf[ jyj lfkj [elibq htpekmnfn.

Дjgjkybntkmyj d 'njv ujle ,skb ddtlty cktle.obq gfhfvtnh, pfdbczobt jn hfccnjzybz:

4) Пfhs ckjd. Вtc gj gfhfv ckjd dsxbckzkcz rfr jgbcfyj d [3]. Пhb 'njv, gjybvfz, xnj d hzlt ckexftd njxysq gfccf; kexit jgbcsdftn cvsck ljrevtynf, vs gfhfvb ckjd exbnsdftv d njv xbckt b gjhzljr ckjd d

gfccf;t. В yfib[ 'rcgthbvtynf[ gfhfvtnh lfk ghb,fdre d rfxtcndt 5%. W4 - uheggf ljgjkybntkmys[ gfhfvtnhjd (ddtltyf d 'njv ujle): 1) Бkbpjcnm ckjd bp pfghjcf r yfxfke ghtlkj;tybz. Дj cb[ gjh vs yt dcnhtxfkb jgbcfybt 'njuj afrnjhf d hf,jnf[ gj byajhvfwbjyyjve gjbcre. Оcyjdfybt В heccrjv zpsrt ntvf (bpdtcnyfz byajhvfwbz) ghtlkj;tybz dshf;ftncz d njv xbckt b gjhzlrjv ckjd. Хjnz d heccrjv zpsrt ckjdf vjuen cnjznm d k.,jv gjhzlrt, ghzvjq gjhzljr ckjd zdkztncz ,jktt egjnht,bntkmysv. Тfrbv j,hfpjv, nj, j xtv bltn htxm (ntvf), - j,jpyfxtyj d yfxfkt ahfps. Пhb j,hf,jnrt pfghjcf vs lfdfkb lj,fdre ljrevtyne, ult rk.xtdst ckjdf dcnhtxf.ncz d yfxfkt ghtlkj;tybz. В yfib[ 'rcgthbvtynf[ gfhfvtnh lfk ghb,fdre d rfxtcndt 5%; 2) Вcnhtxftvjcnm d ljrevtynt njxys[ ckjdjajhv bp pfghjcf. Нfb,jktt ceotcndtyysvb d gkfyt ekexitybz rfxtcndf jrfpfkbcm afrnjhs: 1. Пfhs ckjd 2. Бkbpjcnm ckjd bp pfghjcf r yfxfke ghtlkj;tybz. Пjcrjkmre gjzdktybt yjds[ afrnjhjd eckj;yztn ecnhjqcndj fkujhbnvf gjbcrf, vs pflfkbcm wtkm. cjplfnm ghjuhfvve fdnjvfnbxtcrjuj gjl,jhf gfhfvtnhjd b jghtltktybz df;yjcnb njuj bkb byjuj afrnjhf. 3.2 Оgnbvbpfwbz gfhfvtnhjd Мs gjcnfdbkb gthtl cj,jq pflfxe cjplfnm ghjuhfvve, jgnbvbpbhe.oe. rj'aabwbtyns gthtl ckfuftvsvb d ajhvekt htktdfynyjcnb. Пhjuhfvvf jcyjdsdftncz yf 'rcgthnys[ jwtyrf[ ljrevtynjd.

Бfpjq lkz yfcnhjqrb cbcntvs gjcke;bkb vfnthbfks ghjikjujlytuj ctvbyfhf РОМИП: pfghjcs lkz ljhj;rb gjbcrf gj dt,-rjkktrwbb b ljrevtyns, dslfyyst cbcntvfvb-exfcnybwfvb yf lfyyst pfghjcs. Оhbtynbhfvb, ujdjhzobvb, rfrjq ljrevtyn «[jhjibq», f rfrjq «gkj[jq», cnfkb jwtyrb 'rcgthnjd РОМИП.

Зflfxf ghjuhfvvs-jgnbvbpfnjhf – gjlj,hfnm gfhfvtnhs, rjnjhst j,tcgtxbdf.n yfbkexibt htpekmnfns jwtyrb dslfxb. a) ghbywbgs, kt;fobt d jcyjdt ghjuhfvvs-jgnbvbpfnjhf; 1) Оgnbvbpfwbz ltkftncz yf jcyjdt jwtyjr frctccjhjd; 2) Дkz jgnbvbpfwbb gfhfvtnhjd ljk;yf ceotcndjdfnm rjkbxtcn-dtyyfz vthf jwtyrb ljrevtynf – nj, xnj ujdjhbn, xtv jlby ljrevtyn kexit lheujuj. Мs ghbvtyzkb vjlbabwbhjdfyyjt pyfxtybt gjrfpf-ntkz bpref-10. 3) Оgnbvbpfwbz ghj[jlbkf vtnjljv vjlbabwbhjdfyyjuj rjjh-lbyfnyjuj cgecrf. ,) ghj,ktvs, djpybribt d ghjwtcct cjplfybz; Оgnbvbpbhetvfz aeyrwbz j,kflftn cktle.obvb cdjqcndfvb: 1) Фeyrwbz recjxyfz; 2) Фeyrwbz ytvjyjnjyyfz; 3) Фeyrwbz j,kflftn pfdtljvj ,Оkmibv xbckjv gfhfvtnhjd, xtv bcgjkmpetncz lkz tt dsxbcktybz. Иc[jlz bp 'nb[ cdjqcnd, yf[j;ltybt ukj,fkmyjuj vfrcbvevf zdkztncz pfdtljvj ytljcnb;bvsv. В nfrjq cbnefwbb vj;yj ujdjhbnm njkmrj j ljcnfnjxyj [jhjitv kjrfkmyjv vfrcbvevt. В 'nb[ eckjdbz[ vs ghbvtybkb ldf cgjcj,f jgnbvbpfwbb gfhfvtnhjd: 1) Пfhfvtnhs jgnbvbpbhe.ncz dct chfpe; 2) Дkz yfb,jktt pyfxbvs[ c yfitq njxrb phtybz gfhfvtnhjd pflftncz ytcrjkmrj yfxfkmys[ pyfxtybq rj'aabwbtynf. Дkz rf;ljuj pyfxtybz rj'aabwbtynf ghjdjlbncz tuj jgnbvbpfwbz (jgnbvbpbhetncz njkmrj 'njn gfhfvtnh, jcnfkmyst ytbpvtyys). Иp ytcrjkmrb[ «jgnbvbpbhjdfyys[» pyfxtybq gfhfvtnhf ds,bhftncz njn, d rjnjhjv pyfxtybt aeyrwbb htktdfynyjcnb vfrcbvfkmyj. Пjckt xtuj d aeyrwb. htktdfynyjcnb lj,fdkz.ncz lheubt gfhfvtnhs b jgnbvbpbhe.ncz nfrbv ;t cgjcj,jv. О,f cgjcj,f: b 1, b 2 - gjcnhjtys yf rjjhlbyfnyjv cgecrt, hfpkbxbt d njv, xnj d 1 cgecr ltkftncz gj dctv gfhfvtnhfv «gj rheue», f d 2 rf;lsq gfhfvtnh jgnbvbpbhetncz lj vfrcbvfkmyjuj djpvj;yjuj pyfxtybz aeyrwbb, gjnjv yfqltyyjt jgnbvfkmyjt pyfxtybt gfhfvtnhf pfgbcsdftncz rfr rjycnfynf b lfktt ghjdjlbncz jgnbvbpfwbz cktle.otuj gfhfvtnhf.

d) htpekmnfns jgnbvbpfwbb gfhfvtnhjd В htpekmnfnt hf,jns cgjcj, 2 jrfpfkcz ,jktt 'aatrnbdysv ('aatrnbdyjcnm d lfyyjv ckexft jpyfxftn ,Оkmitt pyfxtybt aeyrwbb htktdfynyjcnb). В cdzpb c ceotcndtyyj hfpysvb cdjqcndfvb rjkktrwbq KM.RU, BY.WEB b Legal vs ghjdjlbkb jgnbvbpfwb. rj'aabwbtynjd lkz rf;ljq rjkktrwbb jnltkmyj. 4. Дjgjkybntkmyst djpvj;yjcnb gjbcrjdjuj vt[fybpvf Дkz ekexitybz rfxtcndf hf,jns vs ddtkb cktle.obt cdjqcndf:

1) Пhbvtytybt ckjdfhz cjrhfotybq. Пhbvth: gj pfghjce «РФ» botncz «РФ» b «Рjccbqcrfz Фtlthfwbz».

2) Пhbvtytybt cgbcrf cnjg-ckjd.

5. Мths gj cnhernehbhjdfyb. rjkktrwbb b pfghjcjd Иpdtcnyst cnfnbcnbxtcrbt vtnjls byajhvfwbjyyjuj gjbcrf kexit hf,jnf.n yf [jhjij cnhernehbhjdfyys[ lfyys[. Зflfxf cnhernehbpfwbb ghtlcnfdkztncz yfv cktle.otq. Дfyj:

1. Нtcnhernehbhjdfyyfz rjkktrwbz.

2. Нtcnhernehbhjdfyyst pfghjcs.

Цtkb:

1. Сnhernehbhjdfnm rjkktrwb..

2. Сnhernehbhjdfnm pfghjcs.

В htpekmnfnt nfrb[ ghtj,hfpjdfybq bp cdzpb |«Нtcnhernehbhjdfyyst pfghjcs» → «Нtcnhernehbhbhjdfyyfz rjkktrwbz»| gjkexftv cdzpm |«Сnhernehbhjdfyyst pfghjcs» → «Сnhernehbhbhjdfyyfz rjkktrwbz»|, hf,jnfnm c rjnjhjq ujhfplj ktuxt. Сnhernehbhjdfybt rjkktrwbb

В eckjdbz[ gkj[j cnhernehbhjdfyyjq rjkktrwbb vs ghtlghbyzkb vths gj elfktyb. byajhvfwbjyyjuj ievf bp ljrevtynjd. Пjl byajhvfwbjyysv ievjv vs gjybvftv nj, xnj yt jnyjcbncz r jcyjdyjve cjlth;fyb. ljrevtynjd: htrkfvye. byajhvfwb., ccskrb yf vfnthbfks yf lheub[ cfqnf[ b n.g. Дkz elfktybz vs ghbvtybkb vtnjl, gjpdjkz.obq yf[jlbnm jajhvktybt cnhfybw cfqnf [4]. Мtnjl yt elfkztn dtcm vecjh, yj ljdjkmyj [jhjij cghfdkztncz c pflfxtq. Сnhernehbhjdfybt pfghjcjd Пjl cnhernehbhjdfybtv pfghjcjd vs gjybvftv cktle.obt ifub:

1) Иcghfdktybt jgtxfnjr;

2) Вsxktytybt cvsckf bp pfghjcjd;

3) Рfcibhtybt pfghjcjd.

П.1 htfkbpetncz c gjvjom. cthdbcf bcghfdktybz jgtxfnjr. П.2 elftncz htfkbpjdfnm njkmrj ghb jghtltktyys[ eckjdbz[. Нfghbvth, bp pfghjcf «ghbynths vjcrdf» vj;yj gjkexbnm lfyyst lkz utjnfhutnbyuf, lkz pfghjcf «ntktajy rfat yf geirbycrjq» ghjdtcnb gjbcr gj ,fpt yjvthjd ntktajyjd b dslfnm cjjndtncnde.oe. byajhvfwb.. Нj xfcnj nfre. jgthfwb. ghjbpdtcnb yt ghtlcnfdkztncz djpvj;ysv bp-pf ytjghtltktyyjcnb pfghjcf. П.3 - lkz ghjujyjd РОМИП vs htfkbpjdfkb ckjdfhm cjrhfotybq.

6. Уxfcnbt d ctvbyfht b gjkextyyst htpekmnfns.

6.1 Дjhj;rb, d rjnjhs[ vs ghbyzkb exfcnbt f) ljhj;rb gjbcrf В 'njv ujle, rfr b d ghjikjv, vs exfcndjdfkb d ljhj;rt gjbcrf gj dt,-rjkktrwbb. Пjbcr jceotcndkzkcz jnltkmyj gj yf,jhe ljrevtynjd КМ.RU b jnltkmyj gj ljrevtynfv ,tkjheccrjuj Иynthytnf (BY.WEB). Мs gjghj,jdfkb ct,z d yjds[ lkz yfc ljhj;rf[: gjbcrf gj yjhvfnbdyj-ghfdjdjq rjkktrwbb (Legal) b ljhj;rt gjbcrf gj cvtifyyjq rjkktrwbb, ult cj,hfys dvtcnt chfpe nhb yf,jhf ljrevtynjd: rjkktrwbz КМ.RU, rjkktrwbz ,tkjheccrjuj Иynthytnf b yjhvfnbdyj-ghfdjdfz rjkktrwbz. ,) ghjujys Дkz ljhj;rb gjbcrf gj dt,-rjkktrwbb (b lkz rjkktrwbb КМ.RU, b lkz rjkktrwbb BY.WEB) vs ltkfkb ldf ghjujyf. В gthdjv ghjujyt bcgjkmpjdfkcz fkujhbnv, rjnjhsq ctqxfc hf,jnftn yf gjbcrt gj gjhnfke КМ.RU. Вnjhjq ghjujy jceotcndkzkcz c gjvjom. fkujhbnvf c yjdsvb gjbcrjdsvb afrnjhfvb b jgnbvbpbhjdfyysvb rj'aabwbtynfvb.

Пhbdtltv htpekmnfns gj jcyjdysv gjrfpfntkzv:

Уxfcnybr	Prec(5)	Prec(10)	Bpref-10	Bpref	Recall
[[[[-1	0,3	0,26	0,24	0,19	0,37
[[[[-2	0,33	0,3	0,28	0,22	0,43
[[[[-3	0,24	0,2	0,17	0,14	0,24
[[[[-4	0,33	0,31	0,33	0,26	0,55
[[[[-5	0,31	0,26	0,24	0,2	0,38
[[[[-6	0,17	0,15	0,13	0,11	0,2
КМ	0,31	0,28	0,26	0,22	0,38
[[[[-8	0,25	0,21	0,17	0,15	0,25
[[[[-9	0,29	0,27	0,22	0,19	0,31
[[[[-10	0,34	0,32	0,33	0,26	0,55
КМ-jgnbv	0,34	0,3	0,27	0,23	0,4
[[[[-12	0,31	0,26	0,24	0,2	0,39
[[[[-13	0,29	0,26	0,24	0,19	0,38
[[[[-14	0,25	0,21	0,17	0,15	0,25
[[[[-15	0,3	0,27	0,24	0,19	0,39

Пj gjrfpfntk. Precision(5) e yfc htpekmnfn yf ehjdyt kblthf (ghjujy xxxx-10), xnj cjjndtncndetn yfibv wtkzv. Пj Precision(10), Bpref b Bpref-10 - ljcnfnjxyj [jhjibt pyfxtybz. Пj gjrfpfntk. Recall yf[jlbvcz d jcyjdyjq uheggt. Оncnfdfybt d Recall jn kblthjd ghtlgjkj;bntkmyj jcyjdsdftncz yf ytbcgjkmpjdfybb yfvb d ghjujyf[ gjbcrf gj rdjheve. Пjckt clfxb htpekmnfnjd d РОМИП vs ghjljk;bkb bccktljdfybz. Пhtlghbybvfkbcm cktle.obt ifub: 1. У,hfkb bcgjkmpjdfybt cnjg-ckjd. Иynthtcyj, xnj, ghjdthbd 'njn ht;bv yf hfpys[ pfghjcf[ b rjkktrwbz[ (BY, KM.RU c pfghjcfvb 2007 b 2008 ujljd) dtplt vs gjkexbkb htpekmnfn kexibq, xtv ghb bcrk.xtybb cnjg-ckjd bp gjbcrf. 2. Вrk.xbkb ht;bv bcghfdktybz jgtxfnjr b bcgjkmpjdfybz rdjhevf. Пhb 'njv rdjhev gj evjkxfyb. yt hf,jnfk, f gjlrk.xfkcz njkmrj ghb cktle.ob[ eckjdbz[: f) jncencndbt ljrevtynjd d dslfxt; bkb ,) jncencndbt gfccf;f d ljrevtynf[ dslfxb.

Кjkktrwbz KM.RU У yfc gjkexbkbcm cktle.obt htpekmnfns: Гhfabr TREC, jwtyrf OR lkz rjkktrwbb KM.RU «KM» - htpekmnfns hf,jns fkujhbnvf, hf,jnf.otuj yf KM.RU, «KM jgnbv» - htpekmnfns yjdjuj fkujhbnvf. Вblyj, xnj uhfabrb exfcnybrjd hfpltkbkbcm yf ldt uheggs. У gthdjq uheggs uhfabrjd htprj pflhfyj yfxfkj, cjjndtncndtyyj, gthdst njxrb e yb[ dsit. Вnjhfz uheggf uhfabrjd – ujhbpjynfkmyfz. Нfxfkmyst njxrb yf b[ uhfabrf[ yb;t. Гheggs gthtctrf.ncz gjckt dnjhjq njxrb, b lfktt uhfabrb gthdjq uheggs cnhtvbntkmyj gflf.n, f dnjhjq gkfdyj cyb;f.ncz. Дevftv, xnj ltktybt yf uheggs cdzpfyj c jcj,tyyjcnzvb fkujhbnvjd exfcnybrjd. Пhbdtltv htpekmnfns gj jcyjdysv gjrfpfntkzv: 00,10,20,30,40,50,60,70,81234567891011[[[[-1[[[[-2[[[[-3КМ-jgnbv[[[[-5[[[[-6[[[[-7[[[[-8[[[[-9КМ[[[[-11[[[[-12[[[[-13[[[[-14[[[[-15

№	Pr(5)	Pr(10)	Bpref-10	Bpref	Recall
[[[[-1	0,54	0,43	0,29	0,27	0,42
[[[[-2	0,54	0,45	0,28	0,27	0,33
[[[[-3	0,40	0,33	0,20	0,19	0,28
КМ-jgnbv	0,53	0,45	0,36	0,34	0,43

[[[[-5	0,55	0,46	0,31	0,29	0,45
[[[[-6	0,42	0,40	0,34	0,32	0,50
[[[[-7	0,50	0,43	0,27	0,26	0,31
[[[[-8	0,49	0,45	0,39	0,37	0,58
[[[[-9	0,52	0,48	0,37	0,34	0,46
КМ	0,49	0,44	0,36	0,34	0,43
[[[[-11	0,60	0,46	0,29	0,27	0,40
[[[[-12	0,48	0,44	0,34	0,30	0,40
[[[[-13	0,56	0,44	0,31	0,29	0,39
[[[[-14	0,51	0,46	0,27	0,26	0,33
[[[[-15	0,50	0,45	0,30	0,28	0,41

Пjckt clfxb htpekmnfnjd vs bcgsnfkb yf rjkktrwbb KM.RU gjbcr gj rdjheve c cj,k.ltybtv jgbcfyys[ dsit eckjdbq. Вblyj, xnj [fhfrnth uhfabrf yt bpvtybkcz, yj cfv uhfabr gkfdyj gjlyzkcz ddth[. В wtkjv uhfabr TREC jrfpfkcz jxtym xedcndbntkty r cbnefwbzv, rjulf cbcntvf yt yf[jlbn ljrevtynjd. Пhbvtybd rdjhev r itcnb pfghjcfv bp itcnbltcznb, pflfyys[ r rjkktrwbb KM.RU, vs gjkexbkb ceotcndtyyj kexibq uhfabr. В cbnefwbz[, rjulf rdjhev yt nht,etncz, vjlbabrfwbz cbcntvs, ghtlcnfdktyyfz yf РОМИП, jnhf,fnsdftn [jhjij. Гhfabr TREC c vt[fybpvjv rdjhevf lkz rjkktrwbb KM.RU (ltkfkcz dyt РОМИП gjckt clfxb jcyjdys[ htpekmnfnjd) 00,10,20,30,40,50,60,70,81234567891011КМ - rdjhevКМ - jgnbvxxxx-5

Кjkktrwbz Legal У yfc gjkexbkbcm cktle.obt htpekmnfns: Гhfabr TREC, jwtyrf OR lkz rjkktrwbb Legal Пhbdtltv htpekmnfns gj jcyjdysv gjrfpfntkzv: 00,10,20,30,40,50,60,70,80,900,10,20,30,40,50,60,70,80,91xxxx-1xxxx-2xxxx-3КМxxxx-5xxxx-6

Мs cltkfkb jlby 'rcgthbvtynfkmysq ghjujy. Нfv ,skj bynthtcyj, rfr gjbcrjdsq vt[fybpv, jgnbvbpbhjdfyysq lkz dt,f, cghfdbncz cj cgtwbabxtcrjq rjkktrwbtq. Рtpekmnfn gjrfpfk, xnj yfit yfghfdktybt – kexibq htpekmnfn yf vfrcbvfkmyj dscjrjq gjpbwbb – dslth;bdftncz. 1-z njxrf yf uhfabrt TREC yf[jlbncz ljcnfnjxyj dscjrj. Пjrfpfntkm precision(5) yf[jlbncz yf [jhjitv ehjdyt gj chfdytyb. c lheubvb exfcnybrfvb. Дfktt vs bltv dcktl pf jcyjdyjq uheggjq. Пjcrjkmre gjbcr gj cgtwbabxysv rjkktrwbzv yt zdkztncz yfibv ghbjhbntnysv yfghfdktybtv, vs d wtkjv ljdjkmys htpekmnfnjv. Тtv yt vtytt, vs htibkb dszcybnm ghbxbye gfltybz uhfabrf b djpvj;yjcnm ekexitybz rfxtcndf gjbcrf gj ghjbpdjkmyjq rjkktrwbb (d lfyyjv ckexft, yjhvfnbdys[ ljrevtynjd). Нtcvjnhz yf nj, xnj d rjkktrwbb ghbcencndetn ,jkmijt xbckj ccskjr, htibkb dszcybnm, rfr gjbcr jnhf,jnftn ,tp ccskjxyjuj hfy;bhjdfybz. Тtcns gjrfpfkb, xnj d 'njv ckexft htpekmnfns gjkexf.ncz kexit. Вjpvj;yj, 'nj jpyfxftn, xnj r gjlj,yjq rjkktrwbb ytghbvtybv nhflbwbjyysq gjl[jl, bcgjkmpe.obq ccskjxysq uhfa. Дjgjkybntkmyj vs dszcybkb, xnj rfxtcndj hfy;bhjdfybz ceotcndtyyj pfdbcbn jn extnf gfccf;tq d pfujkjdrt ljrevtynf. Дfkmytqitt gjdsitybt rfxtcndf gjbcrf vj;tn ,snm cdzpfyj c bcgjkmpjdfybtv rdjhevf b ckjdfhz cgtwbabxtcrb[ lkz rjkktrwbb cjrhfotybq. Гhfabr TREC ,tp ccskjxyjuj hfy;bhjdfybz b c gfccf;fvb d pfujkjdrf[ lkz rjkktrwbb Legal (ltkfkcz dyt РОМИП gjckt clfxb jcyjdys[ htpekmnfnjd) Вsdjls Эrcgthbvtyns yf РОМИП gjrfpfkb, xnj jgnbvbpfwbz rj'aabwbtynjd d ajhvekt htktdfynyjcnb lftn ghbhjcn rfxtcndf gjbcrf. Нjdst gfhfvtnhs - gfhs ckjd b ,kbpjcnm ckjd r yfxfke ghtlkj;tybq – nj;t pfhtrjvtyljdfkb ct,z [jhjij. Эnj jcj,tyyj pfvtnyj d gjbcrt gj dt,-rjkktrwbb. 00,10,20,30,40,50,60,70,81234567891011КМ ,tp ccskjxyjujhfy;bhjdfybz b cgfccf;fvb dpfujkjdrf[КМ cj ccskjxysvhfy;bhjdfybtv

VII. Вjpvj;yst genb lfkmytqituj hfpdbnbz Оcyjdyst vtnjls ekexitybz rfxtcndf dslfxb gjbcrjds[ vfiby d Иynthytnt lj cb[ gjh ,skb cdzpfys c fyfkbpjv ljrevtynjd d dt,-rjkktrwbb, f fyfkbpe pfghjcjd gjkmpjdfntktq yt eltkzkjcm ljk;yjuj dybvfybz. Оlyfrj ctqxfc dct ,jkmit bccktljdfntktq j,hfoftncz r 'njq ntvt (gjcrjkmre yfv bynthtcty byajhvfwbjyysq gjbcr d ctnb Иynthytn, vs ujdjhbv j, bccktljdfybb pfghjcjd b ntrcnjd ljrevtynjd d hfvrf[ dt,f). К fyfkbpe pfghjcf vj;yj jnytcnb fyfkbp tuj cbynfrcbxtcrjuj ecnhjqcndf, vjhajkjubxtcrb[ jcj,tyyjcntq ckjd d pfghjct, f nfr;t b[ ctvfynbxtcrjuj pyfxtybz. Сbynfrcbxtcrbq fyfkbp pfghjcf jnxfcnb ghtlcnfdkztncz nhelyjghjbpdjlbvsv, gjcrjkmre ajhvekbhjdrf vyjub[ dt,-pfghjcjd yt cjjndtncndetn cnhjtyb. ahfps d tcntcndtyyjv zpsrt (ghbvth: Мjcrdf ghbynths pfrfpfnm). Сbynfrcbxtcrbq fyfkbp pfghjcf vj;tn ,snm bynthtcty lkz cjplfybz djghjcyj-jndtnyjuj gjbcrf (yf djghjc: В rfrjv ujle hjlbkcz Пeirby – botv jndtn: Пeirby hjlbkcz d Х ujle, ult Х – cjcnfdyjt xbckbntkmyjt bkb xtnsht[pyfxyjt xbckj). Оlyfrj jhufybpfwbz nfrjuj dblf gjbcrf c cj,cndtyyjq ,fpjq ghjbyltrcbhjdfyys[ ljrevtynjd nht,etn yfvyjuj ,jkmit ecbkbq gj chfdytyb. c «nhflbwbjyyjq» gjbcrjdjq vfibyjq, gjcrjkmre djghjcyj-jndtnysq gjbcr ghtlgjkfuftn yfgbcfybt ,jkmijuj rjkbxtcndf ghfdbk, jnhf,jnrf rjnjhs[ ,eltn pfvtlkznm ghjwtcc j,hf,jnrb pfghjcf, b gjbcrjdjuj byltrcf bp hfpvtxtyys[ dt,-ljrevtynjd, rjnjhsq ,eltn pyfxbntkmyj ghtdsifnm gj j,]tve byltrc nhflbwbjyyjq gjbcrjdjq vfibys, xnj vj;tn gjpdjkbnm ct,t yt rf;lfz rjvfylf hfphf,jnxbrjd. Пj'njve ctqxfc yf hsyrt ytn djghjcyj-jndtnyjq cbcntvs, cgjcj,yjq yfhfdyt rjyrehbhjdfnm c ghjvsiktyysvb cbcntvfvb byajhvfwbjyyjuj gjbcrf d Иynthytnt. Уxtn vjhajkjubxtcrb[ jcj,tyyjcntq ckjd d pfghjct gjnht,etn fyfkbpf vjhajkjubxtcrb[ jcj,tyyjcntq ckjd b d dt,-ljrevtynf[, xnj, jxtdblyj, pyfxbntkmyj edtkbxbn j,]tv gjbcrjdjuj byltrcf. Пhjwtcc, crjhtt dctuj, ,eltn ntcyj cdzpfy c cbynfrcbxtcrbv fyfkbpjv ckjd d pfghjct (yfghbvth, bcgjkmpjdfybt byajhvfwbb j gflt;f[ lkz jghtltktybz ukfdyjuj ckjdf d ckjdjcjxtnfybz[ «,hfcktn bp pjkjnf», «rfhnf ujhjlf»).

Нfb,jktt ghbdktrfntkmyjq gjrf jcnftncz gthcgtrnbdf ghjdtltybz ctvfynbxtcrjuj fyfkbpf. Иyajhvfwb. j ctvfynbxtcrb[ pyfxtybz[ vj;yj bcgjkmpjdfnm lkz jghtltktybz ntvfnbrb pfghjcf, gjl,jhf cbyjybvjd lkz ckjd bp pfghjcf, cjplfybz ,fps cdzpfyys[ gjyznbq b lkz gthtajhvekbhjdrb pfghjcf lheubvb ckjdfvb. У;t ctqxfc gjbcrjdst cbcntvs evt.n hfcibahjdsdfnm cjrhfotybz (МГУ = Мjcrjdcrbq ujcelfhcndtyysq eybdthcbntn) b cjgjcnfdkznm heccrbq b fyukbqcrbq dfhbfyn yfgbcfybz ckjd (БМВ = BMW). Дkz yfc ghtlcnfdkztncz bynthtcysv gjcnhjtybt ,fps cdzpfyys[ gjyznbq lkz ckjd heccrjuj zpsrf, b vs yfxfkb 'rcgthbvtynbhjdfnm d 'njv yfghfdktybb. Эrcgthbvtyns gjrfpfkb, xnj gjcnhjtybt cdzptq vt;le ckjdfvb lkz dsltktyyjq ntvfnbxtcrjq j,kfcnb - 'nj dgjkyt htiftvfz pflfxtq, jlyfrj bcgjkmpjdfybt ds,hfyys[ yfvb vtnjljd dhzl kb gjpdjkbn cjplfnm ctnm cdzpfyys[ gjyznbq lkz dct[ ntvfnbxtcrb[ j,kfcntq chfpe. Пj'njve yf ,kb;fqitt ,eleott vs cnfdbv gthtl cj,jq ldt pflfxb: 1) yfexbnmcz ecnfyfdkbdfnm cdzpb vt;le ckjdfvb lkz ghjbpdjkmyjq ds,jhrb ntrcnjd b pf ghbtvktvjt dhtvz; 2) yfexbnmcz rjhhtrnyj bcgjkmpjdfnm ,fpe cdzpfyys[ gjyznbq lkz gthtajhvekbhjdrb dt,-pfghjcf. Тjulf rfr ghb ghjcns[ gthtajhvekbhjdrf[ pfghjcf (hfcibahjdrf cjrhfotybq, pfvtyf heccrjuj yfgbcfybz yf fyukbqcrjt) vj;yj vfrcbvfkmyj juhflbnm ct,z jn jib,jr, nj ghb ,jktt ckj;ys[ dfhbfynf[ gthtajhvekbhjdrb ghb[jlbncz cnfkrbdfnmcz c hzljv nhelyjcntq. Дj cb[ gjh jcyjdysv 'nfgjv j,hf,jnrb pfghjcf Иynthytn-gjkmpjdfntkz zdkztncz gjbcr ckjd bp pfghjcf d dt,-ljrevtynf[, b ghb pfvtyt ckjd bp pfghjcf yf cbyjybvs, rjnjhst ghtlcnfdkz.ncz yfv jxtdblysvb, gjbcr ,eltn ghjbpdjlbnmcz e;t gj lheubv ckjdfv, xnj vj;tn e[elibnm rfxtcndj dslfxb. Нfghbvth, d yfcnjzott dhtvz cdzpm gjyznbq Мtldtltd b ghtpbltyn Рjccbb lkz yfc ,tpeckjdyf, b tckb yf pfghjc Мtldtltd vs dslflbv cfqn ghtpbltynf Рjccbb, nj 'njn ljrevtyn gjkmpjdfntkm, crjhtt dctuj, cjxntn [jhjibv rfr jlby bp dfhbfynjd jndtnf, jlyfrj vs yt vj;tv dslfxe lkz pfghjcf Мtldtltd gjkyjcnm. gjlvtybnm dslfxtq lkz pfghjcf ghtpbltyn Рjccbb, n.r. d 'njv ckexft gjkmpjdfntkm, djpvj;yj, yt gjkexbn ljrevtyns c ,bjuhfabtq Мtldtltdf, c tuj bynthdm. b ghjx., b 'nj tot yt cfvjt gkj[jt, [e;t, tckb ghb nfrjq gjlvtyt dslfxb vs jnlflbv ljrevtyns ghj ghtpbltynf Пenbyf bkb ghtpbltynf Еkmwbyf, njulf rfr gjkmpjdfntkm, vj;tn ,snm, [jntk epyfnm kbxyst afrns ,bjuhfabb ghtpbltynf Мtldtltdf, b tuj cjdctv yt bynthtcjdfk gjkbnbxtcrbq fcgtrn.

Тtv yt vtytt, ytcvjnhz yf vyj;tcndj nhelyjcntq, cdzpfyys[ c ghjdtltybtv ctvfynbxtcrjuj fyfkbpf pfghjcf, 'njn genm hfpdbnbz ghtlcnfdkztncz ljcnfnjxyj gthcgtrnbdysv, b vs gkfybhetv ghjdjlbnm 'rcgthbvtyns d 'njv yfghfdktybb. Еckb nfrbt cgjcj,s jwtyrb htktdfynyjcnb ljrevtynf, rfr hfcxtn tf*idf, dtcf ljrevtynf, hfccnjzybz vt;le rk.xtdsvb ckjdfvb, vj;yj cxbnfnm rjkbxtcndtyysvb gjrfpfntkzvb, nj fyfkbp ctvfynbxtcrjuj pyfxtybz pfghjcf – 'nj jwtyrf e;t lheujuj gkfyf. Нtcjvytyyj, vs yt [jnbv jnrfpsdfnmcz jn extnf rjkbxtcndtyys[ gjrfpfntktq ghb j,hf,jnrt pfghjcf, yj yflttvcz, xnj bcgjkmpjdfybt yjdjq byajhvfwbb gjvj;tn yfv cltkfnm rfxtcndtyysq ifu dgthtl. Лbnthfnehf

[1]. «The anatomy of a large-scale hypertextual Web search engine» S. Brin, L. Page. - http://infolab.stanford.edu/~backrub/google.html

[2]. «KM.RU yf РОМИП-2007», С.Тfntdjczy, Н.Бhspufkjdf - http://romip.ru/romip2007/romip2007_KM.RU.pdf

[3]. «Аkujhbnv ntrcnjdjuj hfy;bhjdfybz Яyltrcf yf РОМИП-2006» Аylhtq Гekby, Мb[fbk Мfckjd, Иkmz Сtufkjdbx - http://download.yandex.ru/company/03_yandex.pdf

[4]. «Иpdktxtybt pyfxbvjq byajhvfwbb bp web-cnhfybw lkz pflfx byajhvfwbjyyjuj gjbcrf» М.С. Аuttd, И.В. Вthibyybrjd, Б.В. Дj,hjd - http://www.cir.ru/docs/ips/publications/2005_yandex_obraml.pdf

[5]. «Оgnbvbpfwbz gfhfvtnhjd fkujhbnvf gjbcrf yf jcyjdt fyfkbpf jwtyjr 'rcgthnjd», М.С. Аuttd, Б.В. Дj,hjd - http://romip.ru/romip2005/07_uirussia.pdf

KM.RU at RIRES-2008. Parameter optimization S. Tatevosyan, N. Bryzgalova The paper describes a new modification of the information retrieval algorithm, introduced by KM.RU at RIRES-2007, we also talk about an optimizing system aimed at getting the most efficient coefficients for algorithm’s parameters for obtaining better results in information retrieval and document ranking. The article reports on results of KM.RU at RIRES-2008 and our future plans.

www.romver.ru / Полный список статей / КМ.RU на РОМИП-2008