|
ÀÁÐÀÊÀÄÀÁÐÀ (Òîæå ñàìîå íî â ÷èòàåìîì âèäå)
Çfxfcne. cfqns c ghtrhfcysv eybrfkmysv rjyntynjv jrfpsdf.ncz
nhelyjljcnegysvb lkz gjkmpjdfntktq gjbcrjds[ cbcntv njkmrj kbim gjnjve,
xnj b[ hfphf,jnxbrb d cdjt dhtvz yt gjpf,jnbkbcm j njv, yfcrjkmrj
rjhhtrnyj 'nb cfqns cvjuen ghjbyltrcbhjdfnm b jnhfy;bhjdfnm gjbcrjdst
vfibys. Íb;t hfccvjnhbv yfb,jktt nbgbxyst jib,rb b ytljxtns,
ghtgzncnde.obt rjhhtrnyjq byltrcfwbb b hfy;bhjdfyb. cfqnjd d gjbcrjds[
vfibyf[. Ýnb jib,rb vj;yj eckjdyj hfpltkbnm yf 3 ,jkmibt uheggs:
1. Ècgjkmpjdfybt rjycnherwbq, pfnhelyz.ob[ rjhhtrnyjt byltrcbhjdfybt ljrevtynjd 2. Çfcjhtybt byltrcjd gjbcrjds[ vfiby le,kbrfnfvb cnhfybw 3. Îib,rb, ghtgzncnde.obt yfb,jktt gjkyjq b ,scnhjq byltrcfwbb b gthtbyltrcfwbb cfqnf
Ðfccvjnhbv b[ gjlhj,ytt.
1. Ècgjkmpjdfybt rjycnherwbq, pfnhelyz.ob[ rjhhtrnyjt byltrcbhjdfybt ljrevtynjd.
Ýnb jib,rb vjuen ghbdtcnb r njve, xnj gjbcrjdst cbcntvs yt cvjuen
ghjbyltrcbhjdfnm ytrjnjhst cnhfybws cfqnf gjkyjcnm. bkb xfcnbxyj, f
nfr;t yt cvjuen extcnm ytrjnjhst ccskrb vt;le cnhfybwfvb cfqnf.
Java-script, Vbscript
Ïjbcrjdst cbcntvs yt bcgjkyz.n crhbgns, bcgjkyztvst yf cnjhjyt
rkbtynf. Â ghjnbdyjv ckexft b[ bcgjkytybt htprj gjdscbkj ,s yfuhepre yf
cthdthf hj,jnjd. Íb Java-script, yb Vbscript yf ctujlyziybq ltym yt
byltrcbhe.ncz gjbcrjdsvb cbcntvfvb. Ïj'njve hj,jns yt vjuen yb
ghjbyltrcbhjdfnm ntrcn, yb yfqnb ccskrb, dsgjkytyyst yf Java-script bkb
Vbscript. Ïjcktlytt vj;tn cke;bnm ghtgzncndbtv lkz byltrcfwbb ytrjnjhs[
cnhfybw cfqnf (gjbcrjdst hj,jns b[ ghjcnj yt cvjuen yfqnb gj ccskrfv) b
hfcghtltktyb. gjrfpfntktq fdnjhbntnyjcnb dyenhb cfqnf. Îlyfrj, ghb
evtkjv bcgjkmpjdfybb, c gjvjom. gjlj,ys[ ccskjr vj;yj vfybgekbhjdfnm
hfcghtltktybtv gjrfpfntktq fdnjhbntnyjcnb gj dfitve ecvjnhtyb..
Ò'u <noindex>
Åo¸ ghjot crhsnm ntrcn bkb ccskrb vj;yj c gjvjom. n'uf
<noindex></noindex>. Ïhfdlf, yt jn dct[ gjbcrjdbrjd. Ýnjn
n'u - bcrk.xbntkmyj jntxtcndtyyfz hfphf,jnrf. Åuj exbnsdf.n dctuj ldt
gjbcrjdst cbcntvs - ßyltrc b Ðfv,kth. Êjl hfcgjkj;tyysq dyenhb 'njuj
n'uf, d njv xbckt b ccskrb, yt byltrcbhetncz 'nbvb gjbcrjdsvb cbcntvfvb.
Ïj'njve yflj bp,tufnm bcgjkmpjdfybz 'njuj ntuf yf cnhfybwf[ cfqnf, tckb
Âs [jnbnt, xnj,s cjlth;bvjt cnhfybws ,skj gjkyjcnm. ghjbyltrcbhjdfyj.
Ífb,jktt nbgbxyjq jib,rjq zdkztncz bcgjkmpjdfybt 'njuj ntuf lkz pfrhsnbz
lkz byltrcfwbb 'ktvtynjd yfdbufwbjyyjuj vty. ghb bcgjkmpjdfybb yf cfqnt
kjrfkmyjuj gjbcrf, hf,jnf.otuj yf gjbcrjdjv ldb;rt mnoGoSearch, nfr;t
gjllth;bdf.otq 'njn ntu. Îgznm-nfrb, ghb evtkjv bcgjkmpjdfybb, c gjvjom.
'njuj ntuf vj;yj vfybgekbhjdfnm hfcghtltktybtv gjrfpfntktq
fdnjhbntnyjcnb gj dfitve ecvjnhtyb. bkb rjywtynhfwbtq rk.xtds[ ckjd.
Flash
Òfr;t rfr b crhbgns, Flash lj ytlfdyb[ gjh yt byltrcbhjdfkcz
gjbcrjdsvb cbcntvfvb b dcz 'nf "rhfcjnf" yt gjgflfkf d ,fps gjbcrjds[
cbcntv. Îlyfrj, d gjcktlytt dhtvz ytrjnjhst gjbcrjdst vfibys (d
xfcnyjcnb, Ðfv,kth b ßyltrc) pfzdbkb j, byltrcfwbb Flash. Òtv yt vtytt, z
,s yt htrjvtyljdfk ibhjrjt bcgjkmpjdfybt 'njq nt[yjkjubb, tckb ds
[jnbnt, xnj ,s dfib cfqns [jhjij hfy;bhjdfkbcm gjbcrjdsvb vfibyfvb.
Ôhtqvs
Ïhb gthdjyfxfkmyj rf;eotqcz ghbdktrfntkmyjcnb bcgjkmpjdfybz ahtqvjd
yf cfqnt, yf gjdthre jyb j,jhfxbdf.ncz njkmrj ghj,ktvfvb. È ltkj yt
njkmrj d njv, xnj yf rf;ljq cnhfybwt ytj,[jlbvj crhbgns, rjnjhst d 'njv
ckexft pfuhe;f.n dc. ahtqvjde. cnhernehe cfqnf b jnrhsdf.n d jlyjv bp
ahtqvjd ne cnhfybwe, yf rjnjhe. gjctnbntkm ghbitk gthdjyfxfkmyj.
Ôhtqvjdst cnhernehs ,jktt vtlktyyj byltrcbhe.ncz. Ítzcyj, rfr
hfcghtltkztncz dj ahtqvf[ gjrfpfntkb fdnjhbntnyjcnb. Íj tckb e; dfv
ljdtkjcm hf,jnfnm c nfrbv cfqnjv b ytn djpvj;yjcnb jnrfpfnmcz jn
ahtqvjd, nj bcgjkmpeqnt n'u <noframes> - tuj cjlth;fybt, ntrcn b
ccskrb, byltrcbhe.ncz. Íj ytj,[jlbvj ,snm jcnjhj;ysv c tuj
bcgjkmpjdfybtv. Êfr b r k.,jve rjyntyne, crhsnjve jn gjkmpjdfntkz, r
cjlth;fyb. <noframes> gjbcrjdst cbcntvs jnyjczncz c gjljphtybtv, b
jyj ljdjkmyj kturj vj;tn ,snm hfcwtytyj rfr cgfv.
Ðtlbhtrns
Ðtlbhtrn, n.t. gthtyfghfdktybt gjkmpjdfntkz ,tp tuj frnbdys[ ltqcndbq
yf lheue. cnhfybwe, ,sdftn lde[ nbgjd: bcgjkyztvsq yf cnjhjyt cthdthf b
yf cnjhjyt rkbtynf. Êkbtyncrbq htlbhtrn - dtom djj,ot jxtym jgfcyfz,
cfqn vj;tn gjgfcnm d ,fy-kbcn ghjcnj pf tuj bcgjkmpjdfybt. Ätkj d njv,
xnj htlbhtrn yf cnjhjyt rkbtynf j,sxyj bcgjkmpetncz lkz cgfvf gjbcrjds[
cbcntv c gjvjom. ljhdttd. Ðj,jnjv byltrcbhetncz rfr ,s j,sxyfz cnhfybwf,
jgnbvbpbhjdfyyfz gjl rfrjq-kb,j pfghjc, yj ghb j,hfotybb gjkmpjdfntkz r
cnhfybwt tuj gthtyfghfdkz.n yf lheue. cnhfybwe.
Ðtlbhtrn, bcgjkyztvsq yf cnjhjyt cthdthf, yt gjgflftn gjl cfyrwbb, yj
[jhjituj d y¸v nj;t ybxtuj ytn. Ätkj d njv, xnj vt;le ljrevtynjv À, yf
rjnjhjv cnjbn ccskrf b ljrevtynjv Â, yf rjnjhsq d rjytxyjv cxtnt
gjgflftn gjkmpjdfntkm, yf[jlbncz ghjvt;enjxysq ljrevtyn Ñ. È gj'njve
gjlj,yfz rjycnherwbz gjbcrjdjq vfibyjq vj;tn b yt ,snm hfcwtytyf, rfr
ccskrf c ljrevtynf À yf ljrevtyn  cj dctvb dsntrf.obvb gjcktlcndbzvb.
Äbyfvbxtcrbt flhtcf cnhfybw
Ïjbcrjdst cbcntvs yt vjuen pyfnm, rfrbv j,hfpjv ajhvbhetncz rjytxysq
rjl cnhfybw, cnfnbxysq kb 'nj html bkb lbyfvbxtcrb cutythbhjdfyysq.
Ålbycndtyysv ghbpyfrjv dscnegftn url cnhfybws. Äbyfvbxtcrbvb cnhfybwfvb
cxbnf.ncz tckb d b[ flhtct ghbcencndetn pyfr djghjcf bkb jyb bvt.n
hfcibhtybt, jnkbxyjt jn *.htm bkb *.html, yfghbvth *.php, *.jsp, *.pl b
lheubt. ×tv gkj[b nfrbt flhtcf? Ätkj d njv, xnj ytrjnjhst gjbcrjds[
cbcntvs vjuen yfrkflsdfnm juhfybxtybz yf byltrcfwb. gjlj,ys[ cnhfybw bkb
yf extn ccskjr c nfrb[ cnhfybw.
Èynthtcty vt[fybpv byltrcfwbb lbyfvbxtcrb[ cnhfybw Àgjhnjv. Ó ytuj
lkz rf;ljuj cfqnf ceotcndetn rdjnf, yf rjkbxtcndj byltrcbhetvs[ cnhfybw
(k.,juj nbgf), yfghzve. pfdbczofz jn byltrcf wbnbhetvjcnb cfqnf. Ò.t.
rjkbxtcndj byltrcbhetvs[ cnhfybw lkz cfqnjd c ybprbv ÈÖ vtymit, xtv lkz
,jktt "fdnjhbntnys[". È njkmrj d ckexft, tckb rdjnf gjpdjkztn
ghjbyltrcbhjdfnm dct cnhfybws c cfqnf cj cnfnbxtcrbvb flhtcfvb b ti¸ yt
gjkyjcnm. bphfc[jljdfyf, Àgjhnjv yfxbyf.n byltrcbhjdfnmcz cnhfybws c
lbyfvbxtcrbvb flhtcfvb.
Çfvtye lbyfvbxtcrb[ flhtcjd yf cnfnbxtcrbt vj;yj jceotcndbnm c
gjvjom. cgtwbfkmyjuj cgtwbfkmyjuj vjlekz mod_rewrite lkz Apache
(gjlhj,ytt j, 'njv vjlekt vj;yj gjcvjnhtnm pltcm: http://httpd.apache.org/docs/mod/mod_rewrite.html).
2. Çfcjhtybt byltrcjd gjbcrjds[ vfiby le,kbrfnfvb cnhfybw.
Èltynbabrfnjhs ctccbq d flhtcf[ cnhfybw.
Èltynbabrfnjhs ctccbq bcgjkmpe.ncz lkz ghbcdjtybz gjkmpjdfntk.
eybrfkmyjuj j,jpyfxtybz b utythbhe.ncz fdnjvfnbxtcrb ghb jnrhsnbb rf;ljq
yjdjq ctccbb. È rf;lsq hfp, ghb ghj[jlt gj ccskrfv cfqnf hj,jn gjkexftn
yjdsq flhtc lkz jlyjq b njq ;t cnhfybws. Â nj ;t dhtvz, ghjdthzz e;t
[hfyzobtcz d ,fpt gjbcrjdjq cbcntvs ccskrb, hj,jn j,yfhe;bdftn, xnj jyb
gj-ght;ytve ceotcnde.n, jlyfrj bp-pf njuj, xnj ccskjr c lheub[ cnhfybw
yf 'ne ,jkmit ytn, dtc e yt¸ rhfqyt vfk. Ïjcntgtyyj d ,fpt gjbcrjdjq
cbcntvs gjzdkztncz ,jkmijt rjkbxtcndj le,kbrfnjd jlyjq b njq ;t
cnhfybws, xnj vj;tn ghbdtcnb r cfyrwbzv cj cnjhjys gjbcrjdjq cbcntvs.
Ñfqn vj;tn gjldthuyenmcz ",tp;fkjcnyjq xbcnrt", n.t. elfktyb. bp byltrcf
,jkmitq xfcnb cnhfybw.
È 'nj yt tlbycndtyyfz ghj,ktvf, dspsdftvfz bltynbabrfnjhfvb ctccbq.
Ðj,jns ytrjnjhs[ gjbcrjds[ cbcntv bvt.n juhfybxtybz yf rjkbxtcndj
byltrcbhetvs[ pf jlby cdjq dbpbn cnhfybw. È yfkbxbt vyj;tcndf jlbyfrjds[
cnhfybw c hfpysvb flhtcfvb, tcntcndtyyj, pfvtlkztn byltrcfwb. cfqnf.
Óxbnsdfz dsitcrfpfyyjt, ytj,[jlbvj bp,fdkznmcz jn bltynbabrfnjhjd
ctccbq d flhtcf[ cnhfybw, ntv ,jktt xnj d ,jkmibycndt ckexftd, rfr
gjrfpsdftn ghfrnbrf, d b[ ghbvtytybb ytn ytj,[jlbvjcnb. Åckb ;t 'nj
ytdjpvj;yj, nj nfrbt cnhfybws ytj,[jlbvj pfghtnbnm r byltrcfwbb, f d
ckexft j,hfotybz r ljrevtynfv hj,jnjd gjbcrjds[ vfiby (b[ vj;yj,
yfghbvth, bltynbabwbhjdfnm gj pyfxtyb. gjkz User-Agent) yt utythbhjdfnm
bltynbabrfnjhs ctccbb.
Ítrjhhtrnyst jnrkbrb cthdthf.
Åo¸ jlyjq ghbxbyjq pfvecjhbdfybz ,fps gjbcrjdbrjd b ghbvtytybz
gjcktle.ob[ cfyrwbq vj;tn cnfnm ytghfdbkmyfz yfcnhjqrf jnrkbrjd cthdthf,
f njxytt ytdthysq pfujkjdjr cnhfybws, djpdhfoftvsq cthdthjv.
Äjrevtyns yjhvfkmyj byltrcbhe.ncz gjbcrjdsvb cbcntvfvb, njkmrj tckb
cthdth djpdhfoftn d pfujkjdrt rjl 200 (ÎÊ). Ïhb djpdhfnt cthdthjv rjljd
301 (gthtvtotyj), 302 (dhtvtyyj gthtvtotyj) b 404 (yt yfqltyj) cnhfybws
hj,jnjv yt byltrcbhe.ncz b elfkz.ncz bp byltrcf, tckb jyb d y¸v
yf[jlbkbcm. Òbgbxyjq jib,rjq zdkztncz dslfxf cthdthjv rjlf 200 (ÎÊ) lkz
ytceotcnde.ob[ cnhfybw. Ífghbvth, ghb pfghjct gj ytdthyjve flhtce,
dslf¸ncz cnhfybwf c ntrcnjv j, jib,rt, f HTTP-rjl ghb 'njv 200. Â bnjut
'nf cnhfybwf vyjujrhfnyj byltrcbhetncz gjl hfpysvb flhtcfvb b ghb
yfrjgktybb ,jkmijuj rjkbxtcndf gjlj,ys[ cnhfybw d byltrct cfqn
gjldthuftncz xbcnrt (d ckexft ßyltrcf), ghb rjnjhjq jy vj;tn ,snm elfk¸y
bp ,fps ghfrnbxtcrb wtkbrjv. Ðfv,kth vj;tn "gtccbvbpbhjdfnm" cfqn, n.t.
gjybpbnm tuj d htpekmnfnf[ gjbcrf, yfxbckbd tve inhfayst ,fkks.
Ïjcvjnhtnm, rfrbt jnrkbrb dslftn cthdth lkz rjyrhtnyjq cnhfybws
vj;yj, r ghbvthe, c gjvjom. cgtwbfkmys[ jykfqyjds[ cthdbcjd. Âjn flhtc
jlyjuj bp yb[: http://www.searchengineworld.com/cgi-bin/servercheck.cgi.
3. Óghfdktybt gjkyjnjq gthtbyltrcfwbb cfqnf.
Çfxfcne. hfphf,jnxbrb cfqnf yt pflevsdf.ncz j njv, rfr j,tcgtxbnm
yfb,jktt ,scnhe. b gjkye. byltrcfwb. b gthtbyltrcfwb. cnhfybw cfqnf. È
tckb lkz chfdybntkmyj yt,jkmib[ cfqnjd hfpvthjv d ytcrjkmrj ltcznrjd
cnhfybw, 'nj, vj;tn ,snm, b yt jxtym frnefkmyj, nj ghtyt,ht;bntkmyjt
jnyjitybt r gjlj,yjuj hjlf dtofv d ckexft cfqnjd, cjlth;fob[ ,jkmijt
rjkbxtcndj ljrevtynjd, bpvthztvjt cjnyzvb b nsczxfvb, vj;tn ghbdtcnb r
njve, xnj hj,jns gjbcrjds[ vfiby ,elen gjcnjzyyj gthtbyltrcbhjdfnm jlyb b
nt ;t yt bpvtyz.obtcz vfkjbyajhvfnbdyst ljrevtyns, j,[jlz cnjhjyjq
jcyjdyjq rjyntyn cfqnf. Ñeotcndetn hzl nt[ybxtcrb[ ghbtvjd, gjpdjkz.ob[
lj,bnmcz ,jktt ,scnhjq b gjkyjq byltrcfwbb b gthtbyltrcfwbb cnhfybw
cfqnf.
Ðfp,btybt cfqnf yf gjlljvtys.
Ðj,jns gjbcrjds[ vfiby vjuen bvtnm juhfybxtybz yf rjkbxtcndj
byltrcbhetvs[ pf jlby dbpbn ljrevtynjd c jlyjuj cfqnf. Îcj,tyyj
pfvtlkz.n byltrcfwb. ,scnhjhfcneobq rjyntyn, nfrjq, yfghbvth, rfr
gjctoftvsq ajhev bkb ljcrf j,]zdktybq. Ïj'njve vj;yj gjhtrjvtyljdfnm
nfrbt hfpltks dsyjcbnm d gjlljvtys - lkz yb[ e gjbcrjds[ vfiby e;t ,elen
cdjb rdjns b jyb yt ,elen pfvtlkznm byltrcfwb. jcyjdys[ hfpltkjd cfqnf.
Ífcnhjqrf pfujkjdrf jnrkbrf cthdthf yf GET b HEAD c gjktv If-Modified-Since
Ðj,jns gjbcrjds[ vfiby ghb gthtbyltrcfwbb pfghfibdf.n ljrevtyns c
gjktv If-Modified-Since d rjnjhjv cnfdbncz lfnf gjcktlytq
gthtbyltrcfwbb. Äkz cnfnbxtcrb[ ljrevtynjd cthdth cfvjcnjzntkmyj
ajhvbhetn rjhhtrnysq jnrkbr yf nfrjq pfghjc - 200 ÎÊ, tckb ljrevtyn
bpvtyzkcz gjckt lfns, erfpfyyjq d pfghjct kb,j 304 Not Modified, tckb yt
bpvtyzkcz. Âj dnjhjv ckexft hj,jn yt ,eltn crfxbdfnm ljrevtyn b
j,yjdkznm tuj d cdjtq ,fpt.
Îlyfrj lkz lbyfvbxtcrb[ ljrevtynjd, cj,bhftvs[ "yf ktne", cthdth d
cjcnjzybb dslfnm njkmrj 200 ÎÊ. Ïj'njve k.,jq lbyfvbxtcrbq ljrevtyn
,eltn crfxfy b gthtbyltrcbhjdfy, drk.xfz nt, cjlth;bvjt rjnjhs[ htfkmyj
yt vtyzkjcm cj dhtvtyb gjcktlytq gthtbyltrcfwbb. Ïjhjq gjlj,yst
ljrevtyns vjuen ds,hfnm dc. rdjne, dsltktyye. yf byltrcfwb.. Òj tcnm
gjbcrjdfz vfibyf yt gjkexbn ybrfrjq yjdjq byajhvfwbb j cfqnt. Ïj'njve
;tkfntkmyj d pfujkjdrt jnrkbrf yf pfghjcs GET b HEAD c gjktv
If-Modified-Since lkz ljrevtynjd, j lfnt gjcktlytq vjlbabrfwbb rjnjhs[
tcnm byajhvfwbz, ghbyelbntkmyj dslfdfnm jnrkbr 304 Not Modified, tckb
lfnf gjcktlytq vjlbabrfwbb hfymit, xtv lfnf, cnjzofz d pfghjct. Òtv
cfvsv hj,jn gjkexbn byajhvfwb. j njv, xnj ljrevtyn yt bpvtybkcz, b, yt
crfxbdfz tuj, j,hfnbncz r cktle.otve ljrevtyne d jxthtlb. Åckb e hj,jnf
tcnm kbvbn yf rjkbxtcndj crfxbdftvs[ pf jlby pf[jl ljrevtynjd, nj, nfrbv
j,hfpjv, jy pf jlby pf[jl crfxftn ,jkmitt xbckj ljrevtynjd, htfkmyj
bpvtybdib[cz bkb tot yt ghjbyltrcbhjdfyys[.
Çfghtotybt r byltrcfwbb ytbyajhvfnbdys[ bkb le,kbhe.ob[ cnhfybw cfqnf.
Íf cfqnt vj;tn yf[jlbnmcz ytrjnjhjt rjkbxtcndj cnhfybw, rjyntyn
rjnjhs[ cjdthityyj ytbyajhvfnbdty (yfghbvth cnhfybws ajnjufkthtb,
cjlth;fobt njkmrj bpj,hf;tybz) bkb le,kbhetn cjlth;bvjt lheub[ cnhfybw
(yfghbvth, hfpkbxyst ht;bvs cjhnbhjdrb byajhvfwbb d nf,kbwf[). Ïjlj,yst
cnhfybws wtktcjj,hfpyj pfghtofnm r byltrcfwbb d wtkz[ ,jktt ,scnhjq b
gjkyjq gthtbyltrcfwbb lheub[ cnhfybw cfqnf.
Çfghtnbnm cnhfybwe r byltrcfwbb gjbcrjdjq cbcntvjq vj;yj ldevz
cgjcj,fvb: c gjvjom. vtnf-n'ujd bkb afqkf robots.txt Äkz pfghtnf
bcgjkmpetncz vtnf-n'u "robots":
< META NAME="ROBOTS" CONTENT="pyfxtybt" >
 fnhb,ent content vj;yj ghbvtyznm cktle.obt lbhtrnbds:
NOINDEX - pfghtoftn byltrcfwb. ljrevtynf, yj hfphtiftn gtht[jlbnm gj ccskrfv c ytuj:
< META NAME="ROBOTS" CONTENT="NOINDEX" >
NOFOLLOW - pfghtoftn gtht[jlbnm gj ccskrfv, yj yt pfghtoftn byltrcbhjdfnm ljrevtyn:
< META NAME="ROBOTS" CONTENT="NOFOLLOW" >
Èkb b[ rjv,byfwb.: NOINDEX, NOFOLLOW - pfghtoftn byltrcbhjdfnm ljrevtyn b gtht[jlbnm c ytuj gj ccskrfv:
< META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW" >
Åckb nht,etncz pfghtnbnm r byltrcfwbb hfpltk bkb uhegge afqkjd c
jlyjnbgysvb bvtyfvb, nj ,jktt elj,ysv cgjcj,jv ,eltn pfghtn c gjvjom.
robots.txt . Ýnj ntrcnjdsq afqk, rjnjhsq ljk;ty hfcgjkfufnmcz d rjhytdjq
lbhtrnjhbb cthdthf, n.t. ,snm ljcnegty gj flhtce
http://bvz_cfqnf.ru/robots.txt
Ôfqk ljk;ty cjlth;fnm jlye bkb ytcrjkmrj pfgbctq, hfpltktyys[ jlyjq
bkb ytcrjkmrbvb gecnsvb cnhjrfvb. Êf;lfz pfgbcm cjcnjbn bp cnhjr dblf:
bvz_gjkz:[ghj,tks]pyfxtybt[ghj,tks]
Ïhj,tks zdkz.ncz yt j,zpfntkmysvb. Ðtubcnh pyfxtybz gjkz yt
exbnsdftncz. Ìjuen bcgjkmpjdfnmcz rjvvtynfhbb - cbvdjk # jpyfxftn yfxfkj
rjvvtynfhbz, rjytw cnhjrb - rjytw rjvvtynfhbz.
Çfgbcm ljk;yf yfxbyfnmcz c jlyjq bkb ytcrjkmrb[ cnhjr User-Agent,
cktljv ljk;yf ,snm jlyf bkb ytcrjkmrj cnhjr Disallow. Íthfcgjpyfyyst
cnhjrb buyjhbhe.ncz.
 cnhjrt User-Agent erfpsdftncz bvz hj,jnf gjbcrjdjq cbcntvs, lkz
rjnjhjq pfghtof.ncz r byltrcfwbb cnhfybws. Ó ßyltrcf 'nj yandex,
Ðfv,kthf - StackRambler, Àgjhnf - aport b e Google - googlebot. Åckb
hj,jnjd, lkz, rjnjhs[ nht,etncz yfkj;bnm jlbyfrjdsq pfghtn ytcrjkmrj, nj
yflj gjvtcnbnm d pfgbcb ytcrjkmrj cnhjr User-Agent jlye pf lheujq, d
rf;ljq erfpfd bvz cjjndtncde.otuj hj,jnf. Åckb cnhfybws ytj,[jlbvj
pfghtnbnm jn byltrcbhjdfybz dctvb hj,jnfvb, nj ytj,[jlbvj bcgjkmpjdfnm
cbvdjk *. Òfrfz pfgbcm, c gjktv "User-agent: *" vj;tn ,snm d afqkt
robots.txt njkmrj jlyf.
 rf;ljq pfgbcb, nfr;t, ljk;yj ,snm [jnz ,s jlyj gjkt Disallow.  y¸v
erfpsdftncz erfpsdftncz xfcnbxysq bkb gjkysq genm (URL), pfghtoftvs[
cnhfybw. Â cnhjrf[ c gjktv Disallow pfgbcsdf.ncz yt f,cjk.nyst, f
jnyjcbntkmyst ghtabrcs, n.t. d 'njv gjkt yt ljk;yj erfpsdfnmcz ljvtyyjt
bvz cfqnf - www.cfqn.ru Åckb pyfxtybt Disallow yt erfpfyj, nj 'nj
jpyfxftn, xnj vj;tn byltrcbhjdfnmcz dc¸.
Ífghbvth:
User-Agent: * Disallow: /sript/
Ýnf pfgbcm pfghtoftn dctv hj,jnfv byltrcbhjdfnm afqks, ccskrb yf
rjnjhst cjlth;fn genm r lbhtrnjhbb /sript/. Äkz gjkyjuj pfghtnf
byltrcfwbb bcgjkmpetncz cbvdjk /. Çfghtnbv ßyltrce byltrcbhjdfnm cfqn:
User-agent: yandex Disallow: /
×nj,s pfghtnbnm hj,jne gjctotybt lbyfvbxtcrb[ cnhfybw, vj;yj
bcgjkmpjdfnm xfcnbxysq genm. Âjpdhfofzcm r bltynbabrfnjhfv ctccbq, lkz
pfghtnf cnhfybw cjlth;fob[ b[ d flhtct vj;yj bcgjkmpjdfnm gjlj,ye.
rjycnherwb.:
User-agent: * Disallow: /page3.php;phpessionid
Ñnhfybwf page3.php ,eltn yjhvfkmyj ghjbyltrcbhjdfyf, f dct t¸ rjgbb,
yfxbyf.obtcz yf page3.php;phpessionid ,elen pfghtotys r byltrcfwbb.
Ífkbxbt robots.txt yf cthdtht yt zdkztncz j,zpfntkmysv, tuj
jncencndbt, rfr b gecnjq afqk robots.txt, bkb ytghfdbkmyj cjcnfdktyysq,
,eltn bynthghtnbhjdfnmcz hj,jnjv rfr hfphtitybt yf gjkye. byltrcfwb.
cfqnf.
Ïjkyfz ljrevtynfwbz gj ghjnjrjke afqkf robots.txt yf[jlbncz pltcm: http://www.robotstxt.org/wc/robots.html.
 pfrk.xtybb [jxe jnvtnbnm, xnj uhfvjnyjt htitybt dct[
hfccvjnhtyys[ ghj,ktv zdkztncz bcrk.xbntkmyj df;yjq b ytjn]tvktvjq
xfcnm. hf,jns gj ghjldb;tyb. cfqnf d gjbcrjds[ vfibyf[, nfr rfr
ghtyt,ht;bntkmyjt jnyjitybt r 'nbv djghjcfv cgjcj,yj pyfxbntkmyj
evtymibnm bkb lf;t cdtcnb yf ytn 'aatrn jn vthjghbznbq gj
gjpbwbjybhjdfyb. cfqnf.
|