Search engine optimization (SEO, 검색 엔진 최적화) is the process of increasing the quality and quantity of website traffic by increasing the visibility of a website or a web page to users of a web search engine. (https://en.wikipedia.org/wiki/Search_engine_optimization)

robots.txt #

Google 봇은 모두 허용하고, 나머지 봇의 경우, /private, /comment 경로를 제외하고 싶을 때,

User-agent: Mediapartners-Google*
Disallow:

User-agent: *
Disallow: /private
Disallow: /comment

sitemap.xml #

샘플 (참고: https://prolite.tistory.com/1468 )

#!xml
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
   <url>
      <loc>http://www.example.com/</loc>
      <lastmod>2005-01-01</lastmod>
      <changefreq>monthly</changefreq>
      <priority>0.8</priority>
   </url>
   <url>
      <loc>http://www.example.com/catalog?item=12&desc=vacation_hawaii</loc>
      <changefreq>weekly</changefreq>
   </url>
   <url>
      <loc>http://www.example.com/catalog?item=73&desc=vacation_new_zealand</loc>
      <lastmod>2004-12-23</lastmod>
      <changefreq>weekly</changefreq>
   </url>
   <url>
      <loc>http://www.example.com/catalog?item=74&desc=vacation_newfoundland</loc>
      <lastmod>2004-12-23T18:00:15+00:00</lastmod>
      <priority>0.3</priority>
   </url>
   <url>
      <loc>http://www.example.com/catalog?item=83&desc=vacation_usa</loc>
      <lastmod>2004-11-23</lastmod>
   </url>
</urlset>

Suggested Pages #

• 0.025 Mountain View
• 0.025 Sergey Brin
• 0.025 September 4
• 0.025 Larry Page
• 0.025 1998
• 0.013 Hyungyong Kim
• 0.006 July 10
• 0.006 Tennis
• 0.006 Computer vision
• 0.006 Inline skate
• More suggestions...