User-agent: * Disallow: /cgi-bin/ Disallow: /*.db Disallow: /*.idx Disallow: /l*.txt Disallow: /*.flv Disallow: /*.swf