# For domain: jdbizz.com # EXAMPLES!!! # User-agent:* (* =ALL Spiders not allowed, Altavista =Altaviata Spiders not allowed, but everyone elses spiders are welcome!) # Disallow:/cgi-bin/ # Disallow:/privatefolder/ # Disallow:/downloads/ # Disallow:/important/members.html # User-agent:* # Disallow:/ # This command allows the WHOLE SITE to NOT be indexed by spiders! User-agent:* Disallow:/_css Disallow:/_errors/ Disallow:/_include/ Disallow:/_java/ Disallow:/_templates/ Disallow:/cgi-bin/ Disallow:/graphics/ Disallow:/company_documents/ Disallow:/contact_email_form_jobs_request/ Disallow:/php-bin/ Disallow:/phpsitemap/