# This file will tell all robots to avoid URLs User-agent: * Disallow: /data Disallow: /bin Disallow: /images Disallow: /gimages Disallow: /misc Disallow: /Subpages Disallow: /mob/bin Disallow: /mob/stock