Your name or email adress:
Do you already have an account?
Forgot your password?
  • Log in or Sign up

    Promotional Offer: 15% OFF For LifeTime VIP Membership Now Only $19.55 USD One Time Fees. ((( Important ))): Dead Link Support Available Only For VIP Members. Our Contact Email: [email protected]
    Register

    If you already have an account with us, please use the login panel below to access your account.

    Username >>
    Password >>
    offer

    banner
    Untitled Document


    guide

    GET LIVE LATEST POST NOFITICATION !! JOIN OUR TELEGRAM, DISCORD & WHATSAPP GROUP BELOW >

    edollarearn edollarearn edollarearn


    Results 1 to 4 of 4
    1. #1
      Member
      Join Date
      Jul 2015
      Location
      india
      Age
      39
      Posts
      32
      Time Online
      1 Hour 17 Minutes 15 Seconds

      Default What is the use of robert.txt file ?

      Hello friends,


      I would like to know that What is the use of robert.txt file ? tell me guys..

  • #2
    Member
    Join Date
    Jul 2016
    Location
    Madrid
    Age
    39
    Posts
    6
    Time Online
    N/A

    Default Re: What is the use of robert.txt file ?

    Robots.TXT helps in preventing the CRAWLERS to crawl the private and confidential information like Email address, contact number, credit card details.

  • #3
    Member
    Join Date
    Jul 2016
    Location
    Australia
    Age
    30
    Posts
    16
    Time Online
    N/A

    Default Re: What is the use of robert.txt file ?

    Use:
    Block one folder
    Block one file
    Allow full access
    Block all access

  • #4
    Member
    Join Date
    Nov 2014
    Location
    Bangalore
    Age
    44
    Posts
    5
    Time Online
    N/A

    Default Re: What is the use of robert.txt file ?

    Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

  •  

     

    Similar Threads

    1. [GET] Robert Kiyosaki Rich Dad Poor Dad CD | 181 MB
      By selfeducation987 in forum Free Exclusive WSO Area
      Replies: 1
      Last Post: 06-19-2021, 08:03 PM
    2. Why is robert.txt file is important to Website ?
      By soniyamishra in forum Social Networks Market
      Replies: 0
      Last Post: 04-12-2016, 12:53 PM
    3. Replies: 1
      Last Post: 09-20-2015, 08:05 AM
    4. [GET] Freeman Lectures Robert Menard
      By BlackHatX in forum Free Exclusive WSO Area
      Replies: 0
      Last Post: 04-30-2014, 02:15 AM

    Bookmarks

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •  
    mobile-banner-5
    BACK TO TOP