what is robots.txt

General

what is robots.txt?

Answer:

this is simple robots.txt file that allow and block agents

for example.

User-agent: *
User-Agent: Googlebot

with the help of this file you can allow, block or deny agents and page URL as well as.

what is robots.txt?

Answer:

this is simple robots.txt file that allow and block agents

for example.

User-agent: *
User-Agent: Googlebot

with the help of this file you can allow, block or deny agents and page URL as well as.

By asifjans 22-Jun-2018 Views 668

Upcoming Articles

You may also read following recent Post

WebDev Tips & Tricks - YouTube Channel
5 By Junaid A

The Top 15 Highest Paid Programming Languages in 2023
57 By Junaid A

why i choose HostGator as hosting provider
25 By Junaid A

What are the latest trends in international business within your industry
15 By Junaid A

What is OCR in Development
35 By Junaid A

How to fix MongoDb connection issue with nestjs
67 By Tahir

What is Kinemaster pro mod?
61 By Shahzad Anjum

which tool and technology are best to develop, cross platform mobile app development
45 By Junaid A

8 Best FREE Cloud Storage
43 By Shahzad Anjum

How to quickly resolve scratch disk full error in Photoshop?
49 By Shahzad Anjum

how to take business email backup from ms outlook
31 By Junaid A

65% OFF WEB HOSTING
43 By Shahzad Anjum

Standard Web Hosting
49 By Shahzad Anjum

65% off Standard Web Hosting
55 By Shahzad Anjum

PM laptop scheme 2023
47 By Shahzad Anjum

What is shortcut key of "view in browser" in visual studio 2022
48 By Junaid A

Some of the important topics to learn C# quckilly.
48 By Ahsan

what is poco in web development?
62 By Junaid A

cPanel Hosting with 24/7 Support
74 By Shahzad Anjum

Why use dedicated server hosting?
92 By Shahzad Anjum

Dedicated Server Hosting is really turning point
50 By Junaid A

why website support contract is important
69 By Junaid A

30-day SEO plan to help you get started with optimizing your website
52 By Junaid A

why i choose HostGator as hosting provider
86 By Junaid A

any google chrome extension to manage to do list suggested by google
83 By Junaid A

how i can make my laptop as server for deployment of the website
62 By Junaid A

which one is good font family that is recommended by google for website
80 By Junaid A

suggest me hosting company that is offering dedicated server in affordable price
88 By Junaid A

Manchester City F.C. - Football club
56 By Faisal

create custom error page for exception handling in asp.net mvc
64 By Junaid A

find folder path in sub domain
74 By Junaid A

facts about Hazrat Fatima (RA)
85 By Junaid A

Amazing Mobile apps by Google LLC
74 By Junaid A

5-second search to find 100s of opportunities.
69 By Junaid A

How to calculate percentage using function in ms sql server
60 By Junaid A

free screen recording software
108 By Junaid A

how we can make strong ourselves
105 By Junaid A

do right things on right time | what are the right things
88 By Junaid A

$1,000 cpc keywords
81 By Junaid A

High CPC keywords for blog
98 By Junaid A

How to grow 1% every day
125 By Junaid A

who is good web developer
114 By Junaid A

Skills that pay you forever
67 By Junaid A

5 websites to help you find content ideas
70 By Junaid A

The setup for the installation of visual studio is not complete. Please run the Visual Studio installer again to correct the issue.
106 By Junaid A

Generic error occurred in GDI
90 By Shoaib Khan

Live cricket match PAK vs ENG Final T20 World Cup 2022
157 By Junaid A

How to check data is inserted deleted or updated in ms sql database
105 By Junaid A

𝐔𝐩𝐰𝐨𝐫𝐤 𝐔𝐧𝐯𝐞𝐢𝐥𝐬 𝐓𝐨𝐩 𝟏𝟎 𝐌𝐨𝐬𝐭 𝐈𝐧-𝐃𝐞𝐦𝐚𝐧𝐝 𝐒𝐤𝐢𝐥𝐥𝐬
123 By Shoaib Khan

3 Reasons You Need A Graphic Designer
114 By Shoaib Khan

08 Colour Tools for designer
81 By Shoaib Khan

Ptv sports live cricket match today
224 By Junaid A

cheap domain registration today
114 By Junaid A

How to boot HP laptop from USB Drive?
119 By Junaid A

𝐟𝐫𝐞𝐞 𝐰𝐞𝐛𝐬𝐢𝐭𝐞𝐬 𝐟𝐨𝐫 𝐈𝐥𝐥𝐮𝐬𝐭𝐫𝐚𝐭𝐢𝐨𝐧
98 By Junaid A

What are ASP.NET security controls?
245 By Shoaib Khan

Best Website Hosting Provider For Small Business
97 By Junaid A

How to redirect user from one website to another using java script
438 By Junaid A

Find column name in ms sql server database
141 By Junaid A

How to check Database size using sql script
209 By Junaid A

Getting error "Microsoft.ACE.OLEDB.12.0 provider is not registered on the local machine"
234 By Junaid A

Microsoft defender SmartScreen prevented an unrecognized app from starting error
194 By Junaid A

Key points for ms sql server as professional DB Developer
220 By Junaid A

content negotiation in api
147 By Junaid A

How I can learn Article Writing
134 By aj

how we can make Design responsive
115 By Ihsan Ullah

CRUD in Asp.net MVC
130 By Ihsan Ullah

What is life?
92 By Junaid A

How we can set value of View beg in asp.net mvc?
141 By Ahsan

How to set and get value from TempData in asp.net mvc?
131 By Ahsan

How to set and get value from TempData in asp.net mvc?
165 By Ahsan

How to set and get value in localstorage using JavaScript?
153 By Ahsan

How to get and set session in Asp.net mvc?
132 By Ahsan

WEBSITE TESTING CHECK LIST
158 By Junaid A

What is life?
135 By Shoaib Khan

paragraph
138 By Ihsan Ullah

life
108 By khubaib Ahmad

country state and city database in ms sql server 2019
201 By Nasir Kiyani

LinkedIn Freelancing services
397 By Junaid A

How to run sql script file from Command prompt
1399 By Junaid A

website support contracts key points
1342 By Junaid A

find error login in windows server
1450 By Junaid A

In Vitro Fertilization Centres in India | Aarogya Hospital | Elawoman
1416 By

How to track users connected to ptcl wifi
1562 By Junaid A

How to change passsword of Qubee Device
542 By Junaid A

how to add shop in facebook
641 By Junaid A

WEBSITE TESTING CHECK LIST
732 By Junaid A

How to check .pk domain expiry
693 By Junaid A

How to start PMP
679 By Junaid A

How to check website rendering in different locations
667 By Junaid A

what is Digital Marketing
790 By Junaid A

How To Find The Gmail / Google Account Creation Date
673 By Junaid A

How to find address by Postal Code
201 By

Configure compnay email on gmail
691 By Junaid A

what are DBA job title designation
193 By

what is robots.txt
668 By Junaid A

How to enable gzip compression in asp.net mvc
199 By

.NET Framework Types and Their Equivalents SQL Server Data
173 By

find unused CSS in web site with Chrome DevTools
707 By Junaid A

What is CURL?
720 By Junaid A

618 By shaheer

635 By shaheer

183 By

181 By

How Improve Execution time of Queries
646 By Rizwan Saqib

What is Classified in Terms of SEO?
753 By Tayyab Mukhtar

What is a Full-Stack Developer?
686 By Junaid A

Difference Between Temp Table and Table Variable
709 By Rizwan Saqib

version control systems mostly used in development
576 By Junaid A

methodologies mostly used
81 By

Libraries, frameworks, and tools those are used for development work
680 By Junaid A

What are types the database those are used in development
630 By Junaid A

what are the functions in .net
101 By

MVC LEARNIG
262 By

what is storage.ide in visual sutdio 2017
277 By

The data connection could not be established: ETIMEDOUT - Connection attempt timed out Error: Connec
267 By

how perform processing on string
270 By

how to get UserIPAddress in asp.net mvc
279 By

Set GMT instead of DateTime.Now in asp.net MVC?
256 By

How to Reseed Table in SQL Server?
252 By

Show only two digit after decimal point. How to convert double to 2 number after the dot.
206 By

custom message for ValidationMessage
257 By

ValidationMessage overlapping the message
275 By

Kendo Date Picker format using Culture in asp.net mvc
302 By

Steps to add Export to excel option in kendo grid mvc
262 By

How to Implement Date Range Picker in asp.net mvc
270 By

Kendo UI Validator overlapping issue
271 By

show hide kendo ComboBox
280 By

How to Integrate kendo ComboBox in asp.net mvc
267 By

Active A Class In Layout
294 By

IN this we will tell you about the basic things related to API's While Contructing them.
254 By

Issues opening Excel documents - File format and extension of 'orders.xls' don't match. The file cou
245 By

TF400889: The following path contains more than the allowed 259 characters:
316 By

kendoValidator check which input in not valid
242 By

The Microsoft.ACE.OLEDB.12.0 provider is not registered on the local machine Solved
255 By

How to convert json string to object in C#?
268 By

how to add metags in asp.net mvc
308 By

'System.Web.HttpException' occurred in System.Web.dll but was not handled in user code
295 By

Version Compatibility in the .NET Framework
270 By

Multiple errors occurred during the operation, the first of which is displayed below. A full error l
246 By

kendoGrid first row set selected
246 By

Unhandled Exception in ASP.NET 4.0.30319.0
267 By

How to right align text in mvc kendo grid
915 By

How to post uploaded file and form data in MVC using jquery?
249 By

asp.net mvc routing tricks
258 By

Download Microsoft Edge Browser for windows 7
281 By

Remove Cache in ASP .NET MVC (4,5,6)
269 By

How to restore or back up a database in SQL server 2012.
276 By

What is routes in AngularJS?
288 By

Attackers might be trying to steal your information from (for example, passwords, messages, or cred
256 By

filter by multiple values list in asp.net mvc
256 By

Remove Cache in ASP .NET MVC (4,5,6)
284 By

Recovering a database that is in the restoring state
259 By

Invalid Cast Exception was unhandled by user code in Caching.
253 By

dropdown select value not going to FormCollection in mvc
2976 By

LINQ to Entities does not recognize the method 'System.String ToShortDateString()' method, and this
295 By

how to replace one div html to another div html dynamically using jquery in mvc
624 By

unable to load the specified metadata resource. entity framework
247 By

how to check the file size using jquery and reset if size exceeded
443 By

how to call a function in c#
312 By

what are the functions in .net
404 By

Get week start and week end range between two date
380 By

How to collapse/expand panel and preserve its states during sessions
2829 By

How to improve performance in asp.net mvc application
362 By

DataSourceRequest request error on kendo grid apply filtering
2738 By

Submit Post - Article - Ask a Question - Ask an Interview Question - Submit Useful Links

what is robots.txt

Share This with your friend by choosing any social account

You may also read following recent Post