Sitemap: https://www.luxhabitat.ae/sitemaps/index.xml User-agent: * Disallow: /one-tap-login/ Disallow: /admin/ Disallow: /sign-in/ Disallow: /favorites/ Disallow: /searches/ Disallow: /subscriptions/ Disallow: /sort-order/ Disallow: /search/ Disallow: /json-locations/ Disallow: /register-pageview/ # -------------------------------------------- # Slow down too intensive bots # -------------------------------------------- User-agent: PetalBot Crawl-delay: 10 # -------------------------------------------- # Comprehensive Bad-Crawler Blacklist # -------------------------------------------- User-agent: 008 Disallow: / User-agent: 360Spider Disallow: / User-agent: aiHitBot Disallow: / User-agent: AwarioSmartBot Disallow: / User-agent: BackDoorBot/1.0 Disallow: / User-agent: BDCbot Disallow: / User-agent: BLEXBot Disallow: / User-agent: Blekkobot Disallow: / User-agent: Brainobot Disallow: / User-agent: BTExplorer Disallow: / User-agent: Butterfly Robot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: CensysInspect Disallow: / User-agent: CherryPicker Disallow: / User-agent: ChinaClaw Disallow: / User-agent: Cincraw Disallow: / User-agent: Cocolyzebot Disallow: / User-agent: Collector Disallow: / User-agent: Crawler Disallow: / User-agent: CriteoBot Disallow: / User-agent: Curl Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Daum Disallow: / User-agent: DataXu Disallow: / User-agent: Diffbot Disallow: / User-agent: Disco Disallow: / User-agent: DotBot Disallow: / User-agent: Dragonfly Disallow: / User-agent: Drip Disallow: / User-agent: eCatch Disallow: / User-agent: EasyDL Disallow: / User-agent: EirGrabber Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Exabot Disallow: / User-agent: ExactSeek Crawler Disallow: / User-agent: EroCrawler Disallow: / User-agent: Eyespyder Disallow: / User-agent: Fast Disallow: / User-agent: Fetch Disallow: / User-agent: Flipboard Disallow: / User-agent: FreeWebMonitoring Disallow: / User-agent: Gecko/Sign Disallow: / User-agent: Gigabot Disallow: / User-agent: Gobuster Disallow: / User-agent: Grub-client Disallow: / User-agent: HTTrack Disallow: / User-agent: HubSpot Disallow: / User-agent: ia_archiver Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: ichiro Disallow: / User-agent: Incapsula Disallow: / User-agent: inoreader Disallow: / User-agent: Kamaelia Disallow: / User-agent: Kenjin Spider Disallow: / User-agent: Keyword Density Disallow: / User-agent: Larbin Disallow: / User-agent: libwww Disallow: / User-agent: LinkextractorPro Disallow: / User-agent: LinkpadBot Disallow: / User-agent: LinkReaper Disallow: / User-agent: LinkScan Disallow: / User-agent: LinkWalker Disallow: / User-agent: LNSpiderguy Disallow: / User-agent: LoomBot Disallow: / User-agent: lwp-trivial Disallow: / User-agent: Magpie-Crawler Disallow: / User-agent: MATA HARI Disallow: / User-agent: Mediatoolkit Bot Disallow: / User-agent: MegaIndex Disallow: / User-agent: MetaInspector Disallow: / User-agent: MetaJobBot Disallow: / User-agent: Microsoft.URL.Control Disallow: / User-agent: Mirror Disallow: / User-agent: Missigua Locator Disallow: / User-agent: Mister PiX Disallow: / User-agent: Moget Disallow: / User-agent: MojeekBot Disallow: / User-agent: MuscatFerret Disallow: / User-agent: NalezenCzBot Disallow: / User-agent: NaviSearch Disallow: / User-agent: NearSite Disallow: / User-agent: NetAnts Disallow: / User-agent: Netcraft Disallow: / User-agent: NetMechanic Disallow: / User-agent: NetSpider Disallow: / User-agent: NetVampire Disallow: / User-agent: NetZIP Disallow: / User-agent: Nimbostratus Bot Disallow: / User-agent: Nmap Disallow: / User-agent: Nutch Disallow: / User-agent: Octopus Disallow: / User-agent: Openindex Disallow: / User-agent: OutfoxBot Disallow: / User-agent: PageGrabber Disallow: / User-agent: PagePeeker Disallow: / User-agent: Pavuk Disallow: / User-agent: PC Browser Disallow: / User-agent: PerfExplorer Disallow: / User-agent: php version tracker Disallow: / User-agent: Pockey Disallow: / User-agent: Pompos Disallow: / User-agent: ProPowerBot Disallow: / User-agent: psbot Disallow: / User-agent: Pump Disallow: / User-agent: QueryN Metasearch Disallow: / User-agent: Rainmeter Disallow: / User-agent: RamblerMail Image Proxy Disallow: / User-agent: Reaper Disallow: / User-agent: ReGet Disallow: / User-agent: RepoMonkey Disallow: / User-agent: Riddler Disallow: / User-agent: Robozilla Disallow: / User-agent: Roller Disallow: / User-agent: rossbot Disallow: / User-agent: Roverbot Disallow: / User-agent: Ryowl Disallow: / User-agent: SabsimBot Disallow: / User-agent: SafeDNSBot Disallow: / User-agent: Scooter Disallow: / User-agent: Scooex Disallow: / User-agent: Seeker Disallow: / User-agent: Seekport Crawler Disallow: / User-agent: SeznamBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SeznamEmailProxy Disallow: / User-agent: Shai Disallow: / User-agent: Siclab Disallow: / User-agent: Siphon Disallow: / User-agent: SiteChecker Disallow: / User-agent: SiteSnagger Disallow: / User-agent: snagger Disallow: / User-agent: Sogou Spider Disallow: / User-agent: SpaceBison Disallow: / User-agent: Speedy Disallow: / User-agent: SpiderBot Disallow: / User-agent: SqWorm Disallow: / User-agent: SQLMap Disallow: / User-agent: Sproose Disallow: / User-agent: SQUILL Disallow: / User-agent: Startpagina Linkchecker Disallow: / User-agent: StatusCake Disallow: / User-agent: Stringer Disallow: / User-agent: Sublinq Disallow: / User-agent: Superfeedr Disallow: / User-agent: Szukacz Disallow: / User-agent: Taboolabot Disallow: / User-agent: Tag Inspector Disallow: / User-agent: Tarmot Gezgin Disallow: / User-agent: TestCrawler Disallow: / User-agent: TinEye Crawler Disallow: / User-agent: Tiny Tiny RSS Disallow: / User-agent: TurnitinBot Disallow: / User-agent: Twitterbot Disallow: / User-agent: UbiCrawler Disallow: / User-agent: UniversalFeedParser Disallow: / User-agent: UrlAppendBot Disallow: / User-agent: Vagabondo Disallow: / User-agent: VeLen Public Web Crawler Disallow: / User-agent: VeryHip Disallow: / User-agent: Vibra Disallow: / User-agent: Vercel Bot Disallow: / User-agent: Visual Site Mapper Crawler Disallow: / User-agent: VLC/1.0 Disallow: / User-agent: Vogon Disallow: / User-agent: VuMoto Disallow: / User-agent: W3C CSS Validator Disallow: / User-agent: W3C Link Checker Disallow: / User-agent: W3C Markup Validation Service Disallow: / User-agent: W3C MobileOK Checker Disallow: / User-agent: W3C Unified Validator Disallow: / User-agent: WebBandit Disallow: / User-agent: WebCopier Disallow: / User-agent: WebDataStats Disallow: / User-agent: WebEnhancer Disallow: / User-agent: Webler Disallow: / User-agent: WebPros Disallow: / User-agent: WebProbe Disallow: / User-agent: WebReaper Disallow: / User-agent: WebSitePulse Disallow: / User-agent: WebStripper Disallow: / User-agent: WebThumbnail Disallow: / User-agent: WebZIP Disallow: / User-agent: WeSEE:Search Disallow: / User-agent: WhatCMS Disallow: / User-agent: WhereGoes Disallow: / User-agent: WikiDo Disallow: / User-agent: Willow Internet Crawler Disallow: / User-agent: WooRank Disallow: / User-agent: Worm/2.0 Disallow: / User-agent: Wotbox Disallow: / User-agent: Xenu's Link Sleuth Disallow: / User-agent: xine Disallow: / User-agent: XoviBot Disallow: / User-agent: YaCy Disallow: / User-agent: YaK Disallow: / User-agent: YodaoBot Disallow: / User-agent: Zaldamo Disallow: / User-agent: Zao Disallow: / User-agent: Zealbot Disallow: / User-agent: Zeus Disallow: / User-agent: zgrab Disallow: / User-agent: ZumBot Disallow: /
Following keywords were found. You can check the keyword optimization of this page for each keyword.
(Nice to have)