found 2,282 packages in 20ms

isbot4.9mUnlicense5.1.28

🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.

omrilotan14 days agocrawlers, bot, spiders, googlebot

@crawlee/utils180.5kApache-2.03.13.5

A set of shared utilities that can be used by crawlers

apify3 days agocrawlers, apify, crawling, utilities

sitemapper117.9kMIT4.0.2

Parser for XML Sitemaps to be used with Robots.txt and web crawlers

seantomburke10 days agocrawlers, parse, sitemap, xml

Parse robot directives within HTML meta and/or HTTP headers.

stevenvachonalmost 3 years agocrawlers, header, html, http

This is an ES6 adaptation of the original PHP library CrawlerDetect, this library will help you detect bots/crawlers/spiders vie the useragent.

JefferyHusabout 1 month agoes6-javascript, crawler, bots, spider

Packages

Lightweight debugging utility for Node.js and the browser

Lodash modular utilities.

React is a JavaScript library for building user interfaces.

A querystring parser that supports nesting and arrays, with a depth limit

Higher-order functions and common patterns for asynchronous code

Babel compiler core.