Apify

Repositories

• browser-pool

  A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteer, Playwright, or SecretAgent.

  scraping web-scraping browser-automation headless-browsers rpa puppeteer playwright
  JavaScript 4 5 4 1 Updated Feb 25, 2021

• apify-docs

  This project is the home of Apify's documentation.
  JavaScript Apache-2.0 23 5 18 2 Updated Feb 25, 2021

• covid-19

  Open APIs with statistics about Covid-19
  JavaScript 21 28 0 0 Updated Feb 25, 2021

• apify-js

  Apify SDK — The scalable web scraping and crawling library for JavaScript/Node.js. Enables development of data extraction and web automation jobs (not only) with headless Chrome and Puppeteer.

  npm automation scraping crawling javascript-library web-scraping web-crawling
  JavaScript Apache-2.0 184 2,750 83 (2 issues need help) 12 Updated Feb 24, 2021

• apify-client-js

  Apify API client for JavaScript / Node.js.
  JavaScript Apache-2.0 7 20 11 1 Updated Feb 24, 2021

• proxy-chain

  Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.

  proxy-server javascript-library proxychains headless-chrome
  JavaScript Apache-2.0 65 363 24 (1 issue needs help) 3 Updated Feb 24, 2021

• apify-client-python

  Apify API client for Python (work in progress)
  Python Apache-2.0 0 0 9 1 Updated Feb 22, 2021

• actor-google-search-scraper

  Apify actor that crawls Google Search result pages (SERPs) and extracts a list of organic results, ads, related queries and more. It supports selection of custom country, language and location.

  web-scraping google-search apify serp-api
  HTML 16 37 26 0 Updated Feb 22, 2021

• apify-web-covid-19

  A list of public COVID-19 APIs to be rendered on https://apify.com/covid-19
  JavaScript Apache-2.0 6 2 0 0 Updated Feb 22, 2021

• headers-generator

  NodeJs package for generating browser-like headers.
  JavaScript Apache-2.0 0 0 1 0 Updated Feb 21, 2021

• apify-cli

  Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

  command-line headless-chrome apify puppeteer serveless
  JavaScript 7 29 39 (1 issue needs help) 1 Updated Feb 19, 2021

• apify-shared-js

  Utilities and constants shared across Apify projects.
  JavaScript Apache-2.0 5 5 4 3 Updated Feb 18, 2021

• apify-actor-docker

  Base Docker images for Apify actors.
  Dockerfile Apache-2.0 10 30 5 0 Updated Feb 13, 2021

• actor-templates

  This project is the 🏠home of Apify actor template projects to help users quickly get started.
  JavaScript 2 7 4 1 Updated Feb 8, 2021

• actor-quick-start

  Contains a boilerplate of an Apify actor to help you get started quickly build your own actors.
  Dockerfile Apache-2.0 12 10 0 1 Updated Feb 4, 2021

• apify-storage-local-js

  Local emulation of the apify-client NPM package, which enables local use of Apify SDK.
  JavaScript 1 0 3 0 Updated Feb 3, 2021

• scraping-tools-js

  A library of utility functions that make scraping, data extraction and usage of headless browsers easier and faster.
  JavaScript 0 1 0 0 Updated Jan 28, 2021

• actor-page-analyzer

  Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSON-LD metadata, analyzes AJAX requests, etc.

  javascript web-scraping headless-chrome
  JavaScript 14 122 5 3 Updated Jan 21, 2021

• actor-screenshot-url

  Actor which opens URL in headless browser and stores screenshot into Key-Value store
  JavaScript 4 1 1 3 Updated Jan 21, 2021

• actor-algolia-website-indexer

  Apify actor that crawls website and indexes selected web pages to Algolia index. It's used to power the search on https://help.apify.com
  JavaScript MIT 1 0 0 1 Updated Jan 21, 2021

• actor-scrapy-executor

  Apify actor to run web spiders written in Python in the Scrapy library

  scrapy apify scrapy-spiders
  Python 3 4 2 5 Updated Jan 21, 2021

• actor-scraper

  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.

  web-scraping apify
  JavaScript Apache-2.0 24 59 7 4 Updated Jan 21, 2021

• actor-legacy-phantomjs-crawler

  The actor implements the legacy Apify Crawler product. It uses PhantomJS headless browser to recursively crawl websites and extract data from them using a piece of JavaScript code.

  phantomjs web-crawler web-scraping headless-browsers apify
  JavaScript 3 6 1 3 Updated Jan 21, 2021

• keboola-ex-apify

  Apify extractor for Keboola Connection
  JavaScript Apache-2.0 0 0 3 4 Updated Jan 20, 2021

• better-sqlite3-with-prebuilds

  Better SQLite prebuild & publish action
  1 1 1 0 Updated Dec 15, 2020

• algolite

  Forked from marconi1992/algolite

  An Implementation of Algolia to emulate its REST API
  JavaScript 7 0 0 0 Updated Nov 27, 2020

• browser-headers-generator

  Package generating randomized browser-like headers.
  JavaScript 0 1 0 0 Updated Nov 26, 2020

• actor-content-checker

  You can use this act to monitor any page's content and get a notification when content changes.

  web-scraping apify content-selector
  JavaScript Apache-2.0 16 11 7 0 Updated Nov 22, 2020

• http-request

  A HTTP request library for Node.js, with a common-sense API, support for Brotli compression and without bugs in "request" NPM package
  JavaScript Apache-2.0 2 2 7 0 Updated Nov 16, 2020

• test-travis-github-migration Archived
  JavaScript 0 0 0 0 Updated Nov 16, 2020