Go to Main Website

Node.js

Learn web scraping in Node.js, the JavaScript runtime environment. Browse for popular Node.js libraries and frameworks like Puppeteer, Selenium and Playwright.

Web Scraping

Proxy in Axios: 3 Effective Setup Methods Explained

Learn to setup proxy in Axios in 3 easy and effective methods with code examples.

Anber Arif

Technical Writer
10min read
Web Scraping

Proxy in Node.js: 5 Common Setup Methods Explained

Learn to setup a proxy server in Node.js choosing one the 5 common setup methods.

Shanika Wickramasinghe

Software Engineer
8min read
E2E Testing

Proxy in Playwright: 3 Effective Setup Methods Explained

Learn to set up proxies in Playwright in 3 different methods, best fit for your use-case.

Anber Arif

Technical Writer
9min read
Web Scraping

Login in Puppeteer: Examples, Session Cookies & More

Using Puppeteer learn to login to Wikipedia, Facebook, Twitter or Gmail with Google single sign-on.

Anber Arif

Technical Writer
10min read
Web Scraping

Downloading Files in Puppeteer: 5 Methods Explained

Downloading files using Puppeteer is a powerful way to automate web interactions and streamline the acquisition of resources from webpages.

Anber Arif

Technical Writer
9min read
E2E Testing

Replay in Puppeteer: Create Session Recordings

The Puppeteer Replay library provides a high-level API that allows developers to automate and test web experiences efficiently.

Shanika Wickramasinghe

Software Engineer
6min read
Web Scraping

Debugging Puppeteer: Setup, Tips & Examples

Learn the various ways of debugging in Puppeteer along with the tools and techniques associated with it.

Shanika Wickramasinghe

Software Engineer
5min read
Web Scraping

Check Element in Puppeteer: How to Check if it Exists or Is Active?

Learn to check if element exists via Puppeteer and how to check whether they're in an active state.

Shanika Wickramasinghe

Software Engineer
6min read
Web Scraping

How to Intercept Requests in Puppeteer?

Intercepting requests with Puppeteer offers powerful capabilities for testing and ensuring the robustness of web applications.

Shanika Wickramasinghe

Software Engineer
6min read
Web Scraping

How to Wait For Button to be Enabled in Puppeteer?

This article guides you through the process of Puppeteer wait for button to be enabled on a webpage.

Shanika Wickramasinghe

Software Engineer
7min read
Web Scraping

Upload File in Puppeteer: Automation Examples

With Puppeteer's convenient uploadFile() method, you can easily upload files to a site - we'll show you how.

Anber Arif

Technical Writer
7min read
Web Scraping

Bypass or Solve CAPTCHA in Puppeteer: Working Examples

In this article, we explore strategies for bypassing CAPTCHA challenges in Puppeteer automation.

Anber Arif

Technical Writer
9min read
Web Scraping

Puppeteer in Docker: How to Run Examples & Error Troubleshoot

We’ve explored the process of running Puppeteer in Docker, covering essential steps, optimizing performance, and troubleshooting common errors.

Anber Arif

Technical Writer
10min read
Web Scraping

What is Puppeteer? Popular Node.js Library Explained

We explore what Puppeteer is, how it works, and what it can be used for.

Anber Arif

Technical Writer
10min read
Web Scraping

Viewport in Puppeteer: How to Manipulate Default Size

We discuss changing viewport sizes, troubleshooting common issues like setViewport failures, and ensuring content visibility in Puppeteer.

Anber Arif

Technical Writer
5min read
Web Scraping

How To Execute JavaScript on Page in Puppeteer: Examples

In this article, we explored the capabilities of Puppeteer in executing Javascript on web pages, focusing on a live example.

Anber Arif

Technical Writer
4min read
Web Scraping

'networkidle0' vs. 'networkidle2' in Puppetteer

Understanding the distinctions between networkidle0 and networkidle2 in Puppeteer is crucial for optimizing web automation tasks.

Anber Arif

Technical Writer
6min read
Web Scraping

Get Text From Element in Puppeteer: Examples

We discuss several scenarios where you would need to extract text and how to do it with Puppeteer using the methods available with real-life examples.

Shanika Wickramasinghe

Software Engineer
8min read
Web Scraping

Using Puppeteer on AWS Lambda for Scraping

Puppeteer with AWS Lambda gives a powerful and cost-effective way to run large-scale web scraping and other web automation tasks without managing servers or infrastructure.

Shanika Wickramasinghe

Software Engineer
7min read
Web Scraping

Scroll in Puppeteer: Scroll to Bottom, Top, or Into View

Fundamentals and advanced tips for effective scrolling in Puppeteer.

Anber Arif

Technical Writer
6min read
Web Scraping

Fill & Submit Form in Puppeteer

Learn to fill & submit forms in Puppeteer.

Shanika Wickramasinghe

Software Engineer
6min read
Web Scraping

Puppeteer vs. Playwright

Learn the differences and similarities between Puppeteer and Playwright.

Anber Arif

Technical Writer
8min read
Web Scraping

How to scrape websites using Puppeteer?

Basic web scraping techniques using Puppeteer and Node.js.

Anber Arif

Technical Writer
10min read
Web Scraping

Convert HTML to PDF Using Puppeteer

In this article, we covered two handy methods for turning HTML into PDFs with Puppeteer and Node.js.

Anber Arif

Technical Writer
8min read
Web Scraping

Puppeteer vs. Cypress

Puppeteer excels in web scraping, while Cypress focuses on comprehensive end-to-end testing for web applications.

Anber Arif

Technical Writer
9min read
Web Scraping

Puppeteer vs. Selenium

Learn more about differences and similarities between Puppeteer and Selenium.

Anber Arif

Technical Writer
8min read
Web Scraping

Cookies in Puppeteer: How to Accept, Save, Load or Clear Them

In this guide, we’ll cover the following key aspects of cookie management in Puppeteer: How to Accept, Save, Load or Clear Cookies for Puppeteer web automation tasks.

Anber Arif

Technical Writer
10min read
Web Scraping

5 Puppeteer Alternatives For Scraping & Application Testing

Let's cover 5 alternatives for Puppeteer depending on your goal - web scraping or application testing.

Anber Arif

Technical Writer
11min read
Web Scraping

Downloading Images in Puppeteer: 6 Methods Explained

In this article, we explored six methods using Puppeteer for downloading images.

Anber Arif

Technical Writer
9min read
Web Scraping

Input in Puppeteer: How to Enter, Retrieve or Clear Values?

Mastering input handling in Puppeteer is fundamental for efficient browser automation or scraping form data.

Anber Arif

Technical Writer
9min read
Web Scraping

Timeout in Puppeteer: Setup Methods & Error Fixes

We discuss various Puppeteer timeout setup methods, troubleshooting common timeout errors, and strategies to enhance script performance.

Anber Arif

Technical Writer
9min read
Web Scraping

Puppeteer Cluster: Basic & Advanced Setup Explained

If you are someone looking to perform mass scraping from various websites on Puppeteer - this article is for you.

Shanika Wickramasinghe

Software Engineer
7min read
Web Scraping

Guide to Puppeteer Extra: Best Plugins For Scraping Ranked

In this article, we explore Puppeteer Extra and its selection of plugins, each designed to enhance the web scraping operations.

Anber Arif

Technical Writer
9min read
Web Scraping

waitForNavigation in Puppeteer: Basic and Advanced Configuration

In this guide, we discuss the waitForNavigation function in Puppeteer, a method for ensuring precise navigation synchronization during web automation.

Anber Arif

Technical Writer
7min read
Web Scraping

How to Use Puppeteer Stealth For Advanced Scraping?

Learn how Puppeteer Stealth goes beyond regular Puppeteer, enhancing stealth measures for advanced scraping tasks with code examples.

Anber Arif

Technical Writer
10min read
Web Scraping

Page Reload in Puppeteer: Methods & Errors Explained

In this article, we cover various methods to reload web pages using Puppeteer from the simple page.reload() to executing client-side Javascript and which of the methods you should use for your case. Furthermore, we cover common page reload errors, offering solutions like extending timeouts and employing try-catch blocks.

Anber Arif

Technical Writer
9min read
Web Scraping

End-to-End Testing with Puppeteer: Getting Started

Get started with E2E testing in Puppeteer: 4 simple tests explained.

Shanika Wickramasinghe

Software Engineer
8min read
Web Scraping

How to Get HTML in Puppeteer?

In this guide, we discussed how to effectively work with Puppeteer to capture the page source HTML, extract specific elements, and handle Javascript-reliant web pages.

Anber Arif

Technical Writer
9min read
Web Scraping

How to Take Screenshot in Puppeteer: Complete Guide

Puppeteer is a powerful tool for web scraping, and test automation, offering a high degree of flexibility and control over the screenshot-taking process.

Shanika Wickramasinghe

Software Engineer
8min read
Web Scraping

iFrame in Puppeteer: Guide For Developers

To access and extract critical data for scraping, developers need to know how to navigate, manipulate, and interact with iframes. This blog post will teach exactly that.

Anber Arif

Technical Writer
8min read
Web Scraping

Click in Puppeteer: Guide to Master Puppeteer’s Clicking Methods

In this article, we’ll explain how to configure clicking in Puppeteer in 3 different methods, using Selector, XPath and Text search.

Anber Arif

Technical Writer
13min read
Web Scraping

Wait For Page to Load in Puppeteer: 4 Methods Compared

In this article, we explored four commonly-used methods: load, domcontentloaded, networkidle0, and networkidle2 to determine when the page is ready for interaction.

Shanika Wickramasinghe

Software Engineer
7min read
Web Scraping

waitForSelector in Puppeteer: Basic and Advanced Configuration

In this article, we’ll explore both the fundamental details and advanced configuration of waitForSelector in Puppeteer. From waiting for a single element to appear on a web page to modifying the timeout and handling multiple selectors, we’ll discuss all the details.

Shanika Wickramasinghe

Software Engineer
7min read
Web Scraping

Get Element in Puppeteer: Mastering Class, ID and Text Methods

In this article, we will discuss Puppeteer’s methods for precisely targeting and manipulating elements on web pages. We’ll explore three essential techniques: selecting elements by class, by ID, and by their text content.

Anber Arif

Technical Writer
9min read
Web Scraping

Proxy in Puppeteer: 3 Effective Setup Methods Explained

In this article, we’ll explain how to setup proxies in Puppeteer in 3 different methods, using Static, Proxy List and Rotating proxies.

Anber Arif

Technical Writer
12min read
Web Scraping

User-Agent in Puppeteer: Random & Custom Methods Explained

In this article, we’ll dive deeper into the user-agent manipulation in Puppeteer, using random or custom user-agent setups.

Shanika Wickramasinghe

Software Engineer
8min read
Web Scraping
Webshare Academy