Puppeteer

Puppeteer is a Node.js library that provides a high-level API for controlling headless or full browsers like Google Chrome or Chromium. Puppeteer enables web automation, scraping, testing, and performance monitoring, so you can simulate user actions, extract data, and generate PDFs or screenshots. You can find out more about Puppeteer on the official Puppeteer page.

Check whether Node.js is installed

Before anything, check whether Node.js is installed. Open a terminal (Command Prompt or shell) and run:

node -v

If you get a version number, Node.js is already installed. The version number looks like this:

Terminal showing the installed Node.js version number

In that case, skip ahead to Step 2 and create a project directory. If Node.js is not installed on your system, you get this error instead:

'node' is not recognized as an internal or external command

If that is your case, continue with the steps below.

Step 1: Install Node.js

Download Node.js

Go to the Node.js official website and download the LTS version for your operating system.

Node.js download page with the LTS version highlighted

Install Node.js

Run the installer you downloaded and follow the installation wizard.

Step 2: Create a project directory

Create the directory

Open a terminal and create a directory for your project:

mkdir puppeteer-nodemaven-proxy

Go to the directory

cd puppeteer-nodemaven-proxy

Initialize the project

npm init -y

This command creates a package.json file in your project directory.

Terminal output from npm init showing the created package.json

Step 3: Install Puppeteer

Install Puppeteer with:

npm install puppeteer

Terminal output from installing Puppeteer with npm

Step 4: Set up Puppeteer with a NodeMaven proxy

Create a new file called index.js in your project directory using your preferred text editor, then add the code for your authentication method.

const puppeteer = require('puppeteer');

(async () => {
    // Launch Puppeteer with a proxy
    const browser = await puppeteer.launch({
        args: [
            '--no-sandbox',
            '--disable-setuid-sandbox',
            '--proxy-server=http://gate.nodemaven.com:8080'
        ],
    });

    const page = await browser.newPage();

    // Authenticate with the proxy
    await page.authenticate({
        username: 'REPLACE THIS WITH YOUR NODEMAVEN PROXY USERNAME',
        password: 'REPLACE THIS WITH YOUR NODEMAVEN PROXY PASSWORD'
    });

    try {
        // Navigate to a website
        await page.goto('https://nodemaven.com/');
        console.log('Page title:', await page.title());
    } catch (err) {
        console.error('Error navigating to the page:', err);
    } finally {
        // Close the browser
        await browser.close();
    }
})();

const puppeteer = require('puppeteer');

(async () => {
    // Launch Puppeteer in headless mode with a proxy
    const browser = await puppeteer.launch({
        headless: true, // Default is true, so no visible browser
        args: [
            '--no-sandbox',
            '--disable-setuid-sandbox',
            '--proxy-server=http://gate.nodemaven.com:8405' // Replace with your IP whitelisting proxy
        ],
    });

    const page = await browser.newPage();

    try {
        // Navigate to the website
        await page.goto('https://nodemaven.com/');
        // Get the page title
        const title = await page.title();
        console.log('Page title:', title);
    } catch (err) {
        console.error('Error navigating to the page:', err);
    } finally {
        // Close the browser
        await browser.close();
    }
})();

For the whitelisted IP method, see IP whitelist.

Step 5: Run the script

Use the following command in the terminal:

node index.js

If everything is set up correctly, the script logs the title of the page at https://nodemaven.com to the console.

Terminal showing the page title logged by the Puppeteer script

You are now ready to personalize your script and start using Puppeteer with NodeMaven proxies.

Get started

Products

More

Check whether Node.js is installed

Step 1: Install Node.js

Step 2: Create a project directory

Step 3: Install Puppeteer

Step 4: Set up Puppeteer with a NodeMaven proxy

Step 5: Run the script

​Check whether Node.js is installed

​Step 1: Install Node.js

​Step 2: Create a project directory

​Step 3: Install Puppeteer

​Step 4: Set up Puppeteer with a NodeMaven proxy

​Step 5: Run the script

Check whether Node.js is installed

Step 1: Install Node.js

Step 2: Create a project directory

Step 3: Install Puppeteer

Step 4: Set up Puppeteer with a NodeMaven proxy

Step 5: Run the script