Google Custom Search with NodeJS

Goo

Google provides a custom search API by which you can use the power of google search engine in your own application. The base URL for the REST version of custom search API is:

https://www.googleapis.com/customsearch/v1

Before moving on to integration part, we need two things.

  1. API KEY
  2. Search Engine ID

The API KEY can be created by tapping the GET A KEY button and creating a new project at the following link:

https://developers.google.com/custom-search/json-api/v1/introduction

The next step is the search engine ID. You need to create an instance of a search engine at:

https://cse.google.com/

  1. Here you need to add a new instance, give the name of the engine, any website and just create it for now.
  2. Now go to its control panel and in the basic options > Sites to search, you have the option to search the entire web (with emphasis on some websites if you want to include some) or search only for some websites (should be included in list, patterns can also be included).
  3. Configure it as per your choice and in Details section you will find the search engine ID by clicking on the Search Engine ID button.

Now you are ready to integrate. The code to integrate the API using Express and Node JS is:

var express = require(‘express’);

var path = require(‘path’);

var app = express();

var request = require(‘request’);

// The main search function

var google_web_search = function(search, callback) {

    console.log(‘Searching the web for: ‘, search);

    var options = {

        method: ‘GET’,

        url: ‘https://www.googleapis.com/customsearch/v1’,

        qs: {

            q: search,

            key: ‘<API_KEY>’,

            cx: ‘<SEARCH_ENGINE_ID>’,

        }

    };

    request(options, function (error, response, body) {

        callback(error, body);

    });

};

app.get(‘/’, function (req, res) {

   google_web_search(‘<YOUR_SEARCH_QUERY>’, function(error, body) {

     if (!error) {

        res.send(body);

     } else {

        throw new Error(error);

     }

   });

});

app.listen(3000, function () {

    console.log(‘Example app listening on port 3000!’);

});

If you want more results, then you can use pagination by adding two query params:

  1. num: specifies the number of results to return in the response
  2. start: specifies the number of results to skip

gle provides a custom search API by which you can use the power of google search engine in your own application. The base URL for the REST version of custom search API is:

https://www.googleapis.com/customsearch/v1

Before moving on to integration part, we need two things.
1. API KEY
2. Search Engine ID

The API KEY can be created by tapping the GET A KEY button and creating a new project at the following link:

https://developers.google.com/custom-search/json-api/v1/introduction

The next step is the search engine ID. You need to create an instance of a search engine at:

https://cse.google.com/

1. Here you need to add a new instance, give the name of the engine, any website and just create it for now.
2. Now go to its control panel and in the basic options > Sites to search, you have the option to search the entire web (with emphasis on some websites if you want to include some) or search only for some websites (should be included in list, patterns can also be included).
3. Configure it as per your choice and in Details section you will find the search engine ID by clicking on the Search Engine ID button.

Now you are ready to integrate. The code to integrate the API using Express and Node JS is:

var express = require('express');
var path = require('path');
var app = express();

var request = require('request');

// The main search function
var google_web_search = function(search, callback) {
    console.log('Searching the web for: ', search);
    var options = {
        method: 'GET',
        url: 'https://www.googleapis.com/customsearch/v1',
        qs: {
            q: search,
            key: '<API_KEY>',
            cx: '<SEARCH_ENGINE_ID>',
        }
    };

    request(options, function (error, response, body) {
        callback(error, body);
    });
};
app.get('/', function (req, res) {
   google_web_search('<YOUR_SEARCH_QUERY>', function(error, body) {
     if (!error) {
        res.send(body);
     } else {
        throw new Error(error);
     }
   });
});

app.listen(3000, function () {
    console.log('Example app listening on port 3000!');
});

If you want more results, then you can use pagination by adding two query params:
1. num: specifies the number of results to return in the response
2. start: specifies the number of results to skip

Comments

One response to “Google Custom Search with NodeJS”

  1. Thanks for sharing. I read many of your blog posts, cool, your blog is very good.

Recent Post

  • How to Implement In-Order, Pre-Order, and Post-Order Tree Traversal in Python?

    Tree traversal is an essential operation in many tree-based data structures. In binary trees, the most common traversal methods are in-order traversal, pre-order traversal, and post-order traversal. Understanding these tree traversal techniques is crucial for tasks such as tree searching, tree printing, and more complex operations like tree serialization. In this detailed guide, we will […]

  • Mastering Merge Sort: A Comprehensive Guide to Efficient Sorting

    Are you eager to enhance your coding skills by mastering one of the most efficient sorting algorithms? If so, delve into the world of merge sort in Python. Known for its powerful divide-and-conquer strategy, merge sort is indispensable for efficiently handling large datasets with precision. In this detailed guide, we’ll walk you through the complete […]

  • Optimizing Chatbot Performance: KPIs to Track Chatbot Accuracy

    In today’s digital age, chatbots have become integral to customer service, sales, and user engagement strategies. They offer quick responses, round-the-clock availability, and the ability to handle multiple users simultaneously. However, the effectiveness of a chatbot hinges on its accuracy and conversational abilities. Therefore, it is necessary to ensure your chatbot performs optimally, tracking and […]

  • Reinforcement Learning: From Q-Learning to Deep Q-Networks

    In the ever-evolving field of artificial intelligence (AI), Reinforcement Learning (RL) stands as a pioneering technique enabling agents (entities or software algorithms) to learn from interactions with an environment. Unlike traditional machine learning methods reliant on labeled datasets, RL focuses on an agent’s ability to make decisions through trial and error, aiming to optimize its […]

  • Understanding AI Predictions with LIME and SHAP- Explainable AI Techniques

    As artificial intelligence (AI) systems become increasingly complex and pervasive in decision-making processes, the need for explainability and interpretability in AI models has grown significantly. This blog provides a comprehensive review of two prominent techniques for explainable AI: Local Interpretable Model-agnostic Explanations (LIME) and Shapley Additive Explanations (SHAP). These techniques enhance transparency and accountability by […]

  • Building and Deploying a Custom Machine Learning Model: A Comprehensive Guide

    Machine Learning models are algorithms or computational models that act as powerful tools. Simply put, a Machine Learning model is used to automate repetitive tasks, identify patterns, and derive actionable insights from large datasets. Due to these hyper-advanced capabilities of Machine Learning models, it has been widely adopted by industries such as finance and healthcare.  […]

Click to Copy