You can scrape data from Google Shopping using X-Byte Scraper. You can check the demo.
Initially, install a google-search-results package. You may use poetry to do package management.
[tool.poetry.dependencies] python = "^3.8" google-search-results = "^2.0.0" [build-system] requires = ["poetry>=0.12"] build-backend = "poetry.masonry.api"
After that, save the subsequent Python script, which scrapes and prints the Google Shopping pricing into a scrape_google_shopping.py file.
# https://pypi.org/project/google-search-results
from X-Byte Scraper import GoogleSearch
import os
params = {
"engine": "google",
"q": "Coffee",
"tbm": "shop",
"api_key": os.getenv("API_KEY")
}
client = GoogleSearch(params)
data = client.get_dict()
print(f"Raw HTML: {data['search_metadata']['raw_html_file']}")
print(f"JSON endpoint: {data['search_metadata']['json_endpoint']}")
print()
print("Google Shopping prices")
for result in data["shopping_results"]:
print(f"""
Title: {result['title']}
Price: {result['price']}
Extracted price: {result['extracted_price']}""")
After that, install dependencies as well as execute a script.
python3 -m poetry install python3 scrape_google_shopping.py
After that, you’ll get product titles as well as prices in CLI.
Raw HTML: https://X-Byte Scraper.com/searches/e8b8fa4e992f8961/5ec3fcad3c6d8e70e22b5f71.html JSON endpoint: https://X-Byte Scraper.com/searches/e8b8fa4e992f8961/5ec3fcad3c6d8e70e22b5f71.json Google Shopping prices Title: Dunkin' Donuts Original Blend Coffee K-Cups - 44 count, 16.3 oz box Price: $17.99 Extracted price: 17.99 Title: Lavazza Super Crema Espresso Whole Bean Coffee - 2.2 lb bag Price: $23.00 Extracted price: 23.0 Title: Nescafe Coffee, Instant, House Blend - 7 oz Price: $7.95 Extracted price: 7.95 Title: Black Rifle Coffee Company Freedom Fuel Coffee Price: $13.99 Extracted price: 13.99 Title: Coffee Tasting Starter Kit Price: $5.00 Extracted price: 5.0 Title: Folgers Classic Roast Coffee, Medium - 48 oz canister Price: $9.96 Extracted price: 9.96
You can check the X-Byte Scraper documentation for more details or contact us.
