With webscraping it is possible to give you any data and information which is available on the World Wide Web – so more or less only the horizon is the limit. Scrape the data you need and put it in the form you need linkedin Excel, PDF, Word, etc.
IMDB – Movies
What:
Read data from imdb and put it to an excel-sheet with specific informations. Get different informations from the website itself and available imdb-modules
Used Modules:
selenium, bs4, xlwings, imdb, cinemagoer
Blizzard – Ski Stores
What:
Get store-data from blizzard website with address, street, city, zip, etc.
Used Modules:
selenium, xlwings
Amazon – Online Retailer
What:
Collect data from amazon for asin, price, link, name, description
Used Modules:
selenium, xlwings, bs4
Timeform – Horse Betting
What:
Read informations from timeform.com for horseraces and put data to an excel-sheet, read complete history for one year and update new entries
Used Modules:
selenium, bs4, xlwings
Zalando – Fashion Retailer
What:
Collect data from zalando like name, brand, price, links, partner-information
Used Modules:
selenium, bs4, xlwings
WillHaben – Used Cars
What:
Read actual ads on the platform and show in excel-sheet, update the infromation every few minutes
Used Modules:
selenium, bs4, xlwings
Tripadvisor – Eat in Spain
What:
Read actual restaurants from spain and povide email, adress, phone, etc. in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Ebay – E-Commerce
What:
Scrape data from ebay-links like name, price, image, description
Used Modules:
selenium, bs4, xlwings
Atomic – Atomic Stores
What:
Get store-data from atomic website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
TikTok – Social Platform
What:
Check follower count from different tiktok-accounts in an excel-sheet
Used Modules:
selenium, bs4, xlwings
HealthGrades – Find Doctors
What:
Read healthgrades.com and search for orthopedic surgery doctors in the US. Provide the data with address, phone, email, reviews, specialities in an excel-sheet
Used Modules:
selenium, bs4, xlwings, vpn
Dynafit – Ski Stores
What:
Get store-data from dynafit website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
ScanSource – Distributors
What:
Scrape data from scansource for name, prodnumber, MFR, price description
Used Modules:
selenium, bs4, xlwings
Save Circuits
What:
Search for workcodes, download the pdfs, merge them and store them
Used Modules:
selenium, bs4, pypdf2, xlwings
FirmenABC – Company Infos
What:
Search for category and location, get informations about companies which provide this service with address, email, phone, website. Executeable for windows.
Used Modules:
selenium, bs4, xlwings
Douglas – Cosmetic Retailer
What:
Collect data from douglas for prices, variants, labels, image, link, etc.
Used Modules:
selenium, bs4, xlwings
Indeed – Check Jobs
What:
Read searchwords and locations from excel and find jobs with salary-information on indeed.com
Used Modules:
selenium, bs4, xlwings
Ask.com – Search For Links
What:
Read links and search with them on ask.com, translate them from any language to english and store the informatino in excel. Executeable for MacOs.
Used Modules:
requests, bs4, deep_translator, xlwings
Clutch.co – Company Reviews
What:
Get informatins from Developer Companies in the US Market and South America including all the reviews which are available
Used Modules:
selenium, bs4, xlwings
Instagram – Social Platform
What:
Check if an instragram-accontname is free
Used Modules:
selenium, bs4, xlwings
Völkl – Selling Stores
What:
Get store-data from Völkl website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
Xing – Find CEOs in Europe
What:
Search for specific CEO-titles in Europe, and provide the informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Football.il – Israelian Football
What:
Read football-stats from israelian tournaments and provide data in an excel-sheet for games results and standings for every round
Used Modules:
selenium, bs4, xlwings
Rog-Joma – Croatian Bikes
What:
Collect data from a croatian bike-store and provide the documented solution in an excel-sheet
Used Modules:
selenium, bs4, xlwings
BestBuy – Shopping
What:
Collect data from a croatian bike-store and provide the documented solution in an excel-sheet
Used Modules:
selenium, bs4, xlwings
datis.clowd.io – FAA Digital
What:
Read data from a website every hour, save the information to excel sheet and build history
Used Modules:
selenium, bs4, xlwings
violinist.com – Violinist Forum
What:
Read threads from a violinist forum and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Skitrab – Ski Tours
What:
Read store-information for all locations with name, hours, description, name, phone, address
Used Modules:
requests, xlwings, api
Zagskis – Ski Stores
What:
Collect the information for all stores and provide the data in an excel-sheet
Used Modules:
selenium, xlwings
HomeDepot – Appliance Store
What:
Read model-numbers for appliances and find the actual price and link for the product
Used Modules:
selenium, bs4, xlwings
Resale – Machine Selling
What:
Collect machinery companies and their contact person, phone, address for different categories
Used Modules:
selenium, bs4, xlwings
WLW – B2B Platform
What:
Collect data for companies with searchwords as input and find emails additonal. Input will be the link to search – Output in excel
Used Modules:
selenium, bs4, xlwings, valueserp, emailfinder
OGDB – German Gaming DB
What:
Collect data from a online gaming database with different informations about the titles and the development studios
Used Modules:
selenium, bs4, xlwings
Oregon Liquor – US Liquor Store
What:
Get data from a Liquor Store for different cataegories with description, size, price and store locations with city, address, phone etc.
Used Modules:
selenium, bs4, xlwings
Zillow – US Real Estate
What:
Collect real estate data for a specific region and price range – return price, beds, batchrooms, heating, agent information, etc.
Used Modules:
selenium, bs4, xlwings, smartproxy
Linkedin – Social Career
What:
Get name+company and find linkedin-profile with title
Used Modules:
requests, valueserp, xlwings
Yamaha – Motorsport
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Stepstone – Job Searching
What:
Read job-profiles on stepstone for a specific role and location – output the profile contact informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Comparis – Doctors Switzerland
What:
Create a list of of pathologists in switzerland
Used Modules:
selenium, bs4, xlwings
11880 – German Industry
What:
Create a list of of pathologists in switzerland
Used Modules:
selenium, bs4, xlwings
AKV – Austrian Insolvencies
What:
Collect insolvencies from a website with different informations
Used Modules:
selenium, bs4, xlwings
Chrono24 – UK Chrono Watches
What:
Read watch-prices from different countries and build the average price for every model
Used Modules:
selenium, bs4, xlwings
Rockauto – US Car Parts
What:
Provide car informations for different brands with year and model description
Used Modules:
selenium, bs4, xlwings
MyDealz – German Deals
What:
Read the shopping dealz from the website and update an excel-sheet
Used Modules:
selenium, bs4, xlwings
Crowdbotics – Code Packages
What:
Collect text data from a website and put the scraped text in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Indeed – Jobs in Austria
What:
Read all listed jobs for a specific searchstring and provide all the data including a optional detailed description in excel
Used Modules:
selenium, bs4, xlwings
CarsAndBids – Car Auctions US
What:
Check car bids from finished auctions and update the information in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Kawasaki – Vehicles
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Creditcards – Reward Cards
What:
Scrape data for reward credit cards informations like bonuses, annual fees, cashback and other benefits
Used Modules:
selenium, bs4, xlwings
Great Schools – Find Ratings
What:
Search for schools in colorado for a specfic area an provide some info like address, email, phone in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Camping – Places Germany
What:
Collect camping places in germany with data like address, places, energy, dogs allowed, wlan, etc.
Used Modules:
selenium, bs4, xlwings
Realtor – US Estates
What:
Collect data from the realtor website for a specific area and provide data like address, price, beds, baths, sqfts, etc.
Used Modules:
selenium, bs4, xlwings, scrapeops API
Audible – Audiobooks Ratings
What:
Read data from audible and check the rating informations for the different audiobooks and and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
NSE India – Stock Prices
What:
Get stockdata from nseindia with price, buy quantity, sell quantity
Used Modules:
selenium, bs4, xlwings
Arctic Cat – Motor Parts
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Sofascore – Sport Statistics
What:
Collect football statistics from previous games, teams, results, goals, etc.
Used Modules:
selenium, bs4, xlwings
Parkopedia – Worldwide Parking
What:
Collect parking informations all over the world
Used Modules:
selenium, bs4, xlwings
Trulia – Images Real Estates
What:
Read and store all images from a real estatet posting on trulia.com
Used Modules:
selenium requests, bs4, xlwings
United Rentals – Rent Equipment
What:
Collect data for a specific postcode for renting working equipment and vehicles
Used Modules:
selenium, bs4, xlwings, undetected chromedriver
Odds Portal – Football Quotes
What:
Scrape data from betting portal for football-season and different quotes
Used Modules:
selenium, bs4, xlwings
About Payments – Payments
What:
Collect data for paying providers with different infos like cards and countries
Used Modules:
selenium, bs4, xlwings
Gesund.de – Doctors Germany
What:
Scrape data for doctors like email, name, address, website, specialization
Used Modules:
selenium, bs4, xlwings
Coinmarketcap – Crypto Coins
What:
Read coin-information and buidl a historical comparison for price, marketcap, etc.
Used Modules:
selenium, bs4, xlwings
Futurepedia – AI Tools
What:
Collect data from the AI-directory for name, website, price, descrition, labels, etc.
Used Modules:
selenium, bs4, xlwings
Handelsblatt – Business News DE
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Profishop – Swiss Sanitary
What:
Get data from profishop like title, image, description, article-number, technical details
Used Modules:
selenium, bs4, xlwings
Ringschuh – Shoe Retailer AT
What:
Get data for the shops from ringschuh with address, email, website, phone, etc.
Used Modules:
selenium, bs4, xlwings
IProperty – Properties Malaysia
What:
Get data for properties in Malaysia with locatoin, price, beds, baths, parking, images, etc.
Used Modules:
selenium, bs4, xlwings
Yellow Pages ZA – South Africa
What:
Get business from south africa from the yellow page with name, location, website, emails, etc.
Used Modules:
selenium, bs4, xlwings
Yahoo Finance – Financial Data
What:
Read data for stocks from a txt-input file and output the data in a csv-file
Used Modules:
csv, yahooquery
Twitter – Search Data
What:
Read data for a twitter-search with name, profileimage, link, text, etc.
Used Modules:
selenium, bs4, xlwings
Golem – Tech News DE
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Tanami – Real Estate Dubai
What:
Collect data from real estate projects in Saudi Arabia with overview, amenities, payment plans, location maps, master plans, floor plans, images galleries, etc.
Used Modules:
selenium, bs4, xlwings
Cumhuriyet – News Turkey
What:
Check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Amazon – Discount Products
What:
Provide all products which have discounts on Amazon for a specific link and provide price, old-price, discount
Used Modules:
selenium, bs4, xlwings
Ebay – Product Combinations
What:
Check prices for all possible combinations of an ebay-add with link, price, combination
Used Modules:
selenium, bs4, csv
SteamDB – Games Wishlist
What:
Collect games wishlist-data with name, followers, release date, developer, images, description, etc.
Used Modules:
octoparse
Stockanalysis – Financial Data
What:
Read data for stocks from a txt-input file using proxies and output the data in a csv-file
Used Modules:
selenium, bs4, csv, buyproxies.org
Liquipedia – ESports Players
What:
Scrape player data for different esport-gams with playername, age, team, country, twitter, instagram, etc. images, description, etc.
Used Modules:
selenium, bs4, csv
Numerade – Video Lessons
What:
Collect data from video-lessons with book, author, edition, chapter, question, etc.
Used Modules:
selenium, bs4, xlwings
Marketbeat – Financial Data
What:
Read data for stocks from a txt-input file using proxies and output the data in a csv-file
Used Modules:
selenium, bs4, csv, buyproxies.org
CostPlusDrugs – Online Medication
What:
Read price data for the different kinds of medication regarding form, strength, volume, quantity
Used Modules:
xlwings, selenium, bs4
Meet.Barcelona.Cat – Unlicensed tourist flats
What:
Read excel-sheet with street names and check for unlicensed tourist flats in Barcelona
Used Modules:
xlwings, selenium, bs4
Hublot – Watches
What:
Update prices from Hublot and checking the price deviaton to Bitcoin including currency exchange between CHF and USD
Used Modules:
xlwings, selenium, bs4, currency_converter, yahooquery
TCDb – Trading Card Database
What:
Collect data for Baseball and Basketball cards for year, player, team, set
Used Modules:
xlwings, selenium, bs4
Housing Anywhere – Rent Rooms
What:
Gather data for different spanish cities and provide data for the rooms like price, type, bedrooms, availibility
Used Modules:
xlwings, selenium, bs4
OpenPath – Find Psychotherapists
What:
Find information about Psychoterapists with name, skills, expertise, location, availibility, finances, qualifications, client focus, etc.
Used Modules:
xlwings, selenium, bs4
Military Relocation Pro
What:
Find Military relocation proffesionals for different states and bases with address, phone,m website, name, informations
Used Modules:
xlwings, selenium, bs4
ImportInfo – US Customs Import
What:
Get infos about US Customs Import Companies with Email Contacts, Bills of Lading, Activity by Port, Phone Numbers, etc.
Used Modules:
xlwings, selenium, bs4
Trusted Shops Germany
What:
Collect data from trusted shops with detailed informations, rating, emails, website, etc.
Used Modules:
selenium, bs4, xlwings
Available Sizes – Shoe Shop
What:
Check available sizes of shoes and prices and make some calculations
Used Modules:
selenium, bs4, xlwings, scrapeops.io
Auction – Property Data
What:
Collect some property data from auctions and put the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings, scrapeops.io
Buildings Data – Manually Choosen
What:
Scrape buildings data for specific areas which are manually choosen in the browser
Used Modules:
selenium, bs4, xlwings
Shoes, Prices And Sizes
What:
Check available sizes of shoes and prices and make some calculations
Used Modules:
selenium, bs4, xlwings
Prices For Lego Sets
What:
Check prices for lego-sets and compare them with actual prices from bricklink.com
Used Modules:
selenium, bs4, xlwings, progress
Check New Adds And Alert
What:
Check for new adds and send email with the new links and running the program in the cloud
Used Modules:
selenium, bs4, email, progress, pythonanywhere
Stock-Info From BarChart
What:
Read information from stocks like Sales, NetIncome, Cashflow, etc. and output to excel
Used Modules:
selenium, bs4, xlwings