With webscraping data extraction servicesit is possible to give you any data and information which is available on the World Wide Web – so more or less only the horizon is the limit. Scrape the data you need and put it in the form you need linkedin Excel, PDF, Word, etc.
Get Jeep Data (using webscraping data extraction services)
What:
Gather data for jeeps like name, sku, price, desc, image and put it in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Doctors Data Germany (s)
What:
Collect data for doctors (name, street, phone, city, category, etc.)
Used Modules:
selenium, bs4, xlwings
Data from Fansmetriccs (s)
What:
Get data from fansmetrics and provide informations (name, cats, price, views, etc.) in an excel-sheet using
Used Modules:
selenium, bs4, xlwings
School data from Germany (s)
What:
Collect school data form a website and store the data in an excel-sheet using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings
Finance Data from Buthan-stocks (s)
What:
Get finance-data from a website and output the stock-data from Buthan in a google sheet using webscraping data extraction services
Used Modules:
selenium, gspread, bs4
Psychotherapists Berlin, Hamburg (s)
What:
Get a list of psychotherpists from Berlin and Hamburg with phone, email, website, adress, specialiazation, etc.
Used Modules:
selenium, xlwings, bs4
Apartments from Phoenix Arizona (s)
What:
Get data from apartments.com and provide this in an excel sheet with address, price, beds, amenities, phone, website, etc.
Used Modules:
selenium, xlwings, bs4
Car Retailers – Opel (using webscraping data extraction services)
What:
Find car retailers in germany including emails from the CEOs using webscraping data extraction services
Used Modules:
selenium, dotenv, bs4, xlwings
Communitylink – find help (s)
What:
Find data from communitylink.findhelp.com using undetected chromedriver (use US VPN)
Used Modules:
seleniumbase, dotenv, bs4, xlwings
Jobs – Arbeitsagentur (s)
What:
Provide data from arbeitsagentur.de with also solving captchas using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings, twocaptcha
Doctors Bayern (s)
What:
Collect data from website
Used Modules:
selenium, bs4, xlwings
Hospital – Staff (s)
What:
Collect data asynchronous from website and use vcf-cards for information as download
Used Modules:
httpx, asyncio, bs4, xlwings, requests
Kashkool – Books (s)
What:
Read arabic books from the books-store with arabic language for author, title, price, etc.
Used Modules:
selenium, bs4, xlwings
IMDB – Movies
What:
Read data from imdb and put it to an excel-sheet with specific informations. Get different informations from the website itself and available imdb-modules
Used Modules:
selenium, bs4, xlwings, imdb, cinemagoer
Blizzard – Ski Stores
What:
Get store-data from blizzard website with address, street, city, zip, etc. using webscraping data extraction services
Used Modules:
selenium, xlwings
Amazon – Online Retailer (s)
What:
Collect data from amazon for asin, price, link, name, description using webscraping data extraction services
Used Modules:
selenium, xlwings, bs4
Timeform – Horse Betting
What:
Read informations from timeform.com for horseraces and put data to an excel-sheet, read complete history for one year and update new entries
Used Modules:
selenium, bs4, xlwings
Zalando – Fashion Retailer
What:
Collect data from zalando like name, brand, price, links, partner-information
Used Modules:
selenium, bs4, xlwings
WillHaben – Used Cars
What:
Read actual ads on the platform and show in excel-sheet, update the infromation every few minutes
Used Modules:
selenium, bs4, xlwings
Tripadvisor – Eat in Spain
What:
Read actual restaurants from spain and povide email, adress, phone, etc. in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Ebay – E-Commerce
What:
Scrape data from ebay-links like name, price, image, description using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings
Atomic – Atomic Stores
What:
Get store-data from atomic website with address, street, city, zip, etc. using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings
TikTok – Social Platform
What:
Check follower count from different tiktok-accounts in an excel-sheet using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings
HealthGrades – Find Doctors
What:
Read healthgrades.com and search for orthopedic surgery doctors in the US. Provide the data with address, phone, email, reviews, specialities in an excel-sheet
Used Modules:
selenium, bs4, xlwings, vpn
Dynafit – Ski Stores
What:
Get store-data from dynafit website with address, street, city, zip, etc. using webscraping data extraction services
Used Modules:
selenium, bs4, xlwings
ScanSource – Distributors
What:
Scrape data from scansource for name, prodnumber, MFR, price description
Used Modules:
selenium, bs4, xlwings
Save Circuits
What:
Search for workcodes, download the pdfs, merge them and store them
Used Modules:
selenium, bs4, pypdf2, xlwings
FirmenABC – Company Infos
What:
Search for category and location, get informations about companies which provide this service with address, email, phone, website. Executeable for windows.
Used Modules:
selenium, bs4, xlwings
Douglas – Cosmetic Retailer
What:
Collect data from douglas for prices, variants, labels, image, link, etc.
Used Modules:
selenium, bs4, xlwings
Indeed – Check Jobs
What:
Read searchwords and locations from excel and find jobs with salary-information on indeed.com
Used Modules:
selenium, bs4, xlwings
Ask.com – Search For Links
What:
Read links and search with them on ask.com, translate them from any language to english and store the informatino in excel. Executeable for MacOs.
Used Modules:
requests, bs4, deep_translator, xlwings
Clutch.co – Company Reviews
What:
Get informatins from Developer Companies in the US Market and South America including all the reviews which are available
Used Modules:
selenium, bs4, xlwings
Instagram – Social Platform
What:
Check if an instragram-accontname is free
Used Modules:
selenium, bs4, xlwings
Völkl – Selling Stores
What:
Get store-data from Völkl website with address, street, city, zip, etc.
Used Modules:
selenium, bs4, xlwings
Xing – Find CEOs in Europe
What:
Search for specific CEO-titles in Europe, and provide the informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Football.il – Israelian Football
What:
Read football-stats from israelian tournaments and provide data in an excel-sheet for games results and standings for every round
Used Modules:
selenium, bs4, xlwings
Rog-Joma – Croatian Bikes
What:
Collect data from a croatian bike-store and provide the documented solution in an excel-sheet
Used Modules:
selenium, bs4, xlwings
BestBuy – Shopping
What:
Collect data from a croatian bike-store and provide the documented solution in an excel-sheet
Used Modules:
selenium, bs4, xlwings
datis.clowd.io – FAA Digital
What:
Read data from a website every hour, save the information to excel sheet and build history
Used Modules:
selenium, bs4, xlwings
violinist.com – Violinist Forum
What:
Read threads from a violinist forum and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Skitrab – Ski Tours
What:
Read store-information for all locations with name, hours, description, name, phone, address
Used Modules:
requests, xlwings, api
Zagskis – Ski Stores
What:
Collect the information for all stores and provide the data in an excel-sheet
Used Modules:
selenium, xlwings
HomeDepot – Appliance Store
What:
Read model-numbers for appliances and find the actual price and link for the product
Used Modules:
selenium, bs4, xlwings
Resale – Machine Selling
What:
Collect machinery companies and their contact person, phone, address for different categories
Used Modules:
selenium, bs4, xlwings
WLW – B2B Platform
What:
Collect data for companies with searchwords as input and find emails additonal. Input will be the link to search – Output in excel
Used Modules:
selenium, bs4, xlwings, valueserp, emailfinder
OGDB – German Gaming DB
What:
Collect data from a online gaming database with different informations about the titles and the development studios
Used Modules:
selenium, bs4, xlwings
Oregon Liquor – US Liquor Store
What:
Get data from a Liquor Store for different cataegories with description, size, price and store locations with city, address, phone etc.
Used Modules:
selenium, bs4, xlwings
Zillow – US Real Estate
What:
Collect real estate data for a specific region and price range – return price, beds, batchrooms, heating, agent information, etc.
Used Modules:
selenium, bs4, xlwings, smartproxy
Linkedin – Social Career
What:
Get name+company and find linkedin-profile with title
Used Modules:
requests, valueserp, xlwings
Yamaha – Motorsport
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Stepstone – Job Searching
What:
Read job-profiles on stepstone for a specific role and location – output the profile contact informations in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Comparis – Doctors Switzerland
What:
Create a list of of pathologists in switzerland
Used Modules:
selenium, bs4, xlwings
11880 – German Industry
What:
Create a list of of pathologists in switzerland
Used Modules:
selenium, bs4, xlwings
AKV – Austrian Insolvencies
What:
Collect insolvencies from a website with different informations
Used Modules:
selenium, bs4, xlwings
Chrono24 – UK Chrono Watches
What:
Read watch-prices from different countries and build the average price for every model
Used Modules:
selenium, bs4, xlwings
Rockauto – US Car Parts
What:
Provide car informations for different brands with year and model description
Used Modules:
selenium, bs4, xlwings
MyDealz – German Deals
What:
Read the shopping dealz from the website and update an excel-sheet
Used Modules:
selenium, bs4, xlwings
Crowdbotics – Code Packages
What:
Collect text data from a website and put the scraped text in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Indeed – Jobs in Austria
What:
Read all listed jobs for a specific searchstring and provide all the data including a optional detailed description in excel
Used Modules:
selenium, bs4, xlwings
CarsAndBids – Car Auctions US
What:
Check car bids from finished auctions and update the information in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Kawasaki – Vehicles
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Creditcards – Reward Cards
What:
Scrape data for reward credit cards informations like bonuses, annual fees, cashback and other benefits
Used Modules:
selenium, bs4, xlwings
Great Schools – Find Ratings
What:
Search for schools in colorado for a specfic area an provide some info like address, email, phone in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Camping – Places Germany
What:
Collect camping places in germany with data like address, places, energy, dogs allowed, wlan, etc.
Used Modules:
selenium, bs4, xlwings
Realtor – US Estates
What:
Collect data from the realtor website for a specific area and provide data like address, price, beds, baths, sqfts, etc.
Used Modules:
selenium, bs4, xlwings, scrapeops API
Audible – Audiobooks Ratings
What:
Read data from audible and check the rating informations for the different audiobooks and and provide the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
NSE India – Stock Prices
What:
Get stockdata from nseindia with price, buy quantity, sell quantity
Used Modules:
selenium, bs4, xlwings
Arctic Cat – Motor Parts
What:
Collect data for brand, year and model and output the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings
Sofascore – Sport Statistics
What:
Collect football statistics from previous games, teams, results, goals, etc.
Used Modules:
selenium, bs4, xlwings
Parkopedia – Worldwide Parking
What:
Collect parking informations all over the world
Used Modules:
selenium, bs4, xlwings
Trulia – Images Real Estates
What:
Read and store all images from a real estatet posting on trulia.com
Used Modules:
selenium requests, bs4, xlwings
United Rentals – Rent Equipment
What:
Collect data for a specific postcode for renting working equipment and vehicles
Used Modules:
selenium, bs4, xlwings, undetected chromedriver
Odds Portal – Football Quotes
What:
Scrape data from betting portal for football-season and different quotes
Used Modules:
selenium, bs4, xlwings
About Payments – Payments
What:
Collect data for paying providers with different infos like cards and countries
Used Modules:
selenium, bs4, xlwings
Gesund.de – Doctors Germany
What:
Scrape data for doctors like email, name, address, website, specialization
Used Modules:
selenium, bs4, xlwings
Coinmarketcap – Crypto Coins
What:
Read coin-information and buidl a historical comparison for price, marketcap, etc.
Used Modules:
selenium, bs4, xlwings
Futurepedia – AI Tools
What:
Collect data from the AI-directory for name, website, price, descrition, labels, etc.
Used Modules:
selenium, bs4, xlwings
Handelsblatt – Business News DE
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Profishop – Swiss Sanitary
What:
Get data from profishop like title, image, description, article-number, technical details
Used Modules:
selenium, bs4, xlwings
Ringschuh – Shoe Retailer AT
What:
Get data for the shops from ringschuh with address, email, website, phone, etc.
Used Modules:
selenium, bs4, xlwings
IProperty – Properties Malaysia
What:
Get data for properties in Malaysia with locatoin, price, beds, baths, parking, images, etc.
Used Modules:
selenium, bs4, xlwings
Yellow Pages ZA – South Africa
What:
Get business from south africa from the yellow page with name, location, website, emails, etc.
Used Modules:
selenium, bs4, xlwings
Yahoo Finance – Financial Data
What:
Read data for stocks from a txt-input file and output the data in a csv-file
Used Modules:
csv, yahooquery
Twitter – Search Data
What:
Read data for a twitter-search with name, profileimage, link, text, etc.
Used Modules:
selenium, bs4, xlwings
Golem – Tech News DE
What:
Login to the site and check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Tanami – Real Estate Dubai
What:
Collect data from real estate projects in Saudi Arabia with overview, amenities, payment plans, location maps, master plans, floor plans, images galleries, etc.
Used Modules:
selenium, bs4, xlwings
Cumhuriyet – News Turkey
What:
Check the text of all available articles for date, text and content
Used Modules:
selenium, bs4, xlwings
Amazon – Discount Products
What:
Provide all products which have discounts on Amazon for a specific link and provide price, old-price, discount
Used Modules:
selenium, bs4, xlwings
Ebay – Product Combinations
What:
Check prices for all possible combinations of an ebay-add with link, price, combination
Used Modules:
selenium, bs4, csv
SteamDB – Games Wishlist
What:
Collect games wishlist-data with name, followers, release date, developer, images, description, etc.
Used Modules:
octoparse
Stockanalysis – Financial Data
What:
Read data for stocks from a txt-input file using proxies and output the data in a csv-file
Used Modules:
selenium, bs4, csv, buyproxies.org
Liquipedia – ESports Players
What:
Scrape player data for different esport-gams with playername, age, team, country, twitter, instagram, etc. images, description, etc.
Used Modules:
selenium, bs4, csv
Numerade – Video Lessons
What:
Collect data from video-lessons with book, author, edition, chapter, question, etc.
Used Modules:
selenium, bs4, xlwings
Marketbeat – Financial Data
What:
Read data for stocks from a txt-input file using proxies and output the data in a csv-file
Used Modules:
selenium, bs4, csv, buyproxies.org
CostPlusDrugs – Online Medication
What:
Read price data for the different kinds of medication regarding form, strength, volume, quantity
Used Modules:
xlwings, selenium, bs4
Meet.Barcelona.Cat – Unlicensed tourist flats
What:
Read excel-sheet with street names and check for unlicensed tourist flats in Barcelona
Used Modules:
xlwings, selenium, bs4
Hublot – Watches
What:
Update prices from Hublot and checking the price deviaton to Bitcoin including currency exchange between CHF and USD
Used Modules:
xlwings, selenium, bs4, currency_converter, yahooquery
TCDb – Trading Card Database
What:
Collect data for Baseball and Basketball cards for year, player, team, set
Used Modules:
xlwings, selenium, bs4
Housing Anywhere – Rent Rooms
What:
Gather data for different spanish cities and provide data for the rooms like price, type, bedrooms, availibility
Used Modules:
xlwings, selenium, bs4
OpenPath – Find Psychotherapists
What:
Find information about Psychoterapists with name, skills, expertise, location, availibility, finances, qualifications, client focus, etc.
Used Modules:
xlwings, selenium, bs4
Military Relocation Pro
What:
Find Military relocation proffesionals for different states and bases with address, phone,m website, name, informations
Used Modules:
xlwings, selenium, bs4
ImportInfo – US Customs Import
What:
Get infos about US Customs Import Companies with Email Contacts, Bills of Lading, Activity by Port, Phone Numbers, etc.
Used Modules:
xlwings, selenium, bs4
Trusted Shops Germany
What:
Collect data from trusted shops with detailed informations, rating, emails, website, etc.
Used Modules:
selenium, bs4, xlwings
Available Sizes – Shoe Shop
What:
Check available sizes of shoes and prices and make some calculations
Used Modules:
selenium, bs4, xlwings, scrapeops.io
Auction – Property Data
What:
Collect some property data from auctions and put the data in an excel-sheet
Used Modules:
selenium, bs4, xlwings, scrapeops.io
Buildings Data – Manually Choosen
What:
Scrape buildings data for specific areas which are manually choosen in the browser
Used Modules:
selenium, bs4, xlwings
Shoes, Prices And Sizes
What:
Check available sizes of shoes and prices and make some calculations
Used Modules:
selenium, bs4, xlwings
Prices For Lego Sets
What:
Check prices for lego-sets and compare them with actual prices from bricklink.com
Used Modules:
selenium, bs4, xlwings, progress
Check New Adds And Alert
What:
Check for new adds and send email with the new links and running the program in the cloud
Used Modules:
selenium, bs4, email, progress, pythonanywhere
Stock-Info From BarChart
What:
Read information from stocks like Sales, NetIncome, Cashflow, etc. and output to excel
Used Modules:
selenium, bs4, xlwings
AirBNB
What:
Collect data from AirBNB
Used Modules:
selenium, bs4, xlwings
SuperATV
What:
Collect data from SuperATV
Used Modules:
selenium, bs4, xlwings, dataimpulse
Booking.com
What:
Collect data from booking.com
Used Modules:
selenium, bs4, xlwings
Integral-Led
What:
Collect data from Integral-led.com and download all images locally
Used Modules:
selenium, bs4, xlwings, requests
WikiArt (s)
What:
Collect Images from different Artitsts and download the images locally
Used Modules:
selenium, bs4, xlwings, requests
