GitPlanet

Cheap and reliable Node.js hosting starts at $3/month, and $1/month static HTML hosting

Created with love in Canada, visit hostnodejs.com today

Feel like to post an Ad? Learn Details
All Projects → Diggernaut → Configs

Diggernaut / Configs

Licence: mit
Public, free to use, repository with diggers configs for scraping / extracting data from various e-commerce websites and online stores

Labels

ecommercescrapingetlwebscraping

Projects that are alternatives of or similar to Configs

browser-automation-api
Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other things like capture a screenshot, generate pdf, extract content or execute custom Puppeteer, Playwright functions.
Stars: ✭ 24 (-35.14%)
Mutual labels:  scraping, webscraping
ioweb
Web Scraping Framework
Stars: ✭ 31 (-16.22%)
Mutual labels:  scraping, webscraping
Django Dynamic Scraper
Creating Scrapy scrapers via the Django admin interface
Stars: ✭ 1,024 (+2667.57%)
Mutual labels:  scraping, webscraping
Autoscraper
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Stars: ✭ 4,077 (+10918.92%)
Mutual labels:  scraping, webscraping
ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-020-03726-9
Stars: ✭ 68 (+83.78%)
Mutual labels:  scraping, webscraping
anime-scraper
[partially working] Scrape and add anime episode stream URLs to uGet (Linux) or IDM (Windows) ~ Python3
Stars: ✭ 21 (-43.24%)
Mutual labels:  scraping, webscraping
Dotnetcrawler
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Stars: ✭ 100 (+170.27%)
Mutual labels:  scraping, webscraping
chesf
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
Stars: ✭ 18 (-51.35%)
Mutual labels:  scraping, webscraping
schedule-tweet
Schedules tweets using TweetDeck
Stars: ✭ 14 (-62.16%)
Mutual labels:  scraping, webscraping
Gazpacho
🥫 The simple, fast, and modern web scraping library
Stars: ✭ 525 (+1318.92%)
Mutual labels:  scraping, webscraping
Woocommerce
An open source eCommerce plugin for WordPress.
Stars: ✭ 7,473 (+20097.3%)
Mutual labels:  ecommerce
Sig To Googlecalendar
A python script to get class schedules on UFLA's SIG and convert to a .CSV file to use in Google Calendar
Stars: ✭ 14 (-62.16%)
Mutual labels:  webscraping
Oc Shop Plugin
An ecommerce platform for October CMS.
Stars: ✭ 29 (-21.62%)
Mutual labels:  ecommerce
Ecommerce
We're going to take you step-by-step to build a modern, fully open-source, eCommerce web application using Python, Django, Bootstrap, Javascript, and more.
Stars: ✭ 980 (+2548.65%)
Mutual labels:  ecommerce
Syliusmercanetbnpparibasplugin
BnpParibas Mercanet payment gateway for Sylius based applications.
Stars: ✭ 12 (-67.57%)
Mutual labels:  ecommerce
Ecommerce
A powerful and lightweight eCommerce platform using ReactJs, Graphql, PHP, and Mysql.
Stars: ✭ 28 (-24.32%)
Mutual labels:  ecommerce
Dswarm Backoffice Web
The backoffice web application of d:swarm (https://github.com/dswarm/dswarm-documentation/wiki)
Stars: ✭ 11 (-70.27%)
Mutual labels:  etl
Tuna
🐟 A streaming ETL for fish
Stars: ✭ 11 (-70.27%)
Mutual labels:  etl
Django Ecommerce
An e-commerce website built with Django
Stars: ✭ 861 (+2227.03%)
Mutual labels:  ecommerce
Connect Java Sdk
Java client library for the Square Connect v2 API
Stars: ✭ 36 (-2.7%)
Mutual labels:  ecommerce
View All Similar Projects ➔

configs

Public, free to use, repository with diggers configs for web scraping various e-commerce websites and online stores

All configs can be used with Diggernaut service to retrieve products information.

  1. You need to create free account at Diggernaut
  2. Login to your account
  3. Create a project with any name and description you want
  4. Get into your new project by clicking it and create new digger with any name
  5. Then you will see 3 options suggested to you, you need to use one where you will use meta-language
  6. Config editor will open and you can simply copy and paste config code and click on save button.
  7. Switch mode for digger from Debug to Active and then run your digger.
  8. Wait for completion.
  9. Download data.
  10. Schedule your runs if required.

List of sites:

  1. abercrombie.com
  2. adidas.com
  3. adidashardware.com
  4. ae.com
  5. alexandermcqueen.com
  6. americanapparel.net
  7. anntaylor.com
  8. anthropologie.com
  9. asos.com
  10. athleta.gap.com
  11. avito.ru
  12. bananarepublic.gap.com
  13. bedbathandbeyond.com
  14. benmeadows.com
  15. betseyjohnson.com
  16. bloomingdales.com
  17. burton.com
  18. cabelas.com
  19. calypsostbarth.com
  20. cartier.com
  21. chanel.com
  22. covergirl.com
  23. debshops.com
  24. desigual.com
  25. diesel.com
  26. dior.com
  27. donnakaran.com
  28. dwell.co.uk
  29. eddiebauer.com
  30. eloquii.com
  31. esteelauder.com
  32. faithfullthebrand.com
  33. farfetch.com
  34. ferragamo.com
  35. footlocker.com
  36. forever21.com
  37. freepeople.com
  38. gap.com
  39. gapfactory.com
  40. gentrynyc.com
  41. gilt.com
  42. global.tommy.com
  43. guess.com
  44. guessbymarciano.guess.com
  45. happysocks.com
  46. hermanmiller.com
  47. hermes.com
  48. hm.com
  49. hollisterco.com
  50. hugoboss.com
  51. ikea.com
  52. jaanuu.com
  53. jcrew.com
  54. joesjeans.com
  55. johnstonmurphy.com
  56. johnvarvatos.com
  57. romwe.com
  58. patagonia.com
  59. vans.com

To be released:

  1. karenwalker.com
  2. karl.com
  3. katespade.com
  4. kennethcole.com
  5. kohls.com
  6. lancome-usa.com
  7. levi.com
  8. llbean.com
  9. lornajane.de
  10. lululemon.com
  11. macys.com
  12. mango.com
  13. marcjacobs.com
  14. marketplace.asos.com
  15. matthewwilliamson.com
  16. maybelline.com
  17. michaelkors.com
  18. nastygal.com
  19. nautica.com
  20. neimanmarcus.com
  21. nike.com
  22. nordstrom.com
  23. oldnavi.gap.com
  24. onekingslane.com
  25. paulsmith.com
  26. pier1.com
  27. potterybarn.com
  28. quiksilver.com
  29. rainbowshops.com
  30. ralphlauren.com
  31. ralphlaurenhome.com
  32. rei.com
  33. revlon.com
  34. revolve.com
  35. riverisland.com
  36. roomandboard.com
  37. rue21.com
  38. scotch-soda.com
  39. sephora.com
  40. shopbop.com
  41. eastdane.com
  42. sonos.com
  43. stellamccartney.com
  44. stevemadden.com
  45. style.com
  46. sunglasshut.com
  47. superdry.com
  48. surlatable.com
  49. target.com
  50. tedbaker.com
  51. timberland.com
  52. tomford.com
  53. topman.com
  54. topshop.com
  55. toysrus.com
  56. uk.tommy.com
  57. underarmour.com
  58. uniqlo.com
  59. urbanoutfitters.com
  60. us.benetton.com
  61. us.burberry.com
  62. us.louisvuitton.com
  63. us.nextdirect.com
  64. us.shein.com
  65. valentino.com
  66. versace.com
  67. victoriassecret.com
  68. vineyardvines.com
  69. walmart.com
  70. westelm.com
  71. whitehouseblackmarket.com
  72. williams-sonoma.com
  73. ysl.com
  74. zalando.de
  75. zappos.com
  76. zara.com
  77. zarahome.com
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].