Reason Rust Scraper
This is a code repository for implementing how to scraping and crawling websites using Rust, and ReasonML. This project was created by me with the aim of being a tools in my company i work. However, because of the sudden change of ideas and concepts finally i make it like this hehe, as well as my first project when learning & use ReasonML.
If you have never heard of scraping, try to read this web scraping for more information.
Requirements
Server
Client
Getting started
- Clone this repo
- Start Apache & MySQL server
- Create new database and
.env
file and set config, like this .env npm install
to install all req'd dependencies
Running
To running this project locally:
- For MacOS, and you have a iTerm. You can running easily, type this command
$ sudo chmod +x ./run.sh && ./run.sh
- Or, you can running manually, for client side:
$ npm start
- Open a new terminal tab/window, and type this command:
$ npm server
- Open a new terminal tab/window again, for running server side:
$ cargo run
- Open in you browser http://localhost:8000/
Testing
$ sudo chmod +x ./test.sh && ./test.sh
Build
Client:
$ npm run build
Server:
$ cargo build
Contributing
Pull requests are welcome. For major changes, please:
- Create issues and PRs - bugs, missing documentation, typos, unreadable code...
- Make sure to update tests as appropriate