All Projects → zhoutk → Gotools

zhoutk / Gotools

Licence: mit
create some tools use go lang.

Programming Languages

go
31211 projects - #10 most used programming language
golang
3204 projects

Projects that are alternatives of or similar to Gotools

Hfish
安全、可靠、简单、免费的企业级蜜罐
Stars: ✭ 2,977 (+5412.96%)
Mutual labels:  mysql, tools
Zhihuquestionsspider
😊😊😊 知乎问题爬虫
Stars: ✭ 152 (+181.48%)
Mutual labels:  spider, mysql
Zhihuspider
知乎用户公开个人信息爬虫, 能够爬取用户关注关系,基于Python、使用代理、多线程
Stars: ✭ 92 (+70.37%)
Mutual labels:  spider, mysql
Jobs Search
🕷招聘网站爬虫合集,不定期更新分支
Stars: ✭ 111 (+105.56%)
Mutual labels:  spider, mysql
Gormt
database to golang struct
Stars: ✭ 1,063 (+1868.52%)
Mutual labels:  mysql, tools
Oxidtools
200 TOOLS BY 0XID4FF0X FOR TERMUX
Stars: ✭ 143 (+164.81%)
Mutual labels:  mysql, tools
Bilibili member crawler
B站用户爬虫 好耶~是爬虫
Stars: ✭ 115 (+112.96%)
Mutual labels:  spider, mysql
Go Mygen
Quickly generate CURD and documentation for operating MYSQL.etc
Stars: ✭ 94 (+74.07%)
Mutual labels:  mysql, tools
Blog
Jiajun的编程随想
Stars: ✭ 528 (+877.78%)
Mutual labels:  goroutine, mysql
Reading
整理阅读过的干货文章, 帖子
Stars: ✭ 318 (+488.89%)
Mutual labels:  goroutine, mysql
Dumpall
一款信息泄漏利用工具,适用于.git/.svn源代码泄漏和.DS_Store泄漏
Stars: ✭ 250 (+362.96%)
Mutual labels:  spider, tools
Funpyspidersearchengine
Word2vec 千人千面 个性化搜索 + Scrapy2.3.0(爬取数据) + ElasticSearch7.9.1(存储数据并提供对外Restful API) + Django3.1.1 搜索
Stars: ✭ 782 (+1348.15%)
Mutual labels:  spider, mysql
Python Spider
豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章
Stars: ✭ 615 (+1038.89%)
Mutual labels:  spider, mysql
Go spider
A golang spider
Stars: ✭ 25 (-53.7%)
Mutual labels:  goroutine, spider
Cloudmusic
网易云爬虫解决方案
Stars: ✭ 51 (-5.56%)
Mutual labels:  spider
Ddlparse
DDL parase and Convert to BigQuery JSON schema and DDL statements
Stars: ✭ 52 (-3.7%)
Mutual labels:  mysql
Phproutine
PHProutine is goroutines emulation in PHP
Stars: ✭ 50 (-7.41%)
Mutual labels:  goroutine
Aclify
🔒 Node Access Control Lists (ACL).
Stars: ✭ 49 (-9.26%)
Mutual labels:  mysql
Last Statement Of Death Row
Last-Statement-of-Death-Row, 人之将死,其言也善
Stars: ✭ 53 (-1.85%)
Mutual labels:  spider
Xjavafxtool
基于JavaFx搭建的实用小工具集合,方便开发过程中的代码编写与调试,想学习javaFx的同学可以参考参考。其中包括文件复制、Cron表达式生成器、编码转换、加密解密、Time转换、路径转换、二维码生成工具、身份证生成器、正则表达式生成工具、网址缩短、转义字符、字符串转换、Mq调试工具、Http调试工具、json格式化编辑工具、图标生成工具、Redis连接工具、网页源码下载工具、切换Hosts工具、Ftp服务器、Cmd调试工具、Ftp/Ftps/Sftp客户端调试工具、Pdf转换工具、文件列表生成器、图片压缩工具、图片转码工具、Kafka调试工具、Email群发工具、颜色代码转换工具、短信群发工具、脚本引擎调试、文件重命名、Json转换、语音转换、Socket调试、图片解析、微信小程序反编译、Zookeeper操作、Excel拆分合并、文件夹监控、文件编码检测、传输、端口扫描、久坐提醒、随机数生成、剪贴板历史、文件搜索、mp3转换、印章生成等工具
Stars: ✭ 1,063 (+1868.52%)
Mutual labels:  tools

goTools

create some tools use go lang.

  1. mysql exporter
  2. ip spider

1. mysql exporter

a tool can export mysql's table,data,views,function & stored procedure together or independent.

characteristic

  • can export table, data, views, funcs.
  • multi grountinue to export many database together.
  • filter \xfffd.
  • solve the dependence of views.
  • can recieve a cli arg, which must be in table, data, view(s) & func, to export single content.

configs.json

you must create configs.json as:

{
    "db_name1": {
        "db_host": "192.168.1.8",
        "db_port": 3306,
        "db_user": "root",
        "db_pass": "123456",
        "db_name": "name1",
        "db_charset": "utf8mb4",
        "file_alias": "file name1"
    },
    "db_name2": {
        "db_host": "localhost",
        "db_port": 3306,
        "db_user": "root",
        "db_pass": "123456",
        "db_name": "name2",
        "db_charset": "utf8mb4"
    },
    "database_dialect": "mysql",
    "workDir": "/home/zhoutk/gocodes/goTools/"
}

Instructions

git clone https://github.com/zhoutk/goTools
cd goTools
go get
go run main.go

go buid main.go
./main                  #export all things of database
./main table            #export tables
./main data             #export tables & data
./main views            #export views
./main funcs            #export funcs & stored procedures

2. ip spider

a tool can spider ip address info from appointed web page.

characteristic

  • multi grountinue to spider web data.
  • write mysql batch.
  • update mysql batch.

sql scripts

you can create table use it:

CREATE TABLE `ip_addr_info` (
  `id` int(11) NOT NULL AUTO_INCREMENT COMMENT '索引,自动增长',
  `ip_addr_begin` varchar(32) NOT NULL DEFAULT '' COMMENT 'ip地址段开始',
  `ip_addr_end` varchar(32) DEFAULT '' COMMENT 'ip地址段结束',
  `province` varchar(32) DEFAULT '' COMMENT '所属省',
  `ip_comp` varchar(32) DEFAULT '' COMMENT '运营商',
  PRIMARY KEY (`id`),
  UNIQUE KEY `ip_addr` (`ip_addr_begin`,`ip_addr_end`)
) ENGINE=InnoDB AUTO_INCREMENT=7268 DEFAULT CHARSET=utf8 COMMENT='表';

Instructions

git clone https://github.com/zhoutk/goTools
cd goTools
go get
go run ip.go

go buid ip.go
./ip 

3. rest server

A framework for building micro service rapidly, safely & efficiently.

characteristic

  • auto orm that can build sql from json object.
  • standard sql interface.
  • auto restful api serivce according to sql struct.

Instructions

git clone https://github.com/zhoutk/goTools
cd goTools
go get
go run bock.go

go buid bock.go
./bock
Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].