Python and Pyspark Tips for Data Scientist

𝐖𝐡𝐚𝐭?

The book focuses on Python and Pyspark Tips for Data Scientist, and includes the following topics:

• Setup python on local computer or on cloud
• Connect with database
• Working with AWS S3
• Python primer function
• Data Structures: List, Tuple, Dictionary
• pandas.DataFrame vs PySpark DataFrame
• Package Wrapper
• Model Deployment with Flask
• API Book
• Online machine learning Courses and Useful Websites

𝐑𝐞𝐬𝐨𝐮𝐫𝐜𝐞𝐬 📚

• 𝐎𝐧𝐥𝐢𝐧𝐞 𝐯𝐞𝐫𝐬𝐢𝐨𝐧: https://runawayhorse001.github.io/PythonTipsDS
• 𝐏𝐃𝐅 𝐯𝐞𝐫𝐬𝐢𝐨𝐧: https://runawayhorse001.github.io/PythonTipsDS/pythonTipsDS.pdf
• 𝐒𝐨𝐮𝐫𝐜𝐞 𝐜𝐨𝐝𝐞: https://github.com/runawayhorse001/PythonTipsDS

Authors

Wenqiang Feng, Ph.D. and Jing Yang, Ph.D.

B𝐨𝐨𝐤 𝐟𝐨𝐫 𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤 (by Wenqiang Feng, Ph.D.)

If you are interested to learn data science with 𝐀𝐩𝐚𝐜𝐡𝐞 𝐒𝐩𝐚𝐫𝐤 𝒘𝒊𝒕𝒉 𝐏𝐲𝐒𝐩𝐚𝐫𝐤, I recommend you to check 𝑻𝒉𝒆 𝑳𝒆𝒂𝒓𝒏𝒊𝒏𝒈 𝑨𝒑𝒂𝒄𝒉𝒆 𝑺𝒑𝒂𝒓𝒌 𝒘𝒊𝒕𝒉 𝑷𝒚𝒕𝒉𝒐𝒏 by Wenqiang Feng, Ph.D. 🚀

𝐖𝐡𝐚𝐭?

The book focuses on the core data science applications of Apache Spark with PySpark, and includes the following topics:

• Introduction to Spark
• Working and exploring data
• Core stats and ML - regression, classification, clustering
• Text mining and social media analysis
• Monte Carlo and MCMC simulation
• Neural network
• Working with Spark wrappers

𝐑𝐞𝐬𝐨𝐮𝐫𝐜𝐞𝐬 📚

• 𝐎𝐧𝐥𝐢𝐧𝐞 𝐯𝐞𝐫𝐬𝐢𝐨𝐧: https://runawayhorse001.github.io/LearningApacheSpark/index.html
• 𝐏𝐃𝐅 𝐯𝐞𝐫𝐬𝐢𝐨𝐧: https://runawayhorse001.github.io/LearningApacheSpark/pyspark.pdf
• 𝐒𝐨𝐮𝐫𝐜𝐞 𝐜𝐨𝐝𝐞: https://github.com/runawayhorse001/LearningApacheSpark