All Projects → aaronpenne → Get_noaa_ghcn_data

aaronpenne / Get_noaa_ghcn_data

Licence: mit
A tool to interface with and download Global Historical Climatology Network (GHCN) data into easily readable CSVs.

Programming Languages

python
139335 projects - #7 most used programming language

Projects that are alternatives of or similar to Get noaa ghcn data

Xweather
A weather app for iOS and Android built with Xamarin
Stars: ✭ 62 (-25.3%)
Mutual labels:  weather
Mahapps.metro.iconpacks
Awesome icon packs for WPF and UWP in one library
Stars: ✭ 1,157 (+1293.98%)
Mutual labels:  weather
Downloads
AD Health Check, Send HTML Email, Ping machines, Encrypt Password,Bulk Password,Microsoft Teams,Monitor Certificate expiry, Monitor cert expiry, AD attributes, IP to Hostname, Export AD group, CSV to SQL,Shutdown, Restart, Local Admin, Disk Space, Account expiry,Restore Permissions, Backup permissions, Delete Files Older Than X-Days, export DHCP options,Read Registry,Distribution group AD attributes,Monitor Windows Services,Export Reverse DNS,Task Monitor,Monitor and alert, Exchange Health check,Get Network Info, Export AD Attributes,AD group members, Office 365 Group member, SQL to CSV, Outlook save send attachments, Upload files to FTP,Exchange – Total Messages Sent Received, Set Teams Only Mode, Intune Duplicate Device,Intune Cleanup Not Evaluated, Ownership and Grant Permissions, Write Create Modify Registry , Organization Hierarchy from AD,Azure AD Privileged Identity Management,Intune – Export MAM Devices,Intune Marking devices as Corporate, Dynamic to Static Distribution Group,Monitor Alert Office 365 services,Group Member Count,Bulk Addition external users sharepoint, ADD to Exchange online License Group,All in One Office 365 Powershell,Bulk Addition of Secondary Email, Automate move mailboxes to o365, Addition Modification Termination Exchange users, Monitoring Unified Messaging port,Unified Messaging Extensions Report, Set Default Quota for SharePoint,Bulk Contact Creation and Forwarding, Uploading and Downloading files sftp, Monitoring Sftp file and download, Office 365 groups Write back, CSV parser, Email address update, Email address modify, MDM enrollment, Welcome Email, Intune Welcome Email, remove messages, remove email, SKOB to AD, SKOB to group, PowerApps report, Powerautomate Report, Flow report, Server QA, Server Check List, O365 IP range, IP range Monitor, o365 Admin Roles, memberof extraction, CSV to Excel, Skype Policy, UPN Flip, Rooms Report, License Reconciliation,Intune Bulk Device Removal, Device Removal, Clear Activesync, Lync Account Termination,Lync Account Removal, Enable office 365 services, Enable o365 Services, Export PST, Site collection Report, Office 365 Group Sites, System Admin,ActiveSync Report,White Space,Active Directory attributes, outlook automation, Intune Detect App, Distribution list Fix, Legacy DN, start service, stop service, disable service, Message tracking, Distribution lists report,Distribution groups report,Quota Report, Auto reply, out of office, robocopy multi session, Home Folder, local admin, Database, UPN SIP Mismatch, Recoverable deleted, teams number, Number assignment, teams phone, AD Group Hierarchy, Hierarchy membership, Sync Groups
Stars: ✭ 75 (-9.64%)
Mutual labels:  ftp
Air
Mac menu bar app to track Air Quality
Stars: ✭ 63 (-24.1%)
Mutual labels:  weather
Bash Snippets
A collection of small bash scripts for heavy terminal users
Stars: ✭ 8,558 (+10210.84%)
Mutual labels:  weather
Flask weather
☀️ ☔️ Flask app to auto-detect local weather based off of user's IP address.
Stars: ✭ 70 (-15.66%)
Mutual labels:  weather
Sanchez
False-colour geostationary satellite image compositor
Stars: ✭ 61 (-26.51%)
Mutual labels:  weather
Homebridge Weather
OpenWeatherMap Plugin for Homebridge
Stars: ✭ 78 (-6.02%)
Mutual labels:  weather
Rwunderground
A simple R package to get historical and forecast weather data
Stars: ✭ 68 (-18.07%)
Mutual labels:  weather
Gsodr
Global Surface Summary of the Day ('GSOD') Weather Data Client for R
Stars: ✭ 72 (-13.25%)
Mutual labels:  weather
Cyberduck
Cyberduck is a libre FTP, SFTP, WebDAV, Amazon S3, Backblaze B2, Microsoft Azure & OneDrive and OpenStack Swift file transfer client for Mac and Windows.
Stars: ✭ 1,080 (+1201.2%)
Mutual labels:  ftp
Knowweather
一款美观、实用的天气app。实践了模块化架构 和 Android Architecture Components
Stars: ✭ 1,138 (+1271.08%)
Mutual labels:  weather
Xygrib
This is the new home for the development of zyGrib
Stars: ✭ 70 (-15.66%)
Mutual labels:  weather
Vscode Sftp
Super fast sftp/ftp extension for VS Code
Stars: ✭ 1,121 (+1250.6%)
Mutual labels:  ftp
Fake ftp
A fake FTP server for use with ruby tests
Stars: ✭ 77 (-7.23%)
Mutual labels:  ftp
Easyweather
这是一款基于MD设计的Android天气App。提供查询任意城市天气,获取所在城市天气等功能。
Stars: ✭ 61 (-26.51%)
Mutual labels:  weather
Dark Sky Api
PHP Library for the Dark Sky API.
Stars: ✭ 70 (-15.66%)
Mutual labels:  weather
Darksky
Python API wrapper for the DarkSky (async&sync)
Stars: ✭ 81 (-2.41%)
Mutual labels:  weather
Pyftpdlib
Extremely fast and scalable Python FTP server library
Stars: ✭ 1,209 (+1356.63%)
Mutual labels:  ftp
Aix Weather Widget
Graph weather widget for Android
Stars: ✭ 70 (-15.66%)
Mutual labels:  weather

Get NOAA GHCN Data

This tool functions as an interface to the extensive weather data in the NOAA GHCN database. No manually digging through the FTP server or going through Google Big Query, just directly download your station's weather from the command line.

Screen capture of program usage.

get_noaa_ghcn_data.py

Run this tool from the command line to:

  • Search for a Global Historical Climatology Network (GHCN) station ID using plain text
  • Download a station's daily weather data in raw .dly format
  • Download a station's daily weather data in a reformatted .csv for easy analysis

The format of each station's daily measurements are fixed width files with one row per month per element, and multiple columns for the days:

    ------------------------------
    Variable   Columns   Type
    ------------------------------
    ID            1-11   Character
    YEAR         12-15   Integer
    MONTH        16-17   Integer
    ELEMENT      18-21   Character
    VALUE1       22-26   Integer
    MFLAG1       27-27   Character
    QFLAG1       28-28   Character
    SFLAG1       29-29   Character
    VALUE2       30-34   Integer
    MFLAG2       35-35   Character
    QFLAG2       36-36   Character
    SFLAG2       37-37   Character
      .           .          .
      .           .          .
      .           .          .
    VALUE31    262-266   Integer
    MFLAG31    267-267   Character
    QFLAG31    268-268   Character
    SFLAG31    269-269   Character

This tool parses all of the station's available data and outputs it with one row per day, and multiple columns for the elements. This is easier to analyze programattically and read, as seen below:

Screenshot of reformatted .csv file

Background

The Global Historical Climatology Network (GHCN) is an integrated database of climate summaries from land surface stations across the globe that have been subjected to a common suite of quality assurance reviews. The data are obtained from more than 20 sources. Some data are more than 175 years old while others are less than an hour old. GHCN is the official archived dataset, and it serves as a replacement product for older NCEI-maintained datasets that are designated for daily temporal resolution

The five core elements (measurements) are:

  • PRCP = Precipitation (tenths of mm)
  • SNOW = Snowfall (mm)
  • SNWD = Snow depth (mm)
  • TMAX = Maximum temperature (tenths of degrees C)
  • TMIN = Minimum temperature (tenths of degrees C)

For a full list of possible elements (measurements) see the codebook.

The five core elements which are recorded by most stations are precipitation, snow, snow depth, max temp, and min temp. There are several other attributes that may or may not be recorded in each station's dataset including: average cloudiness, average daily wind direction, average daily wind speed, water evaporation, time of fastest wind, frozen ground layer depth, water depth gauge heights, evaporation pan water temperature, percent of day that is sunshine, soil temp, soil type, ice thickness, direction of fastest winds, weather type, multiday measurements, and number of days included in multiday measurements. There are also flags indicating measurement details, quality details, and the source agency of the measurement.

Dependencies

Developed with Python 3.6 on Windows 10.

License

MIT License © Aaron Penne

Disclaimer: This project is not affiliated with NOAA or GHCN in any way.

Note that the project description data, including the texts, logos, images, and/or trademarks, for each open source project belongs to its rightful owner. If you wish to add or remove any projects, please contact us at [email protected].