Skip to end of metadata
Go to start of metadata

CDI Monthly Meeting - 20190508

The Community for Data Integration (CDI) meetings are held the 2nd Wednesday of each month from 11:00 a.m. to 12:30 p.m. Eastern Time.


Meeting Recording

Meeting recordings are available to CDI Members approximately 24 hours after the completion of the meeting. Please log in to view the recording. If you would like to become a member of CDI, email cdi@usgs.gov.

Agenda (in Eastern time)

11:00a Introduction: Member Recommendations

11:05a Welcome CDI_20190508_OpeningSlides.pdf

11:15a Working Group Announcements

11:25a ICE! Ice Jam Hazard Mobile-Friendly Website - Hans Vraga and Kathy Chase, USGS

11:40a Investigation of Lidar Data Processing and Analysis in the Cloud - Jessica Walker, USGS

11:55a OpenTopography: Long tail topographic data management with the Community Dataspace - Chris Crosby, UNAVCO 

12:30p  Adjourn

Abstracts

ICE! Ice Jam Hazard Mobile-Friendly Website - Hans Vraga and Kathy Chase, USGS

Ice jams are a major hazard. The project team worked with the US Army Corps of Engineers, National Weather Service, Silver Jackets, and USGS stakeholders to develop a mobile-friendly prototype of an Ice Jam Hazard website and reporting system.  The prototype shows how ice jam conditions can be recorded nationwide. The public can view and download ice jam information. Historic ice jam locations and frequencies, as well as potentially hazardous developing ice jams, are valuable data. Given the science, modeling, and hazard warning potential provided by this data, continued development of this system is widely supported.

The prototype system consists of an Angular-Material framework javascript client hosted on Amazon Web Services (AWS) Simple Storage Service, .Net Core web services deployed using containerization on AWS Fargate, and an AWS Relational Database Service PostgreSQL instance. This cloud-first system enriches the collective USGS experience in working with the latest cloud technologies.

Client code repository: https://github.com/USGS-WiM/ice-jams

Services code repository: https://github.com/USGS-WiM/IceJamsservices


Investigation of Lidar Data Processing and Analysis in the Cloud - Jessica Walker, USGS


OpenTopography: Long tail topographic data management with the Community Dataspace - Chris Crosby, UNAVCO 

OpenTopography facilitates community access to high-resolution, Earth science-oriented, topography data, and related tools and resources. This talk will provide an overview and then describe upload and archiving for small to moderate sized topographic datasets in the Community Dataspace.

https://opentopography.org/

Presentations

Presentation: Slides are available to CDI Members. Please log in to download the slides. If you would like to become a member of CDI, email cdi@usgs.gov.

Highlights

  1. Links from the introduction
    1. Data Science in R resources: https://github.com/rafalab/ds4stats
    2. From the March Reading List post: https://my.usgs.gov/confluence/x/n5QcJQ
    3. Natural Language Processing and Text Mining Methods resources: https://course.spacy.io
    4. From the April Reading List post: https://my.usgs.gov/confluence/x/VJNUJQ
    5. Past CDI-supported tool: Geo Data Portal: https://cida.usgs.gov/gdp/
      1. Form for Geo Data Portal interest (serving large, structured, gridded data): https://docs.google.com/forms/d/e/1FAIpQLSetDP_HcKJpQ1NoKmelXA1MPSpngdP1v9z2G1YnuTsE6dyYYg/viewform
    6. Everything about the workshop:

      https://my.usgs.gov/confluence/display/cdi/2019+CDI+Workshop

    7. FY19 Funded Projects

      https://www.usgs.gov/center-news/congratulations-2019-cdi-funded-projects
  2. From lahmed : What tools would you recommend processing LiDAR such as point classficiation or applying filters?
    1. hudnut : PDAL
    2. Jason Stoker : https://sites.google.com/a/usgs.gov/usgs-lidar-science-collaboration/home
    3. Crosby : http://opentopo.sdsc.edu/tools/listTools
  3. Ice Jams
    1. On your map, I noticed you don't have a station at/near Niagara Falls. Will you be collaborating with people in that area in the future?
      1. The current map is populated with "example" data, however the group does have some connections with people working in that area.
    2. Will the USACE database be populated into the Ice Jam App?
      1. That is the plan.
  4. Lidar - Walker
    1. Rich Signell : Would you say that entwine is a cloud-friendly format? Can you say a bit more about entwine?
    2. Amber Wittner (GMEGSC) : About I3S: https://www.opengeospatial.org/standards/i3s
    3. Aaron Johnston : Has anyone tried processing lidar data in Google Earth Engine?  
      1. Jess has heard that the GEE platform is not the best for point cloud data.
  5. Lidar - Crosby
    1. How do you manage tiling of this wide variety of size of datasets?
    2. Will opentopo ‘power user’ limits be increased at some point?
      1. They plan to, but it is difficult, being a completely open system with finite resources.
    3. rviger : inclusion of TauDEM is exciting. Is there planning or discussion about expanding the breadth of geoprocessing functionality that might be available? Or a plan for federating geoprocessing services with opentopography.org data services?
      1. That's in the plan.
    4. hudnut : The vertical differencing is a nice feature - what is the status of adding 3D differencing?
      1. We are working on it!

Attendees

A Participant Report is available to CDI Members. Please log in to download the report. If you would like to become a member of CDI, email cdi@usgs.gov.