Confluence Retirement

Due to the feedback from stakeholders and our commitment to not adversely impact USGS science activities that Confluence supports, we are extending the migration deadline to January 2023.

In an effort to consolidate USGS hosted Wikis, myUSGS’ Confluence service is targeted for retirement. The official USGS Wiki and collaboration space is now SharePoint. Please migrate existing spaces and content to the SharePoint platform and remove it from Confluence at your earliest convenience. If you need any additional information or have any concerns about this change, please contact myusgs@usgs.gov. Thank you for your prompt attention to this matter.

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Two way tight coupled atmosphere-Ocean? ie. feedback and convergence at every timestep?
    1. Every few minutes, there is a chance for some elements to affect others.
  2. Where can I go to learn more about EarthMAP?
    1. USGS Director's Science Planning Strategy (EarthMap!)
    2. More information rolling out in March
    3. The CHS Help Center article for Pangeo is located at this link https://support.chs.usgs.gov/x/OwA1Ag
  3. Why do you think that the Pangeo instance of community-driven software has been successful? Isn't it hard to get contributors usually?
    1. Ryan Abernathy has championed Pangeo. Started with big ideas and goals, got government people and commercial people on board from the beginning. Approachable and open. Not developing something to try and sell. 
  4. I've heard that you can use Pangeo even if you don't work with big data - is that true? why? how?
    1. If you're interested in machine-learning, or using Google Earch engine, Pangeo provides a cloud-agnostic way of doing the same kinds of workflows. 
  5. you mentioned costs are free for moving data within region. Who do we talk to about that type of issue?
    1. Reach out to CHS. report.chs.ugs.gov - request support
    2. EROS will be developing some help documentation for accessing Landsat as we start publicizing data availability from USGS
  6. Is there a good start up guide to Pangeo for Matlab users who’re interested in transitioning to some of these python tools? 
    1. Most Matlab users find the Python language structure fairly similar/accessible.  Of course the vocab is different, which is tough.   There are some sites that try to help: https://realpython.com/matlab-vs-python/
  7. Or even better, can these tools be tapped through using Matlab commands via Jupyter notebooks?
    1. Octave, the free version (and reduced functionality version) of Matlab can work with Jupyter.  We would have to enable that capability on pangeo.chs.usgs.gov if there was sufficient interest.
  8. What is level 1 vs level 2 processing?
    1. For Landsat, a Level-1 product is a top of atmosphere product, where a Level-2 will apply atmospheric corrections to get closer to surface reflectance for better scientific analysis. For more information on Landsat Collections and Levels, see the Landsat Missions Website.
  9. When is the next Pangeo crash course/training available?
    1. Workshop in Flagstaff at the end of February March - 10 spaces left.  Contact ianeece@usgs.gov for details and to sign up (or get on wait list). Will cover Jupyter, DASK, xarray, cloud-optimized storage formats, remote sensing, machine learning. "Test" session to see how well it works. 
    2. The CHS Help Center article for Pangeo is located at this link https://support.chs.usgs.gov/x/OwA1Ag
  10. What happens when we build on this and in the future the costs get passed down to us? Is somebody tracking the costs that are currently paid to plan 4 this?
    1. We are tracking costs that Pangeo will generate; cannot distribute costs down to a user. If the current subsidy goes away, we can work with users to see what the cost would be. Will have to be some investment from investigators/users.
  11. What is a simple explanation of how USGS can use Pangeo?
    1. A common software environment; you can just log in and start using this without downloading anything. Eliminates problems in replicating software environment. Low barrier of entry to try these tools.
    2. As ScienceBase moves to a cloud-based platform, that data will be easily accessible through Pangeo.
  12. is the CHS Pangeo public or internal only, meaning if you upload data or create a notebook can someone external access it?
    1. It is tied to your active directory, so you get dedicated space to work on things.
    2. Pangeo Binders is something to explore if you want to share a notebook environment with a team of individuals. Consult CHS for more information about this.
  13. can you clarify what is meant by a "cloud optimized geotiff?
    1. Regular geotiffs are read line by line, cloud optimized chunks it into squares and gives you overlays; allows you to get just your area of interest easier than reading line by line. 
    2. For more information, see this medium.com article.
  14. To reproduce research, versioning of the input data would be needed in addition to versioning of the source code. Is this happening?
    1. There's a versioning proposal in STAC that could use more input if you would like to reach out to the STAC community through their gitter chat or through the GitHub issues board.
  15. Will Pangeo be independent of the Cloud Service chosen. ie, Google vs Amazon vs Microsoft?
    1. It will need to be stood up on the different cloud infrastructures, but the tools themselves are pretty agnostic. It's all python.
  16. Is it fair to think of pangeo as an 'open source' alternative to google earth engine with more analysis capabilities ?
    1. Yes. The data is accessible and reproducible on any cloud.
  17. How hard would it be to set up an R environment built on top of the Pangeo stack?
    1. Pangeo is Jupyter, so you can use Jupyter, Python, or R in this deployment.

...