Confluence Retirement

In an effort to consolidate USGS hosted Wikis, myUSGS’ Confluence service is scheduled for retirement on January 27th, 2023. The official USGS Wiki and collaboration space is now SharePoint. Please migrate existing spaces and content to the SharePoint platform and remove it from Confluence at your earliest convenience. If you need any additional information or have any concerns about this change, please contact myusgs@usgs.gov. Thank you for your prompt attention to this matter.

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migration of unmigrated content due to installation of a new plugin

...

Section

Breakdown of the Components of the CDI Overview (Figure 1)

Column
width20%

Image Modified

 
Column
width80%

Communities of practice include scientists, the CDI as a whole, CDI Working Groups, external partners, and the human network of scientific domain collaborators.

Section
width
Column
20%

Image Modified 

 
Column
width80%

Computational tools and services include applications, Web services, data discovery tools, models, semantic services and tools, infrastructure, data brokers, and visualization tools.

Section
Column
width20%

Image Modified 

 
Column
width80%

Management, policy, and standards include data stewardship, the implementation of the Science Data Management Life CycleLifecycle, knowledge management, data standards, governance, and policy.

Section
width
Column
20%

Image Modified 

Column
width80%

 

Data and information assets include persistent archives, data registries, catalogs, data, metadata, derived information products, knowledge bases, and vocabularies/ontologies.

 

CDI Science Support Framework (SSF)

The CDI SSF provides a conceptual architecture that: illustrates how the CDI contributes to Bureau-level data integration efforts; and defines how current and future CDI projects fit within the framework.

Image Modified

Figure 2: CDI Science Support Framework (SSF)

* Note that the color of the Framework elements (Figure 2) match those of the Overview elements in Figure 1.

USGS SCIENTISTS conduct MONITORING, ASSESSMENT, AND RESEARCH that generates DATA ASSETS. Through the application of business, computational, and analytical processes and technologies, these USGS DATA ASSETS flow vertically through the SSF from a base of MONITORING, ASSESSMENT, AND RESEARCH through the Science Data Lifecycle Model (SDLM) processes, applications, Web services, and semantics. The DATA ASSETSare transformed into INFORMATION products that benefit from data and knowledge management and also increase KNOWLEDGE and understanding of the Earth's physical and biological systems. Data assets also flow horizontally through the SSF from and through science projects to data and knowledge management.

The horizontal elements in the SSF represent the “what” of the CDI: products and tools, the things that contribute to the advancement of scientific data and that lead to the development of knowledge and understanding of the Earth’s systems.

The vertical elements in the SSFrepresent the “how” of the CDI:  the processes, the implementation of standards and best practices, and the interactions among people, data, and technology used to achieve data integration.

Individual Framework element descriptions:

* Note that the color of the Framework elements match those of the Overview elements

Section
Column

Science Inputs (the brown elements)

Monitoring, Assessment, & Research: USGS scientists conduct monitoring, assessment, and research that generates data assets. Through the application of business, computational, and analytical processes and technologies, these assets are converted into

...

information products that

...

can be shared with other researchers, stakeholders, and citizens to increase our knowledge and understanding of the Earth's physical and biological systems.

Science Project Support: Successful science projects encompass a range of activities represented in the SDLM. At each step in the cycle, researchers and data stewards rely on an array of sophisticated tools and services for data, information and knowledge discovery, acquisition, integration, management, and sharing.

Communities of Practice (the tan element)

Communities of practice are the foundation for CDI and all its products – the communities of people working towards the goal of advancing scientific data and information management and data integration across the USGS.

Data & Information Assets (the blue elements)

USGS assets include Data (e.g., raw data, databases, and linked open data (RDF1)); Information or derived/interpreted information products in the broad sense (e.g., published or shared maps, reports, datasets); and Knowledge of all types and in all forms — recorded, organized, and preserved in the form of various artifacts. Knowledge can then be improved; shared across groups, organizations, and domains; and reused to support individual and group learning and research.

Computational Tools & Services (the green elements)

Science Data Lifecycle processes include tools and services that move data through the SDLC, human and machine interactions, and interactions with data through technology. 

Detailed descriptions of SDLC Processes:

  • Planning – A documented sequence of intended actions to identify and secure resources and gather, maintain, secure, and utilize data assets;
  • Acquisition – The series of actions for collecting or adding to data assets;
  • Processing – A series of actions or steps performed on data to verify, organize, transform, integrate, and extract data in an appropriate output form for subsequent use;
  • Analysis – A series of actions and methods performed on data that help describe facts, detect patterns, develop explanations, and test hypotheses;
  • Preservation – Actions and procedures to keep data for some period of time; to set data aside for future use; and
  • Publishing/Sharing – To prepare and issue, or to disseminate data or information products.
Column
Semantics convert raw data into data that can be interpreted by machines: Machine Readable Metadata, Semantic Mediation for Data Integration & Discovery, Ontologies/Vocabularies, and World Wide Web Consortium Standards.

Web Services include machine to machine data exchange, SOAP,2 REST,3 SPARQL4 EndPoints, and other protocols and services.

Applications include human readable data services and user interfaces to data driven applications.

Management, Policy, & Standards (the purple elements)

Data Management includes data and metadata standards and policies and occurs in all phases of the Science Data Lifecycle from scientific research to finished information products.

Knowledge Management involves the creation, standardized documentation, and organization of knowledge using tools such as SKOS5 Vocabularies and information modeling, resulting in the formation of knowledge bases.

1 Resource Description Framework

2 Simple Object Access Protocol

3 REpresentational State Transfer

4 SPARQL Protocol and RDF Query Language

5 Simple Knowledge Organization Systems