Blog

Bug

• [SCIENCEBASE-7825] - Firefox only - File download from the main file page does not work
• [SCIENCEBASE-7838] - Publish/Edit DOI from ScienceBase Intermittently Failing
• [SCIENCEBASE-7844] - S3 files -upload is not working
• [SCIENCEBASE-7848] - JOSSO errors

New Feature

• [SCIENCEBASE-7804] - Implement New 'Add EROS Trusted Digital Respository Resource' for External Resource Type (Concept -Placeholder)
• [SCIENCEBASE-7852] - Delete Multiple files at once

Story

• [SCIENCEBASE-7571] - A user can download a file that has been approved.

Task

• [SCIENCEBASE-7634] - Back-end Processing: Virus check function
• [SCIENCEBASE-7719] - GraphQL: Display file querying metadata
• [SCIENCEBASE-7726] - UI: Create ACL on folder
• [SCIENCEBASE-7728] - files-service: Create Folder ACL entities (continued from Feb)
• [SCIENCEBASE-7738] - create roles for clamAV lambda functions
• [SCIENCEBASE-7786] - Action: Delete
• [SCIENCEBASE-7789] - Action: Move
• [SCIENCEBASE-7805] - Create Tests for Toaster
• [SCIENCEBASE-7815] - GraphQL and UI: Fix upload to using filesdb as source of truth
• [SCIENCEBASE-7816] - GraphQL and UI: Enable pagination in GraphQL and in our Table
• [SCIENCEBASE-7819] - Document cloud deploy process for all SBfiles components
• [SCIENCEBASE-7827] - Implement downloadable check when virus scan is complete
• [SCIENCEBASE-7837] - files-service: REST Services for Folder/Space/ALCs for REST ACLs
• [SCIENCEBASE-7839] - Deploy files-api to Dev-IS EC2 instance with docker
• [SCIENCEBASE-7840] - Set up TLS connection between Apache and files-api
• [SCIENCEBASE-7841] - move files-db-api to that EC2
• [SCIENCEBASE-7842] - Orchestrate across multiple instances
• [SCIENCEBASE-7845] - Files UI: Allow a user to refresh the pathlisting/details view without refreshing the page
• [SCIENCEBASE-7850] - Files UI: Add pagination variables to the query in the url to allow for sharable links/hard refresh functionality
• [SCIENCEBASE-7855] - Move files-db-api to the same hosts as the other apps
• [SCIENCEBASE-7857] - Kubernetes troubleshooting
• [SCIENCEBASE-7867] - files-service: REST Services for sub-folders with Sub-Spaces/ACLs
• [SCIENCEBASE-7868] - GraphQL: Create ACL on Folder March work

Edit/Copy Release Notes

The text area below allows the project release notes to be edited and copied to another document.

** Bug

* [SCIENCEBASE-7772] - Directory: USGS Auto import on initial login recieving error
* [SCIENCEBASE-7812] - Unable able to click on files on Staging

** Task
* [SCIENCEBASE-7495] - catalog files from s3 object created events
* [SCIENCEBASE-7642] - Front-end: Display a catchall error message handler for the user
* [SCIENCEBASE-7711] - Improvements to file-db-api REST services to better handle and prevent data errors
* [SCIENCEBASE-7746] - Update passwords for basisharvester and catalogservice
* [SCIENCEBASE-7758] - Content table row component
* [SCIENCEBASE-7759] - Action Menu component
* [SCIENCEBASE-7760] - Pagination component
* [SCIENCEBASE-7761] - Badge component
* [SCIENCEBASE-7762] - Toaster Component
* [SCIENCEBASE-7769] - Investigate heap dump from Dec 13
* [SCIENCEBASE-7777] - Breadcrumb Component Cont
* [SCIENCEBASE-7782] - Create Icon component
* [SCIENCEBASE-7784] - GraphQL: Initial refactor to use files-db as source of truth
* [SCIENCEBASE-7785] - Human Readable Details
* [SCIENCEBASE-7787] - Action: Download
* [SCIENCEBASE-7788] - Action: Details
* [SCIENCEBASE-7791] - dialog box for delete
* [SCIENCEBASE-7792] - Dialog box for Move
* [SCIENCEBASE-7793] - Dialog box for share
* [SCIENCEBASE-7794] - connect lambda to right bucket
* [SCIENCEBASE-7795] - send file MD to files-api
* [SCIENCEBASE-7798] - Action: Upload
* [SCIENCEBASE-7800] - Create automated process to keep user role views up-to-date
* [SCIENCEBASE-7803] - UI: Number of files to display component
* [SCIENCEBASE-7806] - Extended characters in ScienceBase not being displayed properly in Drupal site
* [SCIENCEBASE-7808] - Change password for Service Account for Directory as it is expiring
* [SCIENCEBASE-7809] - FQA TEST - Feb staging tickets
* [SCIENCEBASE-7814] - GraphQL and UI: Complete refactor to using filesdb as source of truth
* [SCIENCEBASE-7829] - GraphQL: Display file querying metadata
* [SCIENCEBASE-7830] - Action: Delete
* [SCIENCEBASE-7831] - GraphQL and UI: Enable pagination in GraphQL and in our Table
* [SCIENCEBASE-7832] - GraphQL and UI: Fix upload to using filesdb as source of truth
* [SCIENCEBASE-7833] - files-service: Create Folder ACL entities

** Improvement
* [SCIENCEBASE-7666] - ISO transform changes to support layers and CQL queries in OGC services
* [SCIENCEBASE-7765] - update status mutation
* [SCIENCEBASE-7811] - Bucket list styling updates, modal for delete bucket
* [SCIENCEBASE-7821] - UI/UX - New Folder and New file needs a refresh when create
* [SCIENCEBASE-7822] - File Row Actions button
* [SCIENCEBASE-7823] - Folder actions menu button

Task
* [SCIENCEBASE-7687] - files-service: File-Metadata REST services
* [SCIENCEBASE-7693] - Create 2 Test Buckets on S3 for Black Pearl Testing
* [SCIENCEBASE-7731] - GraphQL: create community folder
* [SCIENCEBASE-7742] - change lambda trigger from S3 object creation to SQS message
* [SCIENCEBASE-7754] - Breadcrumb Component
* [SCIENCEBASE-7755] - Add Content component (+)
* [SCIENCEBASE-7757] - Content table header component
* [SCIENCEBASE-7796] - catalog files from s3 object created events

Bug
* [SCIENCEBASE-7723] - Unable to download Large file
* [SCIENCEBASE-7724] - Unable to update/import USGS records in directory
* [SCIENCEBASE-7739] - Fix uploads in latest deploy of SB Files
* [SCIENCEBASE-7744] - Incorrect FGDC to SB translation (on NPG harvested Items)

Task

* [SCIENCEBASE-7640] - GraphQL: Produce better error messages
* [SCIENCEBASE-7674] - files-service: Attach an ACL to a folder
* [SCIENCEBASE-7692] - FQA: Test: SCIENCEBASE-7635: As a user I can upload files to a specific directory
* [SCIENCEBASE-7706] - Deploy files-db-api to dev-api.sciencebase.gov pointed at the RDS
* [SCIENCEBASE-7716] - Wire frame for files column layout Routes
* [SCIENCEBASE-7717] - POC python function to extract shapefile metadata
* [SCIENCEBASE-7718] - UI: Display file metadata
* [SCIENCEBASE-7721] - UI: Improve Files Detail Page and Add New Metadata
* [SCIENCEBASE-7722] - Setup dev environment
* [SCIENCEBASE-7725] - Add test harness to files-api
* [SCIENCEBASE-7729] - GraphQL: Query/Cache roles from directory after user authentication
* [SCIENCEBASE-7730] - GraphQL: Role lookup query
* [SCIENCEBASE-7735] - FQA Test SCIENCEBASE-7712 ScienceBase - Password Reset in IE is not working in Directory
* [SCIENCEBASE-7743] - POC python function to extract metadata from a Geotiff
* [SCIENCEBASE-7745] - UUID for File
* [SCIENCEBASE-7748] - Wire frame Navigation Panel quota
* [SCIENCEBASE-7749] - Wire frame Navigation panel content context
* [SCIENCEBASE-7751] - Profile component
* [SCIENCEBASE-7752] - Files Navigation Panel
* [SCIENCEBASE-7763] - Wireframe toaster
* [SCIENCEBASE-7766] - Standardize the deploy process for the files components
* [SCIENCEBASE-7767] - Place updated *.staging.sciencebase.gov cert into k8s
* [SCIENCEBASE-7768] - Make Redis connection more stable
* [SCIENCEBASE-7775] - FQATEST-SCIENCEBASE-7751-Profile component
* [SCIENCEBASE-7776] - FQA TEST-SCIENCEBASE-7752-Files Navigation Panel
* [SCIENCEBASE-7778] - Content table header component
* [SCIENCEBASE-7779] - catalog files from s3 object created events
* [SCIENCEBASE-7780] - files-service: File-Metadata REST services
* [SCIENCEBASE-7781] - Create 2 Test Buckets on S3 for Black Pearl Testing

Improvement
* [SCIENCEBASE-7771] - Replace Old Version of User's S3 Files on AWS with Correct Version

Sub-task

* [SCIENCEBASE-7545] - Create prod SB elasticsearch copy of public items in Prod-IS
* [SCIENCEBASE-7546] - Deploy sbSearch service to Prod-IS
* [SCIENCEBASE-7547] - Deploy sbSearch UI to Prod-IS

Bug
* [SCIENCEBASE-7699] - Duplicate Key exception when creating folders on file creation request

Story
* [SCIENCEBASE-7544] - Deploy SB3 Search to sciencebase.usgs.gov

Task
* [SCIENCEBASE-7496] - Type files triggered by file receive event
* [SCIENCEBASE-7622] - Deploy files-ui to Dev-IS beta
* [SCIENCEBASE-7630] - Front-end: Identify files that are approved for download
* [SCIENCEBASE-7633] - Back-end API: Provide download URLs
* [SCIENCEBASE-7652] - Front-end: Set up route to load file details at a permanent URL
* [SCIENCEBASE-7675] - Tech talk on Permission Structure for folders/community
* [SCIENCEBASE-7696] - FQA: Test: SCIENCEBASE-7683: S3 download Error when user is not on the DOI network
* [SCIENCEBASE-7698] - Deploy SB Files to a staging Url
* [SCIENCEBASE-7700] - Bucket management in files-ui/api
* [SCIENCEBASE-7705] - Bucket management in files-ui/api
* [SCIENCEBASE-7708] - Design: Permission Structure for folders/community
* [SCIENCEBASE-7709] - Switch node projects to npm with .npmrc
* [SCIENCEBASE-7710] - Create tests for files-ui components
* [SCIENCEBASE-7733] - catalog files from s3 object created events

Improvement
* [SCIENCEBASE-7680] - Audit logging for SB Files DB API
* [SCIENCEBASE-7681] - Database migration (SQL install/deploy process) for files-db-api
* [SCIENCEBASE-7682] - files-db-api - add support for multiple Buckets, refactor keys
* [SCIENCEBASE-7695] - fix breadcrumbs for folders and root directory

Bug
* [SCIENCEBASE-7683] - S3 download Error when user is not on the DOI network
* [SCIENCEBASE-7694] - Investigate ScienceBase OAIPMH feed
* [SCIENCEBASE-7702] - NDC Dashboard Exhibiting Errors
* [SCIENCEBASE-7704] - 'Download as zip' not Working for Shapefile Facet
* [SCIENCEBASE-7712] - ScienceBase - Password Reset in IE is not working in Directory
* [SCIENCEBASE-7713] - Large Files Not Downloading Properly from ScienceBase Item

Bug
* [SCIENCEBASE-7615] - BASIS+ Footprint Shows a Blank Box instead of ScienceBase Login for Some Users
* [SCIENCEBASE-7649] - When using "+ Add S3 files..." store location is incorrect when there is an extension
* [SCIENCEBASE-7661] - Directory/myUSGS not Connecting - JOSSO Unexpected error adding non-DOI user
* [SCIENCEBASE-7662] - Beta - my-beta.usgs.gov - Error when logging in
* [SCIENCEBASE-7663] - Metadata Harvest Option Not Working on Item

Story
* [SCIENCEBASE-7635] - As a user I can upload files to a specific directory

Task
* [SCIENCEBASE-7628] - Front end UI: User can upload a shapefile and see shapefile metadata
* [SCIENCEBASE-7631] - Front-end: On the file info page show the approval metadata
* [SCIENCEBASE-7632] - Back-end API: Provide approval metadata (FileStatus) for files
* [SCIENCEBASE-7636] - Back End: CRUD rest API service for creating new folders
* [SCIENCEBASE-7637] - Front End: Browsing and adding files by folder
* [SCIENCEBASE-7638] - Front End: Add a "Add" button to the directories for adding files
* [SCIENCEBASE-7639] - Back-end: Add upload_session and SB Files uuid metadata to S3PutObject requests
* [SCIENCEBASE-7646] - Deploy SB 2.159.0
* [SCIENCEBASE-7654] - Show files after they have been uploaded
* [SCIENCEBASE-7656] - Add to AWS Access keys
* [SCIENCEBASE-7657] - Back End: plumb the API Service for creating new folders in S3 with graphql
* [SCIENCEBASE-7660] - Point prod search-UI at ScienceBase search instead of service
* [SCIENCEBASE-7664] - Back-end: Add upload_session and SB Files uuid metadata to S3PutObject requests
* [SCIENCEBASE-7665] - Back End: Browsing and adding files by folder
* [SCIENCEBASE-7677] - Investigate the Elastic issue related to the SB problems on 10/22
* [SCIENCEBASE-7678] - Troubleshoot elasticsearch issues (2018-10-26)
* [SCIENCEBASE-7688] - Back-end API: Provide download URLs
* [SCIENCEBASE-7689] - Front-end: Set up route to load file details at a permanent URL
* [SCIENCEBASE-7690] - catalog files from s3 object created events
* [SCIENCEBASE-7691] - Type files triggered by file receive event

Bug
* [SCIENCEBASE-7319] - When using "Add Black Pearl files..." store location is incorrect when there is an extension
* [SCIENCEBASE-7530] - Incorrectly linking an S3 file to an item causes incorrect JSON
* [SCIENCEBASE-7648] - Unable to add a S3 file to a New Item that has not been saved

New Feature
* [SCIENCEBASE-7039] - Add a captcha to the s3 download page

Task
* [SCIENCEBASE-7556] - Add the Files Upload app to the Catalog Status Page

Bug
* [SCIENCEBASE-7611] - advanced search - fix issue with sort method/order overriding each other
* [SCIENCEBASE-7613] - Files: S3 Amazon storage: If outside the DOI network you recive and Error 
* [SCIENCEBASE-7617] - User Unable to Log Into ScienceBase
* [SCIENCEBASE-7624] - troubleshoot orcid script 
* [SCIENCEBASE-7643] - New SB3 UI - As a SB user not logged in/logged in I am not able to perform an Advanced search in IE 
* [SCIENCEBASE-7644] - New SB3 UI - Advanced Search - Enter key after entering query creates page not found

New Feature

* [SCIENCEBASE-7558] - Add the ability to search by ORCID in the S3 Advanced Search form
* [SCIENCEBASE-7559] - Add the Ability to Search for USGS Data Release the S3 Advanced Search Form
* [SCIENCEBASE-7610] - Parse weblinks from the FGDC metextns/onlink section

Story
* [SCIENCEBASE-7609] - NGTOC Metadata Needs (Scrape & Display Info from Metadata Extension)

Task
* [SCIENCEBASE-7430] - Change ItemFile model so download URIs work via IDs/UUIDs
* [SCIENCEBASE-7446] - Search Service: Gitlab CI Testing, Alpha Deployment, Faster Beta deployment, etc
* [SCIENCEBASE-7452] - Refactor Search criteria model
* [SCIENCEBASE-7519] - Deploy files-api to dev-is
* [SCIENCEBASE-7550] - Add Search by Geometry to S3 Advanced Search 
* [SCIENCEBASE-7551] - Add Search by place to S3 Advanced Search
* [SCIENCEBASE-7553] - Add Operators to the searches in the Advanced Search form
* [SCIENCEBASE-7569] - catalog files from s3 object created events
* [SCIENCEBASE-7573] - Design discussion for SB search model 
* [SCIENCEBASE-7574] - Design discussion for SB3 item model
* [SCIENCEBASE-7575] - Review the state of Search for SB3 and SageDAT
* [SCIENCEBASE-7579] - Prepare for GraphQL ARB review
* [SCIENCEBASE-7616] - Deploy SB 2.158.0
* [SCIENCEBASE-7619] - Move 87 files out of the Amethyst Vein System into its child item. 
* [SCIENCEBASE-7620] - Set up development environment for SB Files
* [SCIENCEBASE-7621] - Replace the hasura calls in files-api to hit the new grails-gorm api
* [SCIENCEBASE-7626] - Files UI-API-DB-API-deploy
* [SCIENCEBASE-7627] - Files UI-API-DB-API-deploy to staging
* [SCIENCEBASE-7650] - FQA: Testing: S3 download failing
* [SCIENCEBASE-7655] - Front end UI: User can upload a shapefile and see shapefile metadata
* [SCIENCEBASE-7658] - FQA: Test: SCIENCEBASE-7648: Unable to add a S3 file to a New Item that has not been saved

Improvement
* [SCIENCEBASE-7517] - SB3 - Advanced search - Date filter not working
* [SCIENCEBASE-7537] - Deploy process for (/etc/appconfig) configuration files for beta/prod services in the cloud.
* [SCIENCEBASE-7614] - Config setup for testing search-service with Gitlab CI (on kube)

Bug
* [SCIENCEBASE-6335] - NPE with file downloads: Cannot get property 'fileName' on null object
* [SCIENCEBASE-7557] - Unable to add a Black Pearl file to a New Item that has not been saved
* [SCIENCEBASE-7567] - Bad bounding box in OGC facet gives incorrect error message
* [SCIENCEBASE-7618] - S3 download failing

Task
* [SCIENCEBASE-7429] - Implement batch updates to pySB script for ORCID updates

Sub-task
* [SCIENCEBASE-7605] - Create prod SB elasticsearch copy of public items in Prod-IS
* [SCIENCEBASE-7606] - Deploy sbSearch service to Prod-IS
* [SCIENCEBASE-7607] - Deploy sbSearch UI to Prod-IS

Bug
* [SCIENCEBASE-7448] - Basis+ issue with subtasks as a child of the incorrect projectID
* [SCIENCEBASE-7479] - Full Index (without delete?) deletes index without configuring a new index
* [SCIENCEBASE-7497] - File processing is causing 429s and 400s and ignoring them
* [SCIENCEBASE-7566] - New search ui is not working in IE 11 or edge.
* [SCIENCEBASE-7568] - orcid keyword in elasticsearch index

New Feature

* [SCIENCEBASE-7541] - styling file list view (css-grid vs material-ui)
* [SCIENCEBASE-7542] - Create File View component
* [SCIENCEBASE-7565] - Deploy ScienceBase 2.157.0
* [SCIENCEBASE-7577] - create an AuthContext using react context api for files (pair)

Story
* [SCIENCEBASE-7563] - FQA: SCIENCEBASE-7531: s3-service is not monitored on catalog status page
* [SCIENCEBASE-7604] - Deploy SB3 Search to sciencebase.usgs.gov

Task
* [SCIENCEBASE-7425] - Add OIDC (Keycloak) authentication to files-api
* [SCIENCEBASE-7450] - Start Files UI
* [SCIENCEBASE-7451] - Whiteboard Files UI
* [SCIENCEBASE-7453] - Initial code review of new Advanced Search UI
* [SCIENCEBASE-7454] - Add lucene search capability on the New Advanced Search form
* [SCIENCEBASE-7455] - Add Max/Offset to New Advanced Search form
* [SCIENCEBASE-7491] - Deploy files-api to dev-is
* [SCIENCEBASE-7492] - Next Steps on SB3 home page
* [SCIENCEBASE-7493] - Make SB3 home page mobile responsive
* [SCIENCEBASE-7508] - Use sdkman for docker-grails image
* [SCIENCEBASE-7510] - Add caching for gitlab kubernetes runners
* [SCIENCEBASE-7520] - SB3_Advanced Search: type ahead for Contact and Tag is not working
* [SCIENCEBASE-7525] - Fix footer on SB Search UI
* [SCIENCEBASE-7526] - Add a Photo Collections powered by ScienceBase page
* [SCIENCEBASE-7527] - Whiteboard Files UI
* [SCIENCEBASE-7533] - Deploy NDC Dashboard version 2.x
* [SCIENCEBASE-7534] - Deploy ScienceBase 2.156.0
* [SCIENCEBASE-7535] - Add missing search features from current Advanced Search to new Search UI
* [SCIENCEBASE-7538] - Create File list view component
* [SCIENCEBASE-7539] - Create upload component
* [SCIENCEBASE-7548] - Filter My Files view by user_id
* [SCIENCEBASE-7549] - Set up underlying GraphQL-enabled PostgresDB
* [SCIENCEBASE-7554] - Generate presigned urls for uploads
* [SCIENCEBASE-7560] - MVP for upload progress reporting
* [SCIENCEBASE-7564] - Use the apollo cache for storing a users files
* [SCIENCEBASE-7602] - Deploy files-api to dev-is

Improvement
* [SCIENCEBASE-7521] - New SB3 home improvments
* [SCIENCEBASE-7536] - Use CloudWatch for Search Service (dev-api.sciencebase.gov) logs
* [SCIENCEBASE-7603] - SB3 - Advanced search - Date filter not working
* [SCIENCEBASE-7608] - Deploy process for (/etc/appconfig) configuration files for beta/prod services in the cloud.

Bug
* [SCIENCEBASE-7532] - Turn off debug logging in production for s3-service

Improvement
* [SCIENCEBASE-7509] - Streamline the process for attaching a Black Pearl file to a ScienceBase item
* [SCIENCEBASE-7531] - s3-service is not monitored on catalog status page

Bug
* [SCIENCEBASE-7436] - Trim of extra spaces on web links URI
* [SCIENCEBASE-7486] - prod-es4 down, other nodes overcompensating
* [SCIENCEBASE-7494] - error sorting tags in GSP taglib
* [SCIENCEBASE-7502] - Unexpected System Error when downloading file added from S3 bucket
* [SCIENCEBASE-7528] - Unable to download a file hosted on Cloud using the anonymous link token

Task
* [SCIENCEBASE-7499] - Test the new DOI API
* [SCIENCEBASE-7501] - Metrics: Change ordering on Repo Metrics
* [SCIENCEBASE-7523] - WRET SB Vocab Updates

Story
* [SCIENCEBASE-7441] - As a SB stakeholder, I need to report on the SB System file metrics

Task
* [SCIENCEBASE-7398] - Review and modify files-api flask app to fit in with the current vision
* [SCIENCEBASE-7405] - Create Search Results Wireframe
* [SCIENCEBASE-7435] - Review and update pysb documentation
* [SCIENCEBASE-7445] - Search Service: Secure Item GET to prevent unauthorized access to items.
* [SCIENCEBASE-7449] - Handle token refresh and logout if expired in React apps like Search UI
* [SCIENCEBASE-7456] - Identify/Execute the Next Steps for new SB3 home
* [SCIENCEBASE-7471] - Advanced Search Cleanup
* [SCIENCEBASE-7475] - Attach Large File from Black Pearl Storage to ScienceBase Item
* [SCIENCEBASE-7476] - Update dev-is signer aws access credentials
* [SCIENCEBASE-7480] - Add new file model
* [SCIENCEBASE-7481] - Research ORM to the files-api (SQLAlchemy)
* [SCIENCEBASE-7482] - Add presigning of upload/download URLs to the files-api
* [SCIENCEBASE-7483] - Upgrade React and Refactor Auth to use Context
* [SCIENCEBASE-7484] - Restore/re-implement Gitlab CI/CD for running branches of search-ui for FQA testing before merging
* [SCIENCEBASE-7487] - Add file model to files API
* [SCIENCEBASE-7498] - Deploy files-api to dev-is
* [SCIENCEBASE-7507] - Implement batch updates to pySB script for ORCID updates
* [SCIENCEBASE-7518] - Search Service: Gitlab CI Testing, Alpha Deployment, Faster Beta deployment, etc

Improvement
* [SCIENCEBASE-7439] - Change Default Date Range to longer than 6 months

Bug
[SCIENCEBASE-7438] - JavaScript errors when loading ScienceBase by the Numbers
[SCIENCEBASE-7470] - Receive Cannot get property 'files' on null object when attempting to upload a sd file

Task
[SCIENCEBASE-7474] - Metrics: Change ordering on Repo Metrics

Improvement
[SCIENCEBASE-7428] - Weblink attributes for new TNM HTMC download formats