Blog

Sub-task

* [SCIENCEBASE-7545] - Create prod SB elasticsearch copy of public items in Prod-IS
* [SCIENCEBASE-7546] - Deploy sbSearch service to Prod-IS
* [SCIENCEBASE-7547] - Deploy sbSearch UI to Prod-IS

Bug
* [SCIENCEBASE-7699] - Duplicate Key exception when creating folders on file creation request


Story
* [SCIENCEBASE-7544] - Deploy SB3 Search to sciencebase.usgs.gov

Task
* [SCIENCEBASE-7496] - Type files triggered by file receive event
* [SCIENCEBASE-7622] - Deploy files-ui to Dev-IS beta
* [SCIENCEBASE-7630] - Front-end: Identify files that are approved for download
* [SCIENCEBASE-7633] - Back-end API: Provide download URLs
* [SCIENCEBASE-7652] - Front-end: Set up route to load file details at a permanent URL
* [SCIENCEBASE-7675] - Tech talk on Permission Structure for folders/community
* [SCIENCEBASE-7696] - FQA: Test: SCIENCEBASE-7683: S3 download Error when user is not on the DOI network
* [SCIENCEBASE-7698] - Deploy SB Files to a staging Url
* [SCIENCEBASE-7700] - Bucket management in files-ui/api
* [SCIENCEBASE-7705] - Bucket management in files-ui/api
* [SCIENCEBASE-7708] - Design: Permission Structure for folders/community
* [SCIENCEBASE-7709] - Switch node projects to npm with .npmrc
* [SCIENCEBASE-7710] - Create tests for files-ui components
* [SCIENCEBASE-7733] - catalog files from s3 object created events

Improvement
* [SCIENCEBASE-7680] - Audit logging for SB Files DB API
* [SCIENCEBASE-7681] - Database migration (SQL install/deploy process) for files-db-api
* [SCIENCEBASE-7682] - files-db-api - add support for multiple Buckets, refactor keys
* [SCIENCEBASE-7695] - fix breadcrumbs for folders and root directory



Bug
* [SCIENCEBASE-7683] - S3 download Error when user is not on the DOI network
* [SCIENCEBASE-7694] - Investigate ScienceBase OAIPMH feed
* [SCIENCEBASE-7702] - NDC Dashboard Exhibiting Errors
* [SCIENCEBASE-7704] - 'Download as zip' not Working for Shapefile Facet
* [SCIENCEBASE-7712] - ScienceBase - Password Reset in IE is not working in Directory
* [SCIENCEBASE-7713] - Large Files Not Downloading Properly from ScienceBase Item

Bug
* [SCIENCEBASE-7615] - BASIS+ Footprint Shows a Blank Box instead of ScienceBase Login for Some Users
* [SCIENCEBASE-7649] - When using "+ Add S3 files..." store location is incorrect when there is an extension
* [SCIENCEBASE-7661] - Directory/myUSGS not Connecting - JOSSO Unexpected error adding non-DOI user
* [SCIENCEBASE-7662] - Beta - my-beta.usgs.gov - Error when logging in
* [SCIENCEBASE-7663] - Metadata Harvest Option Not Working on Item



Story
* [SCIENCEBASE-7635] - As a user I can upload files to a specific directory

Task
* [SCIENCEBASE-7628] - Front end UI: User can upload a shapefile and see shapefile metadata
* [SCIENCEBASE-7631] - Front-end: On the file info page show the approval metadata
* [SCIENCEBASE-7632] - Back-end API: Provide approval metadata (FileStatus) for files
* [SCIENCEBASE-7636] - Back End: CRUD rest API service for creating new folders
* [SCIENCEBASE-7637] - Front End: Browsing and adding files by folder
* [SCIENCEBASE-7638] - Front End: Add a "Add" button to the directories for adding files
* [SCIENCEBASE-7639] - Back-end: Add upload_session and SB Files uuid metadata to S3PutObject requests
* [SCIENCEBASE-7646] - Deploy SB 2.159.0
* [SCIENCEBASE-7654] - Show files after they have been uploaded
* [SCIENCEBASE-7656] - Add to AWS Access keys
* [SCIENCEBASE-7657] - Back End: plumb the API Service for creating new folders in S3 with graphql
* [SCIENCEBASE-7660] - Point prod search-UI at ScienceBase search instead of service
* [SCIENCEBASE-7664] - Back-end: Add upload_session and SB Files uuid metadata to S3PutObject requests
* [SCIENCEBASE-7665] - Back End: Browsing and adding files by folder
* [SCIENCEBASE-7677] - Investigate the Elastic issue related to the SB problems on 10/22
* [SCIENCEBASE-7678] - Troubleshoot elasticsearch issues (2018-10-26)
* [SCIENCEBASE-7688] - Back-end API: Provide download URLs
* [SCIENCEBASE-7689] - Front-end: Set up route to load file details at a permanent URL
* [SCIENCEBASE-7690] - catalog files from s3 object created events
* [SCIENCEBASE-7691] - Type files triggered by file receive event

Bug
* [SCIENCEBASE-7319] - When using "Add Black Pearl files..." store location is incorrect when there is an extension
* [SCIENCEBASE-7530] - Incorrectly linking an S3 file to an item causes incorrect JSON
* [SCIENCEBASE-7648] - Unable to add a S3 file to a New Item that has not been saved


New Feature
* [SCIENCEBASE-7039] - Add a captcha to the s3 download page


Task
* [SCIENCEBASE-7556] - Add the Files Upload app to the Catalog Status Page


Bug
* [SCIENCEBASE-7611] - advanced search - fix issue with sort method/order overriding each other
* [SCIENCEBASE-7613] - Files: S3 Amazon storage: If outside the DOI network you recive and Error 
* [SCIENCEBASE-7617] - User Unable to Log Into ScienceBase
* [SCIENCEBASE-7624] - troubleshoot orcid script 
* [SCIENCEBASE-7643] - New SB3 UI - As a SB user not logged in/logged in I am not able to perform an Advanced search in IE 
* [SCIENCEBASE-7644] - New SB3 UI - Advanced Search - Enter key after entering query creates page not found


New Feature

* [SCIENCEBASE-7558] - Add the ability to search by ORCID in the S3 Advanced Search form
* [SCIENCEBASE-7559] - Add the Ability to Search for USGS Data Release the S3 Advanced Search Form
* [SCIENCEBASE-7610] - Parse weblinks from the FGDC metextns/onlink section


Story
* [SCIENCEBASE-7609] - NGTOC Metadata Needs (Scrape & Display Info from Metadata Extension)


Task
* [SCIENCEBASE-7430] - Change ItemFile model so download URIs work via IDs/UUIDs
* [SCIENCEBASE-7446] - Search Service: Gitlab CI Testing, Alpha Deployment, Faster Beta deployment, etc
* [SCIENCEBASE-7452] - Refactor Search criteria model
* [SCIENCEBASE-7519] - Deploy files-api to dev-is
* [SCIENCEBASE-7550] - Add Search by Geometry to S3 Advanced Search 
* [SCIENCEBASE-7551] - Add Search by place to S3 Advanced Search
* [SCIENCEBASE-7553] - Add Operators to the searches in the Advanced Search form
* [SCIENCEBASE-7569] - catalog files from s3 object created events
* [SCIENCEBASE-7573] - Design discussion for SB search model 
* [SCIENCEBASE-7574] - Design discussion for SB3 item model
* [SCIENCEBASE-7575] - Review the state of Search for SB3 and SageDAT
* [SCIENCEBASE-7579] - Prepare for GraphQL ARB review
* [SCIENCEBASE-7616] - Deploy SB 2.158.0
* [SCIENCEBASE-7619] - Move 87 files out of the Amethyst Vein System into its child item. 
* [SCIENCEBASE-7620] - Set up development environment for SB Files
* [SCIENCEBASE-7621] - Replace the hasura calls in files-api to hit the new grails-gorm api
* [SCIENCEBASE-7626] - Files UI-API-DB-API-deploy
* [SCIENCEBASE-7627] - Files UI-API-DB-API-deploy to staging
* [SCIENCEBASE-7650] - FQA: Testing: S3 download failing
* [SCIENCEBASE-7655] - Front end UI: User can upload a shapefile and see shapefile metadata
* [SCIENCEBASE-7658] - FQA: Test: SCIENCEBASE-7648: Unable to add a S3 file to a New Item that has not been saved

Improvement
* [SCIENCEBASE-7517] - SB3 - Advanced search - Date filter not working
* [SCIENCEBASE-7537] - Deploy process for (/etc/appconfig) configuration files for beta/prod services in the cloud.
* [SCIENCEBASE-7614] - Config setup for testing search-service with Gitlab CI (on kube)

Bug
* [SCIENCEBASE-6335] - NPE with file downloads: Cannot get property 'fileName' on null object
* [SCIENCEBASE-7557] - Unable to add a Black Pearl file to a New Item that has not been saved
* [SCIENCEBASE-7567] - Bad bounding box in OGC facet gives incorrect error message
* [SCIENCEBASE-7618] - S3 download failing

Task
* [SCIENCEBASE-7429] - Implement batch updates to pySB script for ORCID updates

Sub-task
* [SCIENCEBASE-7605] - Create prod SB elasticsearch copy of public items in Prod-IS
* [SCIENCEBASE-7606] - Deploy sbSearch service to Prod-IS
* [SCIENCEBASE-7607] - Deploy sbSearch UI to Prod-IS


Bug
* [SCIENCEBASE-7448] - Basis+ issue with subtasks as a child of the incorrect projectID
* [SCIENCEBASE-7479] - Full Index (without delete?) deletes index without configuring a new index
* [SCIENCEBASE-7497] - File processing is causing 429s and 400s and ignoring them
* [SCIENCEBASE-7566] - New search ui is not working in IE 11 or edge.
* [SCIENCEBASE-7568] - orcid keyword in elasticsearch index


New Feature

* [SCIENCEBASE-7541] - styling file list view (css-grid vs material-ui)
* [SCIENCEBASE-7542] - Create File View component
* [SCIENCEBASE-7565] - Deploy ScienceBase 2.157.0
* [SCIENCEBASE-7577] - create an AuthContext using react context api for files (pair)

Story
* [SCIENCEBASE-7563] - FQA: SCIENCEBASE-7531: s3-service is not monitored on catalog status page
* [SCIENCEBASE-7604] - Deploy SB3 Search to sciencebase.usgs.gov

Task
* [SCIENCEBASE-7425] - Add OIDC (Keycloak) authentication to files-api
* [SCIENCEBASE-7450] - Start Files UI
* [SCIENCEBASE-7451] - Whiteboard Files UI
* [SCIENCEBASE-7453] - Initial code review of new Advanced Search UI
* [SCIENCEBASE-7454] - Add lucene search capability on the New Advanced Search form
* [SCIENCEBASE-7455] - Add Max/Offset to New Advanced Search form
* [SCIENCEBASE-7491] - Deploy files-api to dev-is
* [SCIENCEBASE-7492] - Next Steps on SB3 home page
* [SCIENCEBASE-7493] - Make SB3 home page mobile responsive
* [SCIENCEBASE-7508] - Use sdkman for docker-grails image
* [SCIENCEBASE-7510] - Add caching for gitlab kubernetes runners
* [SCIENCEBASE-7520] - SB3_Advanced Search: type ahead for Contact and Tag is not working
* [SCIENCEBASE-7525] - Fix footer on SB Search UI
* [SCIENCEBASE-7526] - Add a Photo Collections powered by ScienceBase page
* [SCIENCEBASE-7527] - Whiteboard Files UI
* [SCIENCEBASE-7533] - Deploy NDC Dashboard version 2.x
* [SCIENCEBASE-7534] - Deploy ScienceBase 2.156.0
* [SCIENCEBASE-7535] - Add missing search features from current Advanced Search to new Search UI
* [SCIENCEBASE-7538] - Create File list view component
* [SCIENCEBASE-7539] - Create upload component
* [SCIENCEBASE-7548] - Filter My Files view by user_id
* [SCIENCEBASE-7549] - Set up underlying GraphQL-enabled PostgresDB
* [SCIENCEBASE-7554] - Generate presigned urls for uploads
* [SCIENCEBASE-7560] - MVP for upload progress reporting
* [SCIENCEBASE-7564] - Use the apollo cache for storing a users files
* [SCIENCEBASE-7602] - Deploy files-api to dev-is

Improvement
* [SCIENCEBASE-7521] - New SB3 home improvments
* [SCIENCEBASE-7536] - Use CloudWatch for Search Service (dev-api.sciencebase.gov) logs
* [SCIENCEBASE-7603] - SB3 - Advanced search - Date filter not working
* [SCIENCEBASE-7608] - Deploy process for (/etc/appconfig) configuration files for beta/prod services in the cloud.


Bug
* [SCIENCEBASE-7532] - Turn off debug logging in production for s3-service


Improvement
* [SCIENCEBASE-7509] - Streamline the process for attaching a Black Pearl file to a ScienceBase item
* [SCIENCEBASE-7531] - s3-service is not monitored on catalog status page

Bug
* [SCIENCEBASE-7436] - Trim of extra spaces on web links URI
* [SCIENCEBASE-7486] - prod-es4 down, other nodes overcompensating
* [SCIENCEBASE-7494] - error sorting tags in GSP taglib
* [SCIENCEBASE-7502] - Unexpected System Error when downloading file added from S3 bucket
* [SCIENCEBASE-7528] - Unable to download a file hosted on Cloud using the anonymous link token

Task
* [SCIENCEBASE-7499] - Test the new DOI API
* [SCIENCEBASE-7501] - Metrics: Change ordering on Repo Metrics
* [SCIENCEBASE-7523] - WRET SB Vocab Updates

Story
* [SCIENCEBASE-7441] - As a SB stakeholder, I need to report on the SB System file metrics

Task
* [SCIENCEBASE-7398] - Review and modify files-api flask app to fit in with the current vision
* [SCIENCEBASE-7405] - Create Search Results Wireframe
* [SCIENCEBASE-7435] - Review and update pysb documentation
* [SCIENCEBASE-7445] - Search Service: Secure Item GET to prevent unauthorized access to items.
* [SCIENCEBASE-7449] - Handle token refresh and logout if expired in React apps like Search UI
* [SCIENCEBASE-7456] - Identify/Execute the Next Steps for new SB3 home
* [SCIENCEBASE-7471] - Advanced Search Cleanup
* [SCIENCEBASE-7475] - Attach Large File from Black Pearl Storage to ScienceBase Item
* [SCIENCEBASE-7476] - Update dev-is signer aws access credentials
* [SCIENCEBASE-7480] - Add new file model
* [SCIENCEBASE-7481] - Research ORM to the files-api (SQLAlchemy)
* [SCIENCEBASE-7482] - Add presigning of upload/download URLs to the files-api
* [SCIENCEBASE-7483] - Upgrade React and Refactor Auth to use Context
* [SCIENCEBASE-7484] - Restore/re-implement Gitlab CI/CD for running branches of search-ui for FQA testing before merging
* [SCIENCEBASE-7487] - Add file model to files API
* [SCIENCEBASE-7498] - Deploy files-api to dev-is
* [SCIENCEBASE-7507] - Implement batch updates to pySB script for ORCID updates
* [SCIENCEBASE-7518] - Search Service: Gitlab CI Testing, Alpha Deployment, Faster Beta deployment, etc

Improvement
* [SCIENCEBASE-7439] - Change Default Date Range to longer than 6 months

Bug
[SCIENCEBASE-7438] - JavaScript errors when loading ScienceBase by the Numbers
[SCIENCEBASE-7470] - Receive Cannot get property 'files' on null object when attempting to upload a sd file

Task
[SCIENCEBASE-7474] - Metrics: Change ordering on Repo Metrics

Improvement
[SCIENCEBASE-7428] - Weblink attributes for new TNM HTMC download formats


Bug
SCIENCEBASE-7437 - Unable to upload a file from the extension tab

Bug
[SCIENCEBASE-7420] - Item Hidden Properties remain after Item has been deleted (and shouldn't)

Task
[SCIENCEBASE-7395] - Complete search deploy in cloud
[SCIENCEBASE-7399] - Document plan for upgrading SB2 to work with the latest files API and uploader
[SCIENCEBASE-7402] - Add ORCID Search filter to advanced SB3 search form
[SCIENCEBASE-7403] - Implement rule for ORCID import from AD
[SCIENCEBASE-7404] - Script to update Contact's name with ORCID on existing SB items
[SCIENCEBASE-7412] - Deploy 2.151.0
[SCIENCEBASE-7415] - Add links to view audit json to SB for UX
[SCIENCEBASE-7419] - Add monitoring for metrics
[SCIENCEBASE-7421] - Default to have the rich text enabled on body when editing item

Improvement
[SCIENCEBASE-7393] - Add the Ability to Query ScienceBase by IPDS#
[SCIENCEBASE-7411] - Clean up SD service refresh
[SCIENCEBASE-7416] - Add link to large file uploader in file tab
[SCIENCEBASE-7417] - Pass an error/message on files > 50MB when using PySB replace_file method



Bug
[SCIENCEBASE-4302] - Incorrect permissions on directory parties
[SCIENCEBASE-6472] - URISyntaxException in DOI code
[SCIENCEBASE-7118] - Directory: Querys for People, Parties and Org Text and logo needs fixed
[SCIENCEBASE-7397] - auto-complete is not working on manage permissions
[SCIENCEBASE-7414] - auto-complete is not working on manage permissions

New Feature
[SCIENCEBASE-7396] - create script to fix/update permissions for parties in directory

Task
[SCIENCEBASE-7078] - Determine if readme files in Gitlab are updated to help Systems team support SB team
[SCIENCEBASE-7391] - Add orcId to the elastic index config.
[SCIENCEBASE-7406] - ArcGIS Service process hanging
[SCIENCEBASE-7413] - Python Functional test is failing

Improvement
[SCIENCEBASE-6215] - Add in 'Import Contact by ID' feature to PySB
[SCIENCEBASE-7392] - 'Data Release' Category Type is Being Dropped When Refining Search Results
[SCIENCEBASE-7394] - Don't display contact details on catalogParty view page if private flag is enabled in directory

Bug

[SCIENCEBASE-6503] - Who tab: Autocomplete does not work on Point of Con
[SCIENCEBASE-6850] - Edits / Minor Bug Resolution in Item 'Edit' Page
[SCIENCEBASE-7032] - Advanced Search: Contact Name Like does not work
[SCIENCEBASE-7360] - Edit form - You are able to save an item as a child item to itself.
[SCIENCEBASE-7370] - Enable ck editor when user clicks a button on the edit form
[SCIENCEBASE-7371] - Update Where ScienceBase Looks for GeometryServer Service
[SCIENCEBASE-7382] - Add file does not route to files tab
[SCIENCEBASE-7383] - Who tab: Next And Previous does not work on Contact Type if field is populated
[SCIENCEBASE-7387] - My Folder button on Pick a Destination does not work

Task

[SCIENCEBASE-6579] - Remove the ability to upload from Drop-box from large file uploader
[SCIENCEBASE-7381] - Create a Jenkins Job for SB elastic replication
[SCIENCEBASE-7389] - Investigate SB heap dump on 5/15/18

Improvement
[SCIENCEBASE-7332] - Allow a .csv File to be Opened Directly From an Item
[SCIENCEBASE-7374] - Meet with Product Owner to Discuss UI Improvements - Placeholder for Dev Actions
[SCIENCEBASE-7375] - Add pagination to the Audit history json
[SCIENCEBASE-7377] - Improve Error Message when Save Destination is not selected
[SCIENCEBASE-7378] - Allow the Ability for a USGS Person in ScienceBase Directory to be Made Private