Blog

Blog

ScienceBase Version August Released 2018-08-31

Sub-task
* [SCIENCEBASE-7605] - Create prod SB elasticsearch copy of public items in Prod-IS
* [SCIENCEBASE-7606] - Deploy sbSearch service to Prod-IS
* [SCIENCEBASE-7607] - Deploy sbSearch UI to Prod-IS


Bug
* [SCIENCEBASE-7448] - Basis+ issue with subtasks as a child of the incorrect projectID
* [SCIENCEBASE-7479] - Full Index (without delete?) deletes index without configuring a new index
* [SCIENCEBASE-7497] - File processing is causing 429s and 400s and ignoring them
* [SCIENCEBASE-7566] - New search ui is not working in IE 11 or edge.
* [SCIENCEBASE-7568] - orcid keyword in elasticsearch index


New Feature

* [SCIENCEBASE-7541] - styling file list view (css-grid vs material-ui)
* [SCIENCEBASE-7542] - Create File View component
* [SCIENCEBASE-7565] - Deploy ScienceBase 2.157.0
* [SCIENCEBASE-7577] - create an AuthContext using react context api for files (pair)

Story
* [SCIENCEBASE-7563] - FQA: SCIENCEBASE-7531: s3-service is not monitored on catalog status page
* [SCIENCEBASE-7604] - Deploy SB3 Search to sciencebase.usgs.gov

Task
* [SCIENCEBASE-7425] - Add OIDC (Keycloak) authentication to files-api
* [SCIENCEBASE-7450] - Start Files UI
* [SCIENCEBASE-7451] - Whiteboard Files UI
* [SCIENCEBASE-7453] - Initial code review of new Advanced Search UI
* [SCIENCEBASE-7454] - Add lucene search capability on the New Advanced Search form
* [SCIENCEBASE-7455] - Add Max/Offset to New Advanced Search form
* [SCIENCEBASE-7491] - Deploy files-api to dev-is
* [SCIENCEBASE-7492] - Next Steps on SB3 home page
* [SCIENCEBASE-7493] - Make SB3 home page mobile responsive
* [SCIENCEBASE-7508] - Use sdkman for docker-grails image
* [SCIENCEBASE-7510] - Add caching for gitlab kubernetes runners
* [SCIENCEBASE-7520] - SB3_Advanced Search: type ahead for Contact and Tag is not working
* [SCIENCEBASE-7525] - Fix footer on SB Search UI
* [SCIENCEBASE-7526] - Add a Photo Collections powered by ScienceBase page
* [SCIENCEBASE-7527] - Whiteboard Files UI
* [SCIENCEBASE-7533] - Deploy NDC Dashboard version 2.x
* [SCIENCEBASE-7534] - Deploy ScienceBase 2.156.0
* [SCIENCEBASE-7535] - Add missing search features from current Advanced Search to new Search UI
* [SCIENCEBASE-7538] - Create File list view component
* [SCIENCEBASE-7539] - Create upload component
* [SCIENCEBASE-7548] - Filter My Files view by user_id
* [SCIENCEBASE-7549] - Set up underlying GraphQL-enabled PostgresDB
* [SCIENCEBASE-7554] - Generate presigned urls for uploads
* [SCIENCEBASE-7560] - MVP for upload progress reporting
* [SCIENCEBASE-7564] - Use the apollo cache for storing a users files
* [SCIENCEBASE-7602] - Deploy files-api to dev-is

Improvement
* [SCIENCEBASE-7521] - New SB3 home improvments
* [SCIENCEBASE-7536] - Use CloudWatch for Search Service (dev-api.sciencebase.gov) logs
* [SCIENCEBASE-7603] - SB3 - Advanced search - Date filter not working
* [SCIENCEBASE-7608] - Deploy process for (/etc/appconfig) configuration files for beta/prod services in the cloud.

ScienceBase Version 2.157.0 Released 2018-08-23


Bug
* [SCIENCEBASE-7532] - Turn off debug logging in production for s3-service


Improvement
* [SCIENCEBASE-7509] - Streamline the process for attaching a Black Pearl file to a ScienceBase item
* [SCIENCEBASE-7531] - s3-service is not monitored on catalog status page

ScienceBase Version 2.156.0 Released 08-09-2018

Bug
* [SCIENCEBASE-7436] - Trim of extra spaces on web links URI
* [SCIENCEBASE-7486] - prod-es4 down, other nodes overcompensating
* [SCIENCEBASE-7494] - error sorting tags in GSP taglib
* [SCIENCEBASE-7502] - Unexpected System Error when downloading file added from S3 bucket
* [SCIENCEBASE-7528] - Unable to download a file hosted on Cloud using the anonymous link token

Task
* [SCIENCEBASE-7499] - Test the new DOI API
* [SCIENCEBASE-7501] - Metrics: Change ordering on Repo Metrics
* [SCIENCEBASE-7523] - WRET SB Vocab Updates

ScienceBase Version July Released 2018-07-31

Story
* [SCIENCEBASE-7441] - As a SB stakeholder, I need to report on the SB System file metrics

Task
* [SCIENCEBASE-7398] - Review and modify files-api flask app to fit in with the current vision
* [SCIENCEBASE-7405] - Create Search Results Wireframe
* [SCIENCEBASE-7435] - Review and update pysb documentation
* [SCIENCEBASE-7445] - Search Service: Secure Item GET to prevent unauthorized access to items.
* [SCIENCEBASE-7449] - Handle token refresh and logout if expired in React apps like Search UI
* [SCIENCEBASE-7456] - Identify/Execute the Next Steps for new SB3 home
* [SCIENCEBASE-7471] - Advanced Search Cleanup
* [SCIENCEBASE-7475] - Attach Large File from Black Pearl Storage to ScienceBase Item
* [SCIENCEBASE-7476] - Update dev-is signer aws access credentials
* [SCIENCEBASE-7480] - Add new file model
* [SCIENCEBASE-7481] - Research ORM to the files-api (SQLAlchemy)
* [SCIENCEBASE-7482] - Add presigning of upload/download URLs to the files-api
* [SCIENCEBASE-7483] - Upgrade React and Refactor Auth to use Context
* [SCIENCEBASE-7484] - Restore/re-implement Gitlab CI/CD for running branches of search-ui for FQA testing before merging
* [SCIENCEBASE-7487] - Add file model to files API
* [SCIENCEBASE-7498] - Deploy files-api to dev-is
* [SCIENCEBASE-7507] - Implement batch updates to pySB script for ORCID updates
* [SCIENCEBASE-7518] - Search Service: Gitlab CI Testing, Alpha Deployment, Faster Beta deployment, etc

Improvement
* [SCIENCEBASE-7439] - Change Default Date Range to longer than 6 months

ScienceBase Version 2.154.0 Released 2018-07-20

Bug
[SCIENCEBASE-7438] - JavaScript errors when loading ScienceBase by the Numbers
[SCIENCEBASE-7470] - Receive Cannot get property 'files' on null object when attempting to upload a sd file

Task
[SCIENCEBASE-7474] - Metrics: Change ordering on Repo Metrics

Improvement
[SCIENCEBASE-7428] - Weblink attributes for new TNM HTMC download formats


ScienceBase Version 2.153.0 Released 2018-06-29

Bug
SCIENCEBASE-7437 - Unable to upload a file from the extension tab

ScienceBase Version 2.152.0 Released 2018-06-14

Bug
[SCIENCEBASE-7420] - Item Hidden Properties remain after Item has been deleted (and shouldn't)

Task
[SCIENCEBASE-7395] - Complete search deploy in cloud
[SCIENCEBASE-7399] - Document plan for upgrading SB2 to work with the latest files API and uploader
[SCIENCEBASE-7402] - Add ORCID Search filter to advanced SB3 search form
[SCIENCEBASE-7403] - Implement rule for ORCID import from AD
[SCIENCEBASE-7404] - Script to update Contact's name with ORCID on existing SB items
[SCIENCEBASE-7412] - Deploy 2.151.0
[SCIENCEBASE-7415] - Add links to view audit json to SB for UX
[SCIENCEBASE-7419] - Add monitoring for metrics
[SCIENCEBASE-7421] - Default to have the rich text enabled on body when editing item

Improvement
[SCIENCEBASE-7393] - Add the Ability to Query ScienceBase by IPDS#
[SCIENCEBASE-7411] - Clean up SD service refresh
[SCIENCEBASE-7416] - Add link to large file uploader in file tab
[SCIENCEBASE-7417] - Pass an error/message on files > 50MB when using PySB replace_file method



ScienceBase Version 2.151.0 Released 2018-06-01

Bug
[SCIENCEBASE-4302] - Incorrect permissions on directory parties
[SCIENCEBASE-6472] - URISyntaxException in DOI code
[SCIENCEBASE-7118] - Directory: Querys for People, Parties and Org Text and logo needs fixed
[SCIENCEBASE-7397] - auto-complete is not working on manage permissions
[SCIENCEBASE-7414] - auto-complete is not working on manage permissions

New Feature
[SCIENCEBASE-7396] - create script to fix/update permissions for parties in directory

Task
[SCIENCEBASE-7078] - Determine if readme files in Gitlab are updated to help Systems team support SB team
[SCIENCEBASE-7391] - Add orcId to the elastic index config.
[SCIENCEBASE-7406] - ArcGIS Service process hanging
[SCIENCEBASE-7413] - Python Functional test is failing

Improvement
[SCIENCEBASE-6215] - Add in 'Import Contact by ID' feature to PySB
[SCIENCEBASE-7392] - 'Data Release' Category Type is Being Dropped When Refining Search Results
[SCIENCEBASE-7394] - Don't display contact details on catalogParty view page if private flag is enabled in directory

ScienceBase Version 2.150.0 Released 2018-05-22

Bug

[SCIENCEBASE-6503] - Who tab: Autocomplete does not work on Point of Con
[SCIENCEBASE-6850] - Edits / Minor Bug Resolution in Item 'Edit' Page
[SCIENCEBASE-7032] - Advanced Search: Contact Name Like does not work
[SCIENCEBASE-7360] - Edit form - You are able to save an item as a child item to itself.
[SCIENCEBASE-7370] - Enable ck editor when user clicks a button on the edit form
[SCIENCEBASE-7371] - Update Where ScienceBase Looks for GeometryServer Service
[SCIENCEBASE-7382] - Add file does not route to files tab
[SCIENCEBASE-7383] - Who tab: Next And Previous does not work on Contact Type if field is populated
[SCIENCEBASE-7387] - My Folder button on Pick a Destination does not work

Task

[SCIENCEBASE-6579] - Remove the ability to upload from Drop-box from large file uploader
[SCIENCEBASE-7381] - Create a Jenkins Job for SB elastic replication
[SCIENCEBASE-7389] - Investigate SB heap dump on 5/15/18

Improvement
[SCIENCEBASE-7332] - Allow a .csv File to be Opened Directly From an Item
[SCIENCEBASE-7374] - Meet with Product Owner to Discuss UI Improvements - Placeholder for Dev Actions
[SCIENCEBASE-7375] - Add pagination to the Audit history json
[SCIENCEBASE-7377] - Improve Error Message when Save Destination is not selected
[SCIENCEBASE-7378] - Allow the Ability for a USGS Person in ScienceBase Directory to be Made Private

ScienceBase Version 2.149.0 Released 2018-04-30


Bug
[SCIENCEBASE-7327] - Import from URL (Build Item from GitHub Page) Not Working
[SCIENCEBASE-7336] - CSW Not Working for USGIN Partner
[SCIENCEBASE-7361] - Fix broken gov.sciencebase.task.basis.BasisItemReaderTest.FetchBasisXMLFiles test in Catalog
[SCIENCEBASE-7364] - ScienceBase no longer recognizes and scrapes ISO-19115-2
[SCIENCEBASE-7376] - catalog-inventory: ItemFileInventory fails with duplicated key

New Feature
[SCIENCEBASE-7265] - Query and create user-role memberships by username and role name
[SCIENCEBASE-7318] - Enable ScienceBase Audit History to be Accessible via JSON

Task
[SCIENCEBASE-7015] - EROS url linking to item for file downloads from EROS
[SCIENCEBASE-7273] - Restart jmx_exporter monitors on tomcat systems
[SCIENCEBASE-7294] - Create a separate app for catalog-inventory which runs the file inventory job(s)
[SCIENCEBASE-7301] - Deploy backend to api-dev.sciencebase.gov/files
[SCIENCEBASE-7312] - Deploy public-search-service to https://dev-api.sciencebase.gov/search
[SCIENCEBASE-7313] - Deploy public-search-ui to dev-sciencebase.usgs.gov/search
[SCIENCEBASE-7323] - Create a Jenkins Job for SB elastic replication
[SCIENCEBASE-7325] - Metrics Pruning
[SCIENCEBASE-7338] - Deploy SB version 2.149.0
[SCIENCEBASE-7345] - Document the Apache Log Collector
[SCIENCEBASE-7346] - Document the Metrics application
[SCIENCEBASE-7347] - Document the Black Pearl
[SCIENCEBASE-7352] - Modlfy Cloud Watch Alarm for database Cloud metrics
[SCIENCEBASE-7353] - WAF harvest transition
[SCIENCEBASE-7354] - Files Inventory Transition
[SCIENCEBASE-7355] - Black Pearl Transition
[SCIENCEBASE-7356] - Metrics transition
[SCIENCEBASE-7357] - BASIS harvest transition
[SCIENCEBASE-7358] - Transition Files API
[SCIENCEBASE-7359] - Update S3 keys
[SCIENCEBASE-7362] - Create the deploy job for the Inventory App and Deploy
[SCIENCEBASE-7363] - Troubleshoot the metrics page

Improvement
[SCIENCEBASE-7366] - Run apache log collector on the same week from 2015, 2016, 2017, 2018
[SCIENCEBASE-7369] - User Reporting Error from S3 Download Link on ScienceBase Item

ScienceBase Version 2.148.0 Released 2018-03-30

Bug
[SCIENCEBASE-7308] - Email not working on large file downloads stored on S3
[SCIENCEBASE-7314] - Item Add S3 Files Compounds Files Added On Consecutive Adds
[SCIENCEBASE-7316] - Body text disappearing in edit mode
[SCIENCEBASE-7321] - CSS issue under Child Item
[SCIENCEBASE-7335] - Error: Save Failed on the upload of .sd files
[SCIENCEBASE-7340] - Jenkins Job Cleanup and Verification

New Feature
[SCIENCEBASE-7259] - Search Service: Copy "public" version of the extents index to the cloud
[SCIENCEBASE-7329] - Developer can deploy directory-ui

Task
[SCIENCEBASE-7253] - After file is uploaded into S3, an event is fired to let SB know (Publish s3:ObjectCreated:* events onto SQS)
[SCIENCEBASE-7274] - Document the WAF processing workflow for TNM
[SCIENCEBASE-7279] - Deploy ScienceBase 2.147.0
[SCIENCEBASE-7280] - Rework selenium_tests to work with a headless chromedriver within a container and get tests working in Gitlab CI
[SCIENCEBASE-7281] - Report a Problem link should not require the User to login
[SCIENCEBASE-7295] - Delete unused communities and roles in SB directory
[SCIENCEBASE-7303] - Add S3 files signing to the Files API
[SCIENCEBASE-7306] - Determine Metrics Data Strategy
[SCIENCEBASE-7307] - UI Work For Black Pearl "Add Files"
[SCIENCEBASE-7311] - public-search-service in GitLab CI
[SCIENCEBASE-7337] - Deploy SB Version 2.148.0
[SCIENCEBASE-7341] - Update Basis+ Harvester Credentials
[SCIENCEBASE-7344] - Basis+ Harvester - Check logs
[SCIENCEBASE-7349] - Document the BASIS relay process
[SCIENCEBASE-7351] - Create a separate app for catalog-inventory which runs the file inventory job(s)

Improvement
[SCIENCEBASE-7204] - Segregate SB Status Page

ScienceBase Version 2.147.0 Released 2018-03-01

Bug
[SCIENCEBASE-7314] - Item Add S3 Files Compounds Files Added On Consecutive Adds

New Feature
[SCIENCEBASE-7223] - Search UI: Query Builder, Advanced Search Form (react.js)
[SCIENCEBASE-7242] - Functional Selenium tests are automatically run after nightly beta deploy
[SCIENCEBASE-7250] - Search-UI: Facets/Aggregation Panel PT 3 (finish facets, cleanup search results, improve tests
[SCIENCEBASE-7289] - Implement elastic replication (or scheduled copy mechanism) from CSAHC-Prod to Cloud - Dev-IS and Prod-IS

Task
[SCIENCEBASE-7253] - After file is uploaded into S3, an event is fired to let SB know (Publish s3:ObjectCreated:* events onto SQS)
[SCIENCEBASE-7255] - Design Document: migrating existing files into the new SB Files

ScienceBase Version 2.146.0 Released 2018-02-20

Bug
[SCIENCEBASE-7236] - Investigate and Resolve TNM Harvest Issue
[SCIENCEBASE-7238] - Add feedback loop using large file uploader so JOSSO session does not expire
[SCIENCEBASE-7244] - Caching issue with Date Type = Date Taken
[SCIENCEBASE-7276] - Fix improper usages of the Elastic Scroll API

New Feature
[SCIENCEBASE-7222] - Search Service: Copy Item Index of PUBLIC Items for new Search Service (in the cloud)
[SCIENCEBASE-7256] - Functional tests for catalog (/items) searches are automatically run after nightly beta deploy

Task
[SCIENCEBASE-7206] - Configure Prometheus deployment from Gitlab environment
[SCIENCEBASE-7228] - Add hidden properties to Pysb
[SCIENCEBASE-7237] - Clean up broken breadcrumbs
[SCIENCEBASE-7268] - Gather requirements for standardizing Python deployments
[SCIENCEBASE-7285] - Add IOS to Realm in Directory


ScienceBase Version 2.145.0 Released 2018-02-02

Bug
[SCIENCEBASE-6999] - ScienceBase allows the same relationship to be created multiple times
[SCIENCEBASE-7119] - Update Logic Contact Import on a ScienceBase Item to Preserve 'contact type' if a Value is Present
[SCIENCEBASE-7193] - Problem with bad/duplicate ancestors
[SCIENCEBASE-7231] - LdapPersonService - java.lang.NullPointerException: Cannot get property 'ldapPerson' on null object
[SCIENCEBASE-7233] - Unknown error when attempting 7.3 GB tiff file via large file uploader
[SCIENCEBASE-7234] - PySB 'Replace File' Exhibits Strange Behavior for file in Facets
[SCIENCEBASE-7260] - Investigate and Resolve TNM Harvest Issue



New Feature
[SCIENCEBASE-7070] - Search Service: Create External ScienceBase Search Service (for PUBLIC Items) PT 1
[SCIENCEBASE-7147] - Cloud Deploy: Deploy for Grails 3 apps (with CI)
[SCIENCEBASE-7149] - Cloud Deploy: Deploy for Grails 2 apps (with CI)
[SCIENCEBASE-7176] - Python-Flask (or ?) web app that uses Open ID Connect
[SCIENCEBASE-7210] - Search-UI: Facets/Aggregation Panel PT 1
[SCIENCEBASE-7212] - Create file metadata scrape service
[SCIENCEBASE-7247] - Search-UI: Facets/Aggregation Panel PT 2
[SCIENCEBASE-7263] - Search Service: Copy Item Index of PUBLIC Items for new Search Service (in the cloud)

Task
[SCIENCEBASE-6931] - Create method to change MyUSGS account name in ScienceBase PT 1
[SCIENCEBASE-7114] - Determine if nginx/nginx plus is an option for Authentication
[SCIENCEBASE-7129] - WRET Help documentation / sample for managing their vocabs
[SCIENCEBASE-7217] - Update File data model for handling File Groups
[SCIENCEBASE-7239] - Review USGS Black Pearl User Stories with Spectra Logic Technical Team
[SCIENCEBASE-7240] - Review USGS Black Pearl User Stories with Spectra Logic Technical Team
[SCIENCEBASE-7241] - Script to fix broken breadcrumbs
[SCIENCEBASE-7261] - Use the new UploadOnly IAM role for file-upload
[SCIENCEBASE-7262] - Configure Prometheus deployment from Gitlab environment

Improvement
[SCIENCEBASE-7232] - Follow up to display rules for a 'public' org when executing a non-logged-in search in ScienceBase Catalog

User Feedback/Request
[SCIENCEBASE-6553] - Expose Information for Public Organizations from SB Directory

ScienceBase Version 2.144.0 Release 2018-01-11

Bug
[SCIENCEBASE-7157] - NDC Dashboard not showing keywords
[SCIENCEBASE-7218] - WAF error when attempting to update a DOI

Story
[SCIENCEBASE-7221] - SB Files Flask API SQLAlchemy Database Binding

New Feature
[SCIENCEBASE-7071] - Make the hidden table a key value list
[SCIENCEBASE-7139] - Search UI : Child Items section with tree view for the children on the Item page
[SCIENCEBASE-7143] - Search UI: completing the Files section
[SCIENCEBASE-7144] - Search UI: Kick Start Search Results Design
[SCIENCEBASE-7148] - Files API: begin SB-files API
[SCIENCEBASE-7172] - Kubernetes deployment namespace provisioning and app deployment
[SCIENCEBASE-7174] - Files API: Design REST API (and strategy to refactor catalog to use it?)
[SCIENCEBASE-7220] - Search UI: Add routing and pagination

Task
[SCIENCEBASE-6989] - Setup SQS Listener app
[SCIENCEBASE-7162] - Start scaffolded file event listener app
[SCIENCEBASE-7178] - Deployment logistics for sb services in the cloud (2)
[SCIENCEBASE-7184] - Deploy ScienceBase 2.144.0
[SCIENCEBASE-7202] - System Setup
[SCIENCEBASE-7203] - Investigate why SB Catalog restarted multiple times
[SCIENCEBASE-7216] - Prepare for Whiteboard Black Pearl discussion

Improvement
[SCIENCEBASE-7002] - Expose Hidden Table through the SB API
[SCIENCEBASE-7120] - Pull in Both the "Organization" and the "Person" from a Contact element (cntorgp OR cntperp) in an FGDC Record
[SCIENCEBASE-7187] - Error in logs elasticsearch query due to upgrade


IT Infrastructure Change
[SCIENCEBASE-7214] - BASIS+ Harvester Expiring Passwords