CDI Software Development Cluster

Meeting Notes

September 26nd, 2019 @ 3:30PM ET / 1:30PM MT

Topic: Databases and Beyond!
 

Join from PC, Mac, Linux, iOS or Android : https://zoom.us/j/696628840

Or iPhone one-tap :

US: +1-669-900-6833,,696628840# or +14087403766,,696628840#

Or Telephone:

Dial(for higher quality, dial a number based on your current location):

US: +1 669 900 6833 or +1 408 740 3766 or +1 646 876 9923

Meeting ID: 696 628 840

Note that we have switched from GSTalk to Zoom for the time being, due to a number of usability/compatibility issues with the GSTalk platform.

 

Meeting Notes in Google Drive: Shared Google Drive Folder:

https://docs.google.com/document/d/1tC4Pmmhax_CTL2-wsjKlmqBA8DziRfelvJgbLKWPD5I/edit?usp=sharing

 

Please feel free to email questions, feedback or ideas to the meeting co-leads: Michelle - mguy@usgs.gov ; Jeremy - jknewson@usgs.gov ; Cassandra ccladino@usgs.gov

 

Attendees

Name

Email (if you are new)

Michelle Guy

 

Jeremy Newson

 

Cassandra Ladino

 

Blake Draper

 

Jeanne Jones

 

Becca Scully

rscully@usgs.gov

Steven Predmore

 

Mary Bucknell

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Recommended Video Resource:

Database Deep Dive | S1 E1 – How to Choose the Right Database for the Job”

https://www.youtube.com/watch?v=W9F9o2Acq0E  


Agenda

     Welcome and announcements

     Please fill in name and email in the attendees table

     *NEW* MS TEAM for Software - https://teams.microsoft.com/l/team/19%3ab34ccbb114b545faafb03ef7af656fff%40thread.skype/conversations?groupId=01927172-3614-4d93-9cbe-6e7c31ad371e&tenantId=0693b5ba-4b18-4d7b-9341-f32f400a5494

     We are always looking for topics, and your input and participation!

     Submit Ideas for a presentation here:

     https://docs.google.com/forms/d/e/1FAIpQLSccsoCmFH4aT1OQNKaMDG7-ngIAlyGgmqSRQwJc_uYFf_tVUQ/viewform

    CDI bison connect google calendar of all the collaboration area meetings and events - name is “GS CDI” owner is gs_cdi@usgs.gov (Also accessible Calendar wiki page or the Google Calendar link . )

    Become a future co-lead! Apply below:

   https://forms.gle/djjoxmN22H76qSr69

     AWS Database Freedom Project

     https://aws.amazon.com/solutions/databasemigrations/database-freedom/

     Mentioned in here https://docs.google.com/presentation/d/1gLK0yWLy4DpEbQCAocGbc96pg8INDO3bpDAxxybnvOc/edit?usp=sharing

     Database Scenarios

     Michelle - presentation https://docs.google.com/presentation/d/1gLK0yWLy4DpEbQCAocGbc96pg8INDO3bpDAxxybnvOc/edit?usp=sharing

     Moving from “free” proprietary (funded enterprise tools) when enterprise support ends is always a challenge.

     Try to stick with universal SQL verses customized SQL for specific databases.

     Pubs moving to postgres and Water Quality portal is moving to the cloud. Stored procedures is a big pain point.

      

     Jeremy will present will present a scenario

https://docs.google.com/presentation/d/1_NoZ-xSfbZcNWOaoG69Z7gYmKuWyK4-g7gHrkf1OJqE/edit?usp=sharing

https://jknewson.github.io/summitSloshApp/

     Overview of AWS databases and community discussion

     https://aws.amazon.com/products/databases/

     https://support.chs.usgs.gov/display/CHSKB/Services

     Hazards, earthquakes, real time data infrastructure, internal and public side. Public side has been working great, but is starting to show it’s age, had a big traffic spike in July, and site partially crashed because the database could not keep up with concurrent requests. Working on standing up AWS aurora because it scales really well with traffic spikes, hope to stand up by the end of the year.

     Postresql, Oracle, SQLServer, Mysql/Aurora, Redis, mongoDB, Redshift,

     Message queue technologies, increasingly important in microservices and DevOps development.

     Postgres support contracts? Most groups doing it on their own.

     Please feel free to email questions, feedback or ideas to the meeting co-leads: michelle - mguy@usgs.gov ; jeremy - jnewson@usgs.gov ; cassandra cladino@usgs.gov

     Next Month: Databases (Oracle, Postgres, do you have others?) and Datastores (redis, others?)

 

 

Discussion/Notes

      If anyone is currently using Kafka, I’d love to see a presentation on that. (Jeanne Jones)