SMP server PostgreSQL storage - feature branch (merge, dont squash) #1467
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
epoberezkin
commented
Feb 24, 2025
•
epoberezkin
commented
- connection pool agent, smp server: PostgreSQL connection pool #1468
- message expiration with postgres smp server: expire messages in postgres database, mark queues as deleted, combine tables #1471
- mark queues/notifiers as deleted on deletion and remove in expiration thread after some defined time (e.g., 2 weeks) - to mimic current store log retention, to allow debugging of absent queues. smp server: expire messages in postgres database, mark queues as deleted, combine tables #1471
- improve postgres store locking in some methods (see comments) smp server: update STM cache only after PostgreSQL update #1470
- refactor in journal store smp server: update STM cache only after PostgreSQL update #1470
- make agent tests work with postgres server
- remove lock from map on queue deletion?
- store cache misses?
- test queries
- combine queries in addQueue? smp server: expire messages in postgres database, mark queues as deleted, combine tables #1471
- checkMsgStoreMode
- failed migration should crash server and tests
* smp server: queue store typeclass * parameterize JournalMsgStore * typeclass for queue store * postgres WIP * compiles, passes tests * remove StoreType * split migrations * progress * addQueueRec * reduce type spaghetti * remove addQueue from typeclass definition * getQueue * test postgres storage in SMP server * fix schema * comment * import queues to postgresql * import queues to postgresql * log * fix test * counts * ci: test smp server with postgres backend (#1463) * ci: test smp server with postgres backend * postgres service * attempt * attempt * empty * empty * PGHOST attempt * PGHOST + softlink attempt * only softlink attempt * working attempt (PGHOST) * remove env var * empty * do not start server without DB schema, do not import when schema exists * export database * enable all tests, disable two tests * option for migration confirmation * comments --------- Co-authored-by: spaced4ndy <[email protected]>
* agent, smp server: PostgreSQL connection pool * simplify, create all connections before start * rename * remove imports
* refactor journal store * update postgres store methods to update STM cache only after DB update * todos * drop Co-authored-by: spaced4ndy <[email protected]> * fix GHC 8.10.7 --------- Co-authored-by: spaced4ndy <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.