postgresql-resilient
Automatic reconnection support for PostgreSQL, built on top of postgresql-simple.
Motivation
The postgresql-simple package gives us the two following functions (see connection management).
connect :: ConnectInfo -> IO Connection
close :: Connection -> IO ()Once we acquire a Connection, it would work as long as there are no connectivity issues. However, if the PostgreSQL server becomes unreachable even for a second, such Connection will no longer be valid and you will need to close it and try to connect again, which could also fail if the server is still down.
So the tiny postgresql-resilient package provides a ResilientConnection from which we can always get a healthy connection. A background process will take care of checking the connection status and reconnecting when necessary. All with configurable retries and exponential back-offs as well as closing the connection once done using it (guaranteed by bracket).
Therefore, instead of using connect, you can leverage the following function.
withResilientConnection
:: forall a
. ResilientSettings
-> LogHandler
-> P.ConnectInfo
-> (ResilientConnection IO -> IO a)
-> IO aNote: it only depends on exceptions and postgresql-simple, yielding a tiny footprint.
Quick Start
import Database.PostgreSQL.Resilient
import qualified Database.PostgreSQL.Simple as P
withResilientConnection defaultResilientSettings logHandler connectInfo $ \pool ->
(conn :: P.Connection) <- getConnection pool
res <- P.query_ conn "SELECT * FROM foo"
putStrLn $ show res
logHandler :: String -> IO ()
logHandler = putStrLn
connectInfo :: P.ConnectInfo
connectInfo = P.ConnectInfo
{ P.connectHost = "localhost"
, P.connectPort = 5432
, P.connectUser = "postgres"
, P.connectPassword = ""
, P.connectDatabase = "store"
}
defaultResilientSettings :: ResilientSettings
defaultResilientSettings = ResilientSettings
{ healthCheckEvery = 3
, exponentialBackoffThreshold = 10
}E.g. using the managed library for your resources.
import Control.Monad.Managed
mkConnection :: Managed (ResilientConnection IO)
mkConnection = managed $ withResilientConnection
defaultResilientSettings logHandler connectInfo
main :: IO ()
main = with mkConnection $ \pool ->
(conn :: P.Connection) <- getConnection pool
doSomething connReconnection
Here are the logs of a simple connection example where the PostgreSQL server is shutdown on purpose and it's then brought back up a few seconds later.
$ cabal new-run postgresql-resilient-demo
Up to date
Connecting to PostgreSQL
Checking PostgreSQL connection status
[Only {fromOnly = "PostgreSQL 13.0 on x86_64-pc-linux-musl, compiled by gcc (Alpine 9.3.0) 9.3.0, 64-bit"}]
Checking PostgreSQL connection status
[Only {fromOnly = "PostgreSQL 13.0 on x86_64-pc-linux-musl, compiled by gcc (Alpine 9.3.0) 9.3.0, 64-bit"}]
Checking PostgreSQL connection status
Closing no longer valid PostgreSQL connection
Connecting to PostgreSQL
libpq: failed (could not connect to server: Connection refused
Is the server running on host "localhost" (::1) and accepting
TCP/IP connections on port 5432?
could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
)
> Retrying in 1 seconds.
Connecting to PostgreSQL
libpq: failed (could not connect to server: Connection refused
Is the server running on host "localhost" (::1) and accepting
TCP/IP connections on port 5432?
could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
)
> Retrying in 2 seconds.
Connecting to PostgreSQL
libpq: failed (could not connect to server: Connection refused
Is the server running on host "localhost" (::1) and accepting
TCP/IP connections on port 5432?
could not connect to server: Connection refused
Is the server running on host "localhost" (127.0.0.1) and accepting
TCP/IP connections on port 5432?
)
> Retrying in 4 seconds.
Connecting to PostgreSQL
Checking PostgreSQL connection status
[Only {fromOnly = "PostgreSQL 13.0 on x86_64-pc-linux-musl, compiled by gcc (Alpine 9.3.0) 9.3.0, 64-bit"}]
Checking PostgreSQL connection status
[Only {fromOnly = "PostgreSQL 13.0 on x86_64-pc-linux-musl, compiled by gcc (Alpine 9.3.0) 9.3.0, 64-bit"}]
^CClosing PostgreSQL connection
Shutdown PostgreSQL reconnection processThe health-check is performed every 3 seconds by default but it is configurable via the healthCheckEvery setting. The retries are exponential by ^2 seconds with a threshold of 10 seconds, also configurable via exponentialThreshold.