Skip to main content

Description

pg_clickhouse is a PostgreSQL extension that enables remote query execution on ClickHouse databases, including a foreign data wrapper. It supports PostgreSQL 13 and higher and ClickHouse 23 and higher.

Getting started

The simplest way to try pg_clickhouse is the Docker image, which contains the standard PostgreSQL Docker image with the pg_clickhouse and re2 extensions:
See the tutorial to get started importing ClickHouse tables and pushing down queries.

Usage

Versioning policy

pg_clickhouse adheres to Semantic Versioning for its public releases.
  • The major version increments for API changes
  • The minor version increments for backward compatible SQL changes
  • The patch version increments for binary-only changes
Once installed, PostgreSQL tracks two variations of the version:
  • The library version (defined by PG_MODULE_MAGIC on PostgreSQL 18 and higher) includes the full semantic version, visible in the output of the pgch_version() function or the Postgres pg_get_loaded_modules() function.
  • The extension version (defined in the control file) includes only the major and minor versions, visible in the pg_catalog.pg_extension table, the output of the pg_available_extension_versions() function, and \dx pg_clickhouse.
In practice this means that a release that increments the patch version, e.g. from v0.1.0 to v0.1.1, benefits all databases that have loaded v0.1 and don’t need to run ALTER EXTENSION to benefit from the upgrade. A release that increments the minor or major versions, on the other hand, will be accompanied by SQL upgrade scripts, and all existing database that contain the extension must run ALTER EXTENSION pg_clickhouse UPDATE to benefit from the upgrade.

DDL SQL reference

The following SQL DDL expressions use pg_clickhouse.

CREATE EXTENSION

Use CREATE EXTENSION to add pg_clickhouse to a database:
Use WITH SCHEMA to install it into a specific schema (recommended):

ALTER EXTENSION

Use ALTER EXTENSION to change pg_clickhouse. Examples:
  • After installing a new release of pg_clickhouse, use the UPDATE clause:
  • Use SET SCHEMA to move the extension to a new schema:

DROP EXTENSION

Use DROP EXTENSION to remove pg_clickhouse from a database:
This command fails if there are any objects that depend on pg_clickhouse. Use the CASCADE clause to drop them, too:

CREATE SERVER

Use CREATE SERVER to create a foreign server that connects to a ClickHouse server. Example:
The supported options are:
  • driver: The ClickHouse connection driver to use, either “binary” or “http”. Required.
  • compression: Native-protocol compression for the “binary” driver, one of “none”, “lz4”, or “zstd”. Defaults to “lz4”. Ignored by the “http” driver.
  • dbname: The ClickHouse database to use upon connecting. Defaults to “default”.
  • fetch_size: Approximate batch size in bytes for HTTP streaming. Batches split on row boundaries. Defaults to 50000000 (50 MB). 0 disables streaming and buffers the full response. Foreign tables can override this value.
  • host: The host name of the ClickHouse server. Defaults to “localhost”;
  • port: The port to connect to on the ClickHouse server. Defaults as follows:
    • 9440 if driver is “binary” and host is a ClickHouse Cloud host
    • 9004 if driver is “binary” and host isn’t a ClickHouse Cloud host
    • 8443 if driver is “http” and host is a ClickHouse Cloud host
    • 8123 if driver is “http” and host isn’t a ClickHouse Cloud host
  • min_tls_version: Minimum TLS protocol version to negotiate on connections that use TLS. One of TLSv1, TLSv1.1, TLSv1.2, or TLSv1.3. Defaults to the TLS library’s own minimum. Applies to both drivers.
  • secure: Controls TLS for the connection. One of:
    • auto (default): use TLS when host is a ClickHouse Cloud host or port is a secure port; plaintext otherwise.
    • on (or true/yes/1): always use TLS. Defaults port to 8443 (“http”) or 9440 (“binary”).
    • off (or false/no/0): never use TLS. Defaults port to 8123 (“http”) or 9000 (“binary”).

ALTER SERVER

Use ALTER SERVER to change a foreign server. Example:
The options are the same as for CREATE SERVER.

DROP SERVER

Use DROP SERVER to remove a foreign server:
This command fails if any other objects depend on the server. Use CASCADE to also drop those dependencies:

CREATE USER MAPPING

Use CREATE USER MAPPING to map a PostgreSQL user to a ClickHouse user. For example, to map the current PostgreSQL user to the remote ClickHouse user when connecting with the taxi_srv foreign server:
The supported options are:
  • user: The name of the ClickHouse user. Defaults to “default”.
  • password: The password of the ClickHouse user.

ALTER USER MAPPING

Use ALTER USER MAPPING to change the definition of a user mapping:
The options are the same as for CREATE USER MAPPING.

DROP USER MAPPING

Use DROP USER MAPPING to remove a user mapping:

IMPORT FOREIGN SCHEMA

Use IMPORT FOREIGN SCHEMA to import all the tables defines in a ClickHouse database as foreign tables into a PostgreSQL schema:
Use LIMIT TO to limit the import to specific tables:
Use EXCEPT to exclude tables:
pg_clickhouse will fetch a list of all the tables in the specified ClickHouse database (“demo” in the above examples), fetch column definitions for each, and execute CREATE FOREIGN TABLE commands to create the foreign tables. Columns will be defined using the supported data types and, were detectable, the options supported by CREATE FOREIGN TABLE.
Imported Identifier Case PreservationIMPORT FOREIGN SCHEMA runs quote_identifier() on the table and column names it imports, which double-quotes identifiers with uppercase characters or blank spaces. Such table and column names thus must be double-quoted in PostgreSQL queries. Names with all lowercase and no blank space characters don’t need to be quoted.For example, given this ClickHouse table:
IMPORT FOREIGN SCHEMA creates this foreign table:
Queries therefore must quote appropriately, e.g.,
To create objects with different names or all lowercase (and therefore case-insensitive) names, use CREATE FOREIGN TABLE.

CREATE FOREIGN TABLE

Use CREATE FOREIGN TABLE to create a foreign table that can query data from a ClickHouse database:
The supported table options are:
  • database: The name of the remote database. Defaults to the database defined for the foreign server.
  • fetch_size: Approximate batch size in bytes for HTTP streaming. Overrides server-level fetch_size. Defaults to 50000000 (50 MB). 0 disables streaming and buffers the full response.
  • table_name: The name of the remote table. Default to the name specified for the foreign table.
  • engine: The table engine used by the ClickHouse table. For CollapsingMergeTree() and AggregatingMergeTree(), pg_clickhouse automatically applies the parameters to function expressions executed on the table.
Use the data type appropriate for the remote ClickHouse data type of each column. The supported column options are:
  • column_name: The name of the column on the ClickHouse side, used in preference to the PostgreSQL attribute name when deparsing queries and inserts. Useful for mapping unquoted lowercase PostgreSQL column names to case-sensitive ClickHouse columns, e.g.,
  • AggregateFunction: The name of the aggregate function applied to an AggregateFunction Type column. Map the data type to the ClickHouse type passed to the function and specify the name of the aggregate function via the appropriate column option and pg_clickhouse will automatically append Merge to an aggregate function evaluating the column.
  • SimpleAggregateFunction: The name of the aggregate function applied to an SimpleAggregateFunction Type column. Map the data type to the ClickHouse type passed to the function and specify the name of the aggregate function via the appropriate column option.

ALTER FOREIGN TABLE

Use ALTER FOREIGN TABLE to change the definition of a foreign table:
The supported table and column options are the same as for CREATE FOREIGN TABLE.

DROP FOREIGN TABLE

Use DROP FOREIGN TABLE to remove a foreign table:
This command fails if there are any objects that depend on the foreign table. Use the CASCADE clause to drop them, too:

DML SQL reference

The SQL DML expressions below may use pg_clickhouse. Examples depend on these ClickHouse tables:

EXPLAIN

The EXPLAIN command works as expected, but the VERBOSE option triggers the ClickHouse “Remote SQL” query to be emitted:
This query pushes down to ClickHouse via a “Foreign Scan” plan node, the remote SQL.

SELECT

Use the SELECT statement to execute queries on pg_clickhouse tables just like any other tables:
pg_clickhouse works to push query execution down to ClickHouse as much as possible, including aggregate functions. Use EXPLAIN to determine the pushdown extent. For the above query, for example, all execution is pushed down to ClickHouse
pg_clickhouse also pushes down JOINs to tables that are from the same remote server:
Joining with a local table will generate less efficient queries without careful tuning. In this example, we make a local copy of the nodes table and join to it instead of the remote table:
In this case, we can push more of the aggregation down to ClickHouse by grouping on node_id instead of the local column, and then join to the lookup table later:
The “Foreign Scan” node now pushes down aggregation by node_id, reducing the number of rows that must be pulled back into Postgres from 1000 (all of them) to just 8, one for each node.

PREPARE, EXECUTE, DEALLOCATE

As of v0.1.2, pg_clickhouse supports parameterized queries, mainly created by the PREPARE command:
Use EXECUTE as usual to execute a prepared statement:
Parameterized execution prevents the http driver from properly converting DateTime time zones on ClickHouse versions prior to 25.8, when the underlying bug was fixed. Note that sometimes PostgreSQL will use a parameterized query plan even without using PREPARE. For any queries on that require accurate time zone conversion, and where upgrading to 25.8 or later is not an option, use the binary driver, instead.
pg_clickhouse pushes down the aggregations, as usual, as seen in the EXPLAIN verbose output:
Note that it has sent the full date values, not the parameter placeholders. This holds for the first five requests, as described in the PostgreSQL PREPARE notes. On the sixth execution, it sends ClickHouse {param:type}-style query parameters: parameters:
Use DEALLOCATE to deallocate a prepared statement:

INSERT

Use the INSERT command to insert values into a remote ClickHouse table:

COPY

Use the COPY command to insert a batch of rows into a remote ClickHouse table:
⚠️ Batch API Limitations pg_clickhouse hasn’t yet implemented support for the PostgreSQL FDW batch insert API. Thus COPY currently uses INSERT statements to insert records. This will be improved in a future release.

LOAD

Use LOAD to load the pg_clickhouse shared library:
It’s not normally necessary to use LOAD, as Postgres will automatically load pg_clickhouse the first time any of its features (functions, foreign tables, etc.) are used. The one time it may be useful to LOAD pg_clickhouse is to SET pg_clickhouse parameters before executing queries that depend on them.

SET

Use SET to set the pg_clickhouse custom configuration parameters.

pg_clickhouse.session_settings

The pg_clickhouse.session_settings parameter configures ClickHouse settings to be set on subsequent queries. Example:
The default is join_use_nulls 1, group_by_use_nulls 1, final 1. Set it to an empty string to fall back on the ClickHouse server’s settings.
The syntax is a comma-delimited list of key/value pairs separated by one or more spaces. Keys must correspond to ClickHouse settings. Escape spaces, commas, and backslashes in values with a backslash:
Or use single quoted values to avoid escaping spaces and commas; consider using dollar quoting to avoid the need to double-quote:
If you care about legibility and need to set many settings, use multiple lines, for example:
Some settings will be ignored in cases where they would interfere with the operation of pg_clickhouse itself. These include:
  • date_time_output_format: the http driver requires it to be “iso”
  • format_tsv_null_representation: the http driver requires the default
  • output_format_tsv_crlf_end_of_line the http driver requires the default
Otherwise, pg_clickhouse does not validate the settings, but passes them on to ClickHouse for every query. It thus supports all settings for each ClickHouse version. Note that pg_clickhouse must be loaded before setting pg_clickhouse.session_settings; either use shared library preloading or simply use one of the objects in the extension to ensure it loads.

pg_clickhouse.pushdown_regex

The pg_clickhouse.pushdown_regex parameter controls whether pg_clickhouse pushes down regular expression functions and operators. It does so by default; set this parameter to false to prevent them from being pushed down:
See Regular Expressions for details.

ALTER ROLE

Use ALTER ROLE’s SET command to preload pg_clickhouse and/or SET its parameters for specific roles:
Use the ALTER ROLE’s RESET command to reset pg_clickhouse preloading and/or parameters:

Preloading

If every or nearly every Postgres connection needs to use pg_clickhouse, consider using shared library preloading to automatically load it:

session_preload_libraries

Loads the shared library for every new connection to PostgreSQL:
Useful to take advantage of updates without restarting the server: just reconnect. May also be set for specific users or roles via ALTER ROLE.

shared_preload_libraries

Loads the shared library into the PostgreSQL parent process at startup time:
Useful to save memory and load overhead for every session, but requires the cluster to be restart when the library is updated.

Data types

pg_clickhouse maps the following ClickHouse data types to PostgreSQL data types. IMPORT FOREIGN SCHEMA uses the first type in the PostgreSQL column when importing columns; additional types may be used in CREATE FOREIGN TABLE statements:
ClickHousePostgreSQLNotes
Boolboolean
Datedate
Date32date
DateTimetimestamptz
Decimalnumeric
Float32real
Float64double precision
IPv4inet
IPv6inet
Int16smallint
Int32integer
Int64bigint
Int8smallint
JSONjsonb, json
Stringtext, bytea
UInt16integer
UInt32bigint
UInt64bigintErrors on values > BIGINT max
UInt8smallint
UUIDuuid
Additional notes and details follow.

BYTEA

ClickHouse does not provide the equivalent of the PostgreSQL BYTEA type, but allows any bytes to be stored in String type. In general ClickHouse strings should be mapped to the PostgreSQL TEXT, but when using binary data, map it to BYTEA. Example:
That final SELECT query will output:
Note that if there are any nul bytes in the ClickHouse columns, a foreign table using TEXT columns will not output the proper values:
Will output:
Note that rows two and three contain truncated values. This is because PostgreSQL relies on nul-terminated strings and does not support nuls in its strings. Attempting to insert binary values into TEXT columns will succeed and work as expected:
The text columns will be correct:
But reading them as BYTEA will not:
As a rule, only use TEXT columns for encoded strings and use BYTEA columns only for binary data, and never switch between them.

Function and operator reference

Functions

These functions provide the interface to query a ClickHouse database.

clickhouse_raw_query

Connect to a ClickHouse service via its HTTP interface, execute a single query, and disconnect. The optional second argument specifies a connection string that defaults to host=localhost port=8123. The supported connection parameters are:
  • host: The host to connect to; required.
  • port: The HTTP port to connect to; defaults to 8123 unless host is a ClickHouse Cloud host, in which case it defaults to 8443
  • dbname: The name of the database to connect to.
  • username: The username to connect as; defaults to default
  • password: The password to use to authenticate; defaults to no password
By default, no role has EXECUTE access to this function; consider GRANTing access only to roles that legitimately need to execute ad-hoc ClickHouse queries, e.g., a dedicated ClickHouse admin role: Useful for queries that return no records, but queries that do return values will be returned as a single text value:

Pushdown functions

pg_clickhouse pushes down a subset of the PostgreSQL builtin functions used in conditionals (HAVING and WHERE clauses). That subset maps to ClickHouse equivalents as follows:

Pushdown operators

Custom functions

These custom functions created by pg_clickhouse provide foreign query pushdown for select ClickHouse functions with no PostgreSQL equivalents. If any of these functions can’t be pushed down they will raise an exception.

Extension pushdown

pg_clickhouse recognizes functions from select core and third-party extensions, pushing them down to their ClickHouse equivalents.

re2

All re2 extension functions push down 1:1 to ClickHouse:

intarray

One intarray function pushes down to ClickHouse:

fuzzystrmatch

Two fuzzystrmatch functions push down to ClickHouse:

Pushdown casts

pg_clickhouse pushes down casts such as CAST(x AS bigint) for compatible data types. For incompatible types the pushdown will fail; if x in this example is a ClickHouse UInt64, ClickHouse will refuse to cast the value. In order to push down casts to incompatible data types, pg_clickhouse provides the following functions. They raise an exception in PostgreSQL if they’re not pushed down.

Pushdown aggregates

These PostgreSQL aggregate functions pushdown to ClickHouse.

Custom aggregates

These custom aggregate functions created by pg_clickhouse provide foreign query pushdown for select ClickHouse aggregate functions with no PostgreSQL equivalents. If any of these functions can’t be pushed down they will raise an exception.

Pushdown ordered set aggregates

These ordered-set aggregate functions map to ClickHouse Parametric aggregate functions by passing their direct argument as a parameter and their ORDER BY expressions as arguments. For example, this PostgreSQL query:
Maps to this ClickHouse query:
Note that the non-default ORDER BY suffixes DESC and NULLS FIRST aren’t supported and will raise an error.

Pushdown window functions

These PostgreSQL window functions push down to ClickHouse with OVER (PARTITION BY ... ORDER BY ...) clauses, including frame specifications where applicable. Ranking functions (row_number, rank, dense_rank, ntile, cume_dist, percent_rank) omit their frame clause during pushdown because ClickHouse rejects frame specifications on these functions.

Compatibility notes

Regular expressions

While pg_clickhouse pushes down regular expressions to ClickHouse equivalents when pg_clickhouse.pushdown_regex is true (the default), and makes an effort to ensure a basic level of compatibility, be aware of the differences between the two and how pg_clickhouse handles them.
  • PostgreSQL supports POSIX Regular Expressions while ClickHouse supports RE2 Regular Expressions. Beware of differences in behavior: write RE2 when the regular expression will be evaluated by ClickHouse (e.g., in a WHERE clause) and POSIX when it will be evaluated by Postgres (e.g., in a SELECT clause).
  • pg_clickhouse pushes down the Postgres flags by prepending them to ClickHouse regular expression inside (?). For example:
    Becomes
  • The only flags both support, and therefore can be used when evaluated by ClickHouse, are:
    FlagAsNotes
    iicase-insensitive matching
    mm-s^ and $ match begin/end line in addition to begin/end text
    nm-sPostgres alias for m
    p-sdon’t let . and [^x] match \n
    sslet . and [^x] match \n
    ttight syntax, ignored
    wminverse partial newline-sensitive matching
    RE2 supports only these flags; don’t use any other Postgres flags.
  • This table summarizes the affects of the various flags (and no flag, which is the same as s) when matching newlines and line endings. Note that in Postgres, m and p prevent negated character classes ([^xyz]) from matching a newline, while the ClickHouse equivalents do not. Otherwise, the behaviors are the same in ClickHouse as in Postgres:
    Pattern applied to a\nbPostgresClickHouseSame?
    a.btruetrue✔︎
    a[^x]btruetrue✔︎
    a$falsefalse✔︎
    s Flag
    (?s)a.btruetrue✔︎
    (?s)a[^x]btruetrue✔︎
    (?s)a$falsefalse✔︎
    m Flag
    (?m)a.bfalsefalse✔︎
    (?m)a[^x]btruefalse
    (?m)a$truetrue✔︎
    p Flag
    (?p)a.bfalsefalse✔︎
    (?p)a[^x]btruefalse
    (?p)a$falsefalse✔︎
    w Flag
    (?w)a.btruetrue
    (?w)a[^x]btruetrue
    (?w)a$truetrue
  • Any other flags passed to regular expression functions will prevent pushdown of the function.
  • The exception is regexp_replace(), which also supports the g flag. When g is set, pg_clickhouse uses replaceRegexpAll() instead of replaceRegexpOne() and removes the flag before prepending other flags.
  • The replacement argument to Postgres regexp_replace() supports \& to refer to the entire match, while in ClickHouse supports \0 for the entire match. Be sure to use \0 when the function pushes down to ClickHouse.
  • Postgres regexp_match returns NULL when there are no matches, while the expressions it pushes down to return an empty array. Use COALESCE() to return an empty array instead of NULL to compare return values compatibly. For example:
To avoid all ambiguity, consider setting pg_clickhouse.pushdown_regex to prevent Postgres regular expression from pushing down to ClickHouse, and using the re2 extension, for which pg_clickhouse supports direct pushdown of ClickHouse-compatible RE2 regular expressions.

to_char()

PostgreSQL to_char() for timestamp and timestamp with time zone pushes down to ClickHouse formatDateTime only when the format argument is a non-NULL string constant whose every PostgreSQL keyword has a byte-for-byte identical ClickHouse equivalent. If the format is dynamic (not a Const), or contains any unsupported keyword or modifier, the call falls back to local evaluation in PostgreSQL — pushdown is never attempted with a partial translation, so output stays PG-compatible. Two-argument to_char() forms over numeric, interval, and other non-timestamp types never push down; ClickHouse formatDateTime only formats date-time values.

Translated keywords

PostgreSQLClickHouseMeaning
YYYY, yyyy%Y4-digit year
YY, yy%y2-digit year
MM, mm%mzero-padded month (01–12)
DD, dd%dzero-padded day of month (01–31)
DDD, ddd%jzero-padded day of year (001–366)
HH24, hh24%Hzero-padded 24-hour (00–23)
HH, hh, HH12, hh12%Izero-padded 12-hour (01–12)
MI, mi%izero-padded minute (00–59)
SS, ss%Szero-padded second (00–59)
Q, q%Qquarter (1–4)
Mon%babbreviated month name, e.g., Oct
Dy%aabbreviated weekday name, e.g., Mon
AM, PM%pmeridiem indicator, always uppercase

Quoted text and literals

Text wrapped in "..." passes through verbatim, with any literal % doubled to %% to escape ClickHouse’s specifier prefix. A \" outside quotes also passes through as a literal ". Inside "...", backslash only escapes "; other backslash sequences are treated as literal text.

Authors

David E. Wheeler Copyright (c) 2025-2026, ClickHouse
Last modified on July 2, 2026