@probitas/client-sql-duckdb
DuckDB client for Probitas scenario testing framework.
This package provides a DuckDB client designed for integration testing, with analytical query capabilities and Parquet/CSV file support.
Features
- Query Execution: Parameterized queries with type-safe results
- Transactions: Full transaction support
- File Formats: Native support for Parquet, CSV, and JSON files
- In-Memory Databases: Perfect for isolated test scenarios
- Analytical Queries: Optimized for OLAP workloads
- Resource Management: Implements
AsyncDisposablefor proper cleanup
Installation
deno add jsr:@probitas/client-sql-duckdb
Quick Start
import { createDuckDbClient } from "@probitas/client-sql-duckdb";
// In-memory database for testing
const client = await createDuckDbClient({
path: ":memory:",
});
// Query from Parquet files
const result = await client.query<{ id: number; name: string }>(
"SELECT id, name FROM read_parquet('data/*.parquet') WHERE active = ?",
[true]
);
console.log(result.rows);
// Analytical queries
const stats = await client.query(`
SELECT
date_trunc('month', created_at) as month,
COUNT(*) as count,
AVG(amount) as avg_amount
FROM transactions
GROUP BY 1
ORDER BY 1
`);
await client.close();
Transactions
await client.transaction(async (tx) => {
await tx.query("INSERT INTO accounts (id, balance) VALUES (?, ?)", [1, 100]);
await tx.query("INSERT INTO accounts (id, balance) VALUES (?, ?)", [2, 200]);
// Automatically committed if no error, rolled back on exception
});
Using with using Statement
await using client = await createDuckDbClient({ path: ":memory:" });
const result = await client.query("SELECT 42 as answer");
// Client automatically closed when block exits
Related Packages
| Package | Description |
|---|---|
@probitas/client-sql |
Common SQL types and utilities |
@probitas/client-sql-postgres |
PostgreSQL client |
@probitas/client-sql-mysql |
MySQL client |
@probitas/client-sql-sqlite |
SQLite client |
Links
Installation
deno add jsr:@probitas/client-sql-duckdbClasses
#CatalogError
class CatalogError extends DuckDbErrorDuckDbErrorError thrown for catalog errors (table not found, etc.).
| Name | Description |
|---|---|
name | — |
duckdbKind | — |
Constructor
new CatalogError(message: string, options?: DuckDbErrorOptions)Properties
- readonly
namestring - readonly
duckdbKind"catalog"
#ConstraintError
class ConstraintError extends SqlErrorSqlErrorError thrown when a constraint violation occurs.
| Name | Description |
|---|---|
name | — |
kind | — |
constraint | — |
Constructor
new ConstraintError(message: string, constraint: string, options?: SqlErrorOptions)Properties
- readonly
namestring - readonly
kind"constraint" - readonly
constraintstring
#DeadlockError
class DeadlockError extends SqlErrorSqlErrorError thrown when a deadlock is detected.
Constructor
new DeadlockError(message: string, options?: SqlErrorOptions)Properties
- readonly
namestring - readonly
kind"deadlock"
#DuckDbError
class DuckDbError extends SqlErrorSqlErrorBase error class for DuckDB-specific errors. Extends SqlError with DuckDB-specific properties.
Constructor
new DuckDbError(message: string, options?: DuckDbErrorOptions)Properties
- readonly
namestring - readonly
errorType?string
#DuckDbTransactionImpl
class DuckDbTransactionImpl implements SqlTransactionSqlTransaction| Name | Description |
|---|---|
begin() | Begin a new transaction. |
query() | — |
queryOne() | — |
commit() | — |
rollback() | — |
Constructor
new DuckDbTransactionImpl(conn: DuckDBConnection)Methods
static begin(): unknownBegin a new transaction.
query(): unknownqueryOne(): unknowncommit(): unknownrollback(): unknown#IoError
class IoError extends DuckDbErrorDuckDbErrorError thrown for IO-related errors (file not found, permission denied, etc.).
| Name | Description |
|---|---|
name | — |
duckdbKind | — |
Constructor
new IoError(message: string, options?: DuckDbErrorOptions)Properties
- readonly
namestring - readonly
duckdbKind"io"
#QuerySyntaxError
class QuerySyntaxError extends SqlErrorSqlErrorError thrown when a SQL query has syntax errors.
Constructor
new QuerySyntaxError(message: string, options?: SqlErrorOptions)Properties
- readonly
namestring - readonly
kind"query"
#SqlError
class SqlError extends ClientErrorClientErrorBase error class for SQL-specific errors. Extends ClientError with SQL-specific properties.
Constructor
new SqlError(message: string, kind: SqlErrorKind, options?: SqlErrorOptions)Properties
- readonly
namestring - readonly
sqlState?string
#SqlQueryResult
class SqlQueryResult<T = Record<string, any>>SQL query result with rows, metadata, and transformation methods.
| Name | Description |
|---|---|
ok | — |
rows | — |
rowCount | — |
duration | — |
metadata | — |
map() | Map rows to a new type. |
as() | Create class instances from rows. |
Constructor
new SqlQueryResult(init: SqlQueryResultInit<T>)Properties
- readonly
okboolean - readonly
rowCountnumber - readonly
durationnumber
Methods
map(): unknownMap rows to a new type.
as(): unknownCreate class instances from rows.
#SqlRows
class SqlRows<T> extends Array<T>Array<T>Row array with first/last helper methods.
Implements ReadonlyArray
| Name | Description |
|---|---|
first() | Get the first row, or undefined if empty. |
firstOrThrow() | Get the first row, or throw if empty. |
last() | Get the last row, or undefined if empty. |
lastOrThrow() | Get the last row, or throw if empty. |
Constructor
new SqlRows(items: readonly T[])Methods
first(): unknownGet the first row, or undefined if empty.
firstOrThrow(): unknownGet the first row, or throw if empty.
last(): unknownGet the last row, or undefined if empty.
lastOrThrow(): unknownGet the last row, or throw if empty.
Interfaces
#DuckDbClient
interface DuckDbClient extends AsyncDisposableDuckDB client interface.
| Name | Description |
|---|---|
config | The client configuration. |
dialect | The SQL dialect identifier. |
query() | Execute a SQL query. |
queryOne() | Execute a query and return the first row or undefined. |
transaction() | Execute a function within a transaction. |
queryParquet() | Query a Parquet file directly. |
queryCsv() | Query a CSV file directly. |
close() | Close the database connection. |
Properties
The client configuration.
- readonly
dialect"duckdb"The SQL dialect identifier.
Methods
query<T = Record<string, any>>(sql: string, params?: unknown[]): Promise<SqlQueryResult<T>>Execute a SQL query.
Parameters
sqlstring- SQL query string
params?unknown[]- Optional query parameters
queryOne<T = Record<string, any>>(sql: string, params?: unknown[]): Promise<T | undefined>Execute a query and return the first row or undefined.
Parameters
sqlstring- SQL query string
params?unknown[]- Optional query parameters
transaction<T>(fn: (tx: SqlTransaction) => unknown, options?: SqlTransactionOptions | DuckDbTransactionOptions): Promise<T>Execute a function within a transaction. Automatically commits on success or rolls back on error.
Parameters
fn(tx: SqlTransaction) => unknown- Function to execute within transaction
- Transaction options
queryParquet<T = Record<string, any>>(path: string): Promise<SqlQueryResult<T>>Query a Parquet file directly. DuckDB can read Parquet files without importing them.
Parameters
pathstring- Path to the Parquet file
queryCsv<T = Record<string, any>>(path: string): Promise<SqlQueryResult<T>>Query a CSV file directly. DuckDB can read CSV files without importing them.
Parameters
pathstring- Path to the CSV file
close(): Promise<void>Close the database connection.
#DuckDbClientConfig
interface DuckDbClientConfig extends CommonOptionsConfiguration for creating a DuckDB client.
Properties
- readonly
path?stringDatabase file path. Use
:memory:or omit for an in-memory database. - readonly
readonly?booleanOpen the database in read-only mode.
#DuckDbErrorOptions
interface DuckDbErrorOptions extends SqlErrorOptionsOptions for DuckDbError constructor.
| Name | Description |
|---|---|
errorType | DuckDB error type if available. |
Properties
- readonly
errorType?stringDuckDB error type if available.
#DuckDbTransactionOptions
interface DuckDbTransactionOptions extends SqlTransactionOptionsDuckDB-specific transaction options.
#SqlErrorOptions
interface SqlErrorOptions extends ErrorOptionsOptions for SqlError constructor.
| Name | Description |
|---|---|
sqlState | SQL State code (e.g., "23505" for unique violation) |
Properties
- readonly
sqlState?stringSQL State code (e.g., "23505" for unique violation)
#SqlQueryResultExpectation
interface SqlQueryResultExpectation<T>Expectation interface for SQL query results.
All methods return this for chaining.
| Name | Description |
|---|---|
ok() | Verify query succeeded |
notOk() | Verify query failed |
noContent() | Verify result has no rows |
hasContent() | Verify result has rows |
rows() | Verify exact row count |
rowsAtLeast() | Verify minimum row count |
rowsAtMost() | Verify maximum row count |
rowCount() | Verify exact affected row count |
rowCountAtLeast() | Verify minimum affected row count |
rowCountAtMost() | Verify maximum affected row count |
rowContains() | Verify a row contains the given subset |
rowMatch() | Custom row validation |
mapContains() | Verify mapped data contains the given subset |
mapMatch() | Custom mapped data validation |
asContains() | Verify instance contains the given subset |
asMatch() | Custom instance validation |
lastInsertId() | Verify exact lastInsertId |
hasLastInsertId() | Verify lastInsertId is present |
durationLessThan() | Verify query duration is below threshold |
Methods
ok(): thisVerify query succeeded
notOk(): thisVerify query failed
noContent(): thisVerify result has no rows
hasContent(): thisVerify result has rows
rows(count: number): thisVerify exact row count
Parameters
countnumber
rowsAtLeast(count: number): thisVerify minimum row count
Parameters
countnumber
rowsAtMost(count: number): thisVerify maximum row count
Parameters
countnumber
rowCount(count: number): thisVerify exact affected row count
Parameters
countnumber
rowCountAtLeast(count: number): thisVerify minimum affected row count
Parameters
countnumber
rowCountAtMost(count: number): thisVerify maximum affected row count
Parameters
countnumber
rowContains(subset: Partial<T>): thisVerify a row contains the given subset
Parameters
subsetPartial<T>
rowMatch(matcher: (rows: SqlRows<T>) => unknown): thisCustom row validation
Parameters
matcher(rows: SqlRows<T>) => unknown
mapContains<U>(mapper: (row: T) => unknown, subset: Partial<U>): thisVerify mapped data contains the given subset
Parameters
mapper(row: T) => unknownsubsetPartial<U>
mapMatch<U>(mapper: (row: T) => unknown, matcher: (mapped: U[]) => unknown): thisCustom mapped data validation
Parameters
mapper(row: T) => unknownmatcher(mapped: U[]) => unknown
asContains<U>(ctor: (row: T) => unknown, subset: Partial<U>): thisVerify instance contains the given subset
Parameters
ctor(row: T) => unknownsubsetPartial<U>
asMatch<U>(ctor: (row: T) => unknown, matcher: (instances: U[]) => unknown): thisCustom instance validation
Parameters
ctor(row: T) => unknownmatcher(instances: U[]) => unknown
lastInsertId(expected: bigint | string): thisVerify exact lastInsertId
Parameters
expectedbigint | string
hasLastInsertId(): thisVerify lastInsertId is present
durationLessThan(ms: number): thisVerify query duration is below threshold
Parameters
msnumber
#SqlQueryResultInit
interface SqlQueryResultInit<T>Options for creating a SqlQueryResult.
| Name | Description |
|---|---|
ok | Whether the query succeeded |
rows | The result rows |
rowCount | Number of affected rows (for INSERT/UPDATE/DELETE) |
duration | Query execution duration in milliseconds |
metadata | Additional metadata |
Properties
- readonly
okbooleanWhether the query succeeded
- readonly
rowsreadonly T[]The result rows
- readonly
rowCountnumberNumber of affected rows (for INSERT/UPDATE/DELETE)
- readonly
durationnumberQuery execution duration in milliseconds
Additional metadata
#SqlQueryResultMetadata
interface SqlQueryResultMetadataMetadata for SQL query results.
| Name | Description |
|---|---|
lastInsertId | Last inserted ID (for INSERT statements) |
warnings | Warning messages from the database |
Properties
- readonly
lastInsertId?bigint | stringLast inserted ID (for INSERT statements)
- readonly
warnings?readonly string[]Warning messages from the database
#SqlTransaction
interface SqlTransactionSQL transaction interface. Implementations should provide actual database-specific transaction handling.
| Name | Description |
|---|---|
query() | Execute a query within the transaction. |
queryOne() | Execute a query and return the first row or undefined. |
commit() | Commit the transaction. |
rollback() | Rollback the transaction. |
Methods
query<T = Record<string, any>>(sql: string, params?: unknown[]): Promise<SqlQueryResult<T>>Execute a query within the transaction.
Parameters
sqlstring- SQL query string
params?unknown[]- Optional query parameters
queryOne<T = Record<string, any>>(sql: string, params?: unknown[]): Promise<T | undefined>Execute a query and return the first row or undefined.
Parameters
sqlstring- SQL query string
params?unknown[]- Optional query parameters
commit(): Promise<void>Commit the transaction.
rollback(): Promise<void>Rollback the transaction.
#SqlTransactionOptions
interface SqlTransactionOptionsOptions for starting a transaction.
| Name | Description |
|---|---|
isolationLevel | Isolation level for the transaction |
Properties
Isolation level for the transaction
Functions
#convertDuckDbError
function convertDuckDbError(error: unknown): SqlErrorConvert a DuckDB error to the appropriate error class.
DuckDB errors are classified based on message content analysis.
Parameters
errorunknown
#createDuckDbClient
async function createDuckDbClient(config: DuckDbClientConfig): Promise<DuckDbClient>Create a new DuckDB client instance.
The client provides parameterized queries, transaction support, and DuckDB-specific features like direct Parquet and CSV file querying.
Parameters
configDuckDbClientConfig- DuckDB client configuration
Returns
Promise<DuckDbClient> — A promise resolving to a new DuckDB client instance
Examples
Using in-memory database (default)
const client = await createDuckDbClient({});
const result = await client.query("SELECT 42 as answer");
console.log(result.rows.first()); // { answer: 42 }
await client.close();
Using file-based database
const client = await createDuckDbClient({
path: "./data.duckdb",
});
Query Parquet files directly
// No need to import - query directly from Parquet
const result = await client.queryParquet<{ id: number; value: string }>(
"./data/events.parquet"
);
Query CSV files directly
const result = await client.queryCsv<{ name: string; age: number }>(
"./data/users.csv"
);
Transaction with auto-commit/rollback
await client.transaction(async (tx) => {
await tx.query("INSERT INTO users VALUES ($1, $2)", [1, "Alice"]);
await tx.query("INSERT INTO users VALUES ($1, $2)", [2, "Bob"]);
});
Using await using for automatic cleanup
await using client = await createDuckDbClient({});
const result = await client.query("SELECT 1");
// Client automatically closed when scope exits
#expectSqlQueryResult
function expectSqlQueryResult<T = Record<string, any>>(result: SqlQueryResult<T>): SqlQueryResultExpectation<T>Create an expectation for a SQL query result.
Parameters
resultSqlQueryResult<T>
Type Aliases
#DuckDbErrorKind
type DuckDbErrorKind = "io" | "catalog" | "parser" | "binder"DuckDB-specific error kinds.
#SqlErrorKind
type SqlErrorKind = "query" | "constraint" | "deadlock" | "unknown"SQL-specific error kinds.
#SqlIsolationLevel
type SqlIsolationLevel = "read_uncommitted" | "read_committed" | "repeatable_read" | "serializable"Transaction isolation level.
