28 KiB
Configuration in Effect
This guide shows you how to load and validate configuration in an Effect application. Two modules work together:
ConfigProvider— reads raw data from a source (environment variables, JSON objects,.envfiles, directory trees).Config— describes what shape and types you expect, then decodes the raw data into typed values.
You describe what you need with Config, and the library figures out how to read and validate it using a ConfigProvider.
Getting Started
Reading a Single Value
The simplest case: read one value from an environment variable.
import { Config, Effect } from "effect"
const program = Effect.gen(function*() {
const host = yield* Config.String("HOST")
console.log(host)
})
Effect.runSync(program)
// reads HOST from process.env
When you yield a Config inside Effect.gen, it automatically uses the default ConfigProvider (which reads from process.env).
Reading Multiple Values
Use Config.all to group related keys:
import { Config, ConfigProvider, Effect } from "effect"
const dbConfig = Config.all({
host: Config.String("host"),
port: Config.Int("port")
})
const provider = ConfigProvider.fromUnknown({
host: "localhost",
port: 5432
})
const result = Effect.runSync(dbConfig.parse(provider))
// { host: "localhost", port: 5432 }
Reading Structured Config with a Schema
For larger configs, use Config.schema with a Schema.Struct:
import { Config, ConfigProvider, Effect, Schema } from "effect"
const AppConfig = Config.schema(
Schema.Struct({
host: Schema.String,
port: Schema.Int,
debug: Schema.Boolean
})
)
const provider = ConfigProvider.fromUnknown({
host: "localhost",
port: 8080,
debug: true
})
const result = Effect.runSync(AppConfig.parse(provider))
// { host: "localhost", port: 8080, debug: true }
The schema automatically decodes raw string values into their target types. For example, when reading from environment variables, "8080" becomes the number 8080 and "true" becomes the boolean true.
Config Constructors
Each constructor reads and decodes a configuration value into the appropriate type.
| Constructor | Decoded type | Notes |
|---|---|---|
Config.String(name?) |
string |
Any string |
Config.NonEmptyString(name?) |
string |
Rejects "" |
Config.Number(name?) |
number |
Includes NaN, Infinity |
Config.Finite(name?) |
number |
Rejects NaN and Infinity |
Config.Int(name?) |
number |
Integers only |
Config.Boolean(name?) |
boolean |
Accepts true/false, yes/no, on/off, 1/0, y/n |
Config.Port(name?) |
number |
Integer in 1–65535 |
Config.URL(name?) |
URL |
Parsed via the URL constructor |
Config.Date(name?) |
Date |
Rejects invalid dates |
Config.Duration(name?) |
Duration |
Parses "10 seconds", "500 millis", "Infinity", "-Infinity", etc. |
Config.LogLevel(name?) |
string |
One of All, Fatal, Error, Warn, Info, Debug, Trace, None |
Config.Redacted(name?) |
Redacted<string> |
Hidden from logs and toString |
Config.Literal(value, name?) |
literal type | Accepts only the given literal |
Config.Literals(values, name?) |
literal union | Accepts one of the given literals |
Config.Array(value, ...) |
ReadonlyArray<V> |
Accepts structural arrays and flat separated strings |
Config.Record(key, value, ...) |
Record<K, V> |
Accepts structural records and flat separated key-value strings |
The optional name parameter sets the local path segment for lookup. If the config is wrapped with Config.nested, the nested prefix is prepended to this local path. Omit name when the config should decode the provider root. Config.Array and Config.Record additionally accept an options object directly when no path is needed, or a path followed by the options object.
Parsing and Path Ownership
A Config exposes parse(provider); lookup prefixes are not part of this public method. Build paths declaratively with the constructor's name / path argument and Config.nested.
This keeps the two path responsibilities separate:
Config.schema(..., path)andConfig.nested(name)describe the logical path of a setting.ConfigProvider.mapInput,ConfigProvider.nested, and case-conversion combinators map logical paths to a source.
The same rule applies when a Config is yielded as an Effect: the config uses the current ConfigProvider, while its internally composed logical path stays an implementation detail.
Config Combinators
Config.withDefault — Fallback for Absent Input
Triggers when the config is absent. For Config.all, any absent child makes the group absent unless another child fails. A group default replaces the entire group; apply defaults to individual children to keep other supplied values. Validation and source errors still propagate.
import { Config, ConfigProvider, Effect } from "effect"
const port = Config.Int("port").pipe(Config.withDefault(3000))
const provider = ConfigProvider.fromUnknown({})
Effect.runSync(port.parse(provider)) // 3000
Config.option — Optional Values
Returns Option.some(value) on success and Option.none() when the config is absent. A successful undefined value is still a success, so a schema that accepts missing input produces Option.some(undefined), not Option.none().
import { Config, ConfigProvider, Effect } from "effect"
const maybePort = Config.option(Config.Int("port"))
const provider = ConfigProvider.fromUnknown({})
Effect.runSync(maybePort.parse(provider)) // { _tag: "None" }
Config.map — Transform a Value
import { Config } from "effect"
const upperHost = Config.String("HOST").pipe(
Config.map((s) => s.toUpperCase())
)
Config.orElse — Fallback on Any Error
Unlike withDefault, this handles absence and all ConfigErrors. The fallback's result replaces the original failure. If the fallback is absent, a later withDefault or option can recover it. If the fallback fails, only its error propagates:
import { Config } from "effect"
const host = Config.String("HOST").pipe(
Config.orElse(() => Config.succeed("localhost"))
)
Config.nested — Scope a Config Under a Prefix
Prepends a logical path segment to every key the inner config reads. The prefix is used for both provider lookups and schema error paths:
import { Config, ConfigProvider, Effect } from "effect"
const dbConfig = Config.all({
host: Config.String("host"),
port: Config.Int("port")
}).pipe(Config.nested("database"))
const provider = ConfigProvider.fromUnknown({
database: { host: "localhost", port: 5432 }
})
Effect.runSync(dbConfig.parse(provider))
// { host: "localhost", port: 5432 }
With environment variables, nesting uses _ as separator:
import { Config, ConfigProvider, Effect } from "effect"
const host = Config.String("host").pipe(Config.nested("database"))
const provider = ConfigProvider.fromEnv({
env: { database_host: "localhost" }
})
Effect.runSync(host.parse(provider)) // "localhost"
Multiple Config.nested calls compose with the outermost prefix first:
import { Config, ConfigProvider, Effect } from "effect"
const config = Config.String("host").pipe(
Config.nested("database"),
Config.nested("production")
)
const provider = ConfigProvider.fromUnknown({
production: {
database: {
host: "localhost"
}
}
})
Effect.runSync(config.parse(provider)) // "localhost"
Config.all — Combine Multiple Configs
Accepts a record, a tuple, or an iterable. A group is absent when any child is absent and no child fails. Config.withDefault replaces the entire absent group, and Config.option returns None. Validation and source errors propagate even when another child is absent.
import { Config } from "effect"
// As a record
const appConfig = Config.all({
host: Config.String("host"),
port: Config.Int("port"),
debug: Config.Boolean("debug")
})
// As a tuple
const pair = Config.all([Config.String("a"), Config.Int("b")])
For example, providing only host selects the default for the entire group here:
import { Config } from "effect"
const database = Config.all({
host: Config.String("host"),
port: Config.Int("port")
}).pipe(
Config.withDefault({ host: "localhost", port: 5432 })
)
If the provider contains { host: "db.internal" }, the result is { host: "localhost", port: 5432 }. To keep the supplied host and default only the port, put Config.withDefault(5432) on the port child instead.
Child defaults resolve missing children before the group decides whether it is absent:
const listener = Config.all({
host: Config.String("host"),
port: Config.Int("port").pipe(Config.withDefault(8080))
}).pipe(Config.option)
listener is None when host is absent, including when a valid port is present. It is Some when host is present and port resolves to either a supplied value or its default. An invalid port fails even if host is absent.
How Absence Is Decided
Configuration evaluation distinguishes three situations before producing the public Effect:
- Resolved — decoding succeeded. The value may legitimately be
undefined,{}, or[]. - Absent — a schema could not resolve because its relevant provider representation was unavailable, or a combined config has an absent child and no failed children.
- Failed — the provider failed, input was invalid, or an effectful transformation failed.
Config.withDefault and Config.option handle only the second case. Config.orElse handles both absence and failures and adopts the fallback's result. Once a failure is recovered, it does not influence enclosing groups or later defaults.
At the lookup path of a Config.schema, an unavailable representation is passed to the schema decoder as undefined. This includes a missing node and a present node whose shape cannot represent the schema: for example, an array node cannot represent a struct. Missing properties inside an object remain omitted so the schema's property semantics still apply. The decoder runs before absence is decided. Consequently:
Config.schema(Schema.UndefinedOr(Schema.String), "key")succeeds withundefinedwhenkeyis absent.- An explicitly present empty object can decode to
{}when the schema permits it. - Wrapping either successful result in
Config.optionproducesSome, because decoding succeeded. - If the schema rejects
undefinedand no relevant representation was found,Config.withDefaultuses its fallback andConfig.optionreturnsNone. - Present invalid data is a failure. A
Config.allgroup with missing children is absent unless another child fails. SourceErroris always a failure and is never replaced bywithDefaultoroption.
Config.schema(Schema.Struct(...)) and Config.all(...) describe different lookup models. A struct schema validates one structured input. An existing object, including an empty object, fails validation if required fields are missing. Config.all evaluates independent child configs and can recover a partially supplied group through Config.withDefault or Config.option. Field optionality in Config.all is expressed on each child with Config.option or Config.withDefault.
How Schema Input Is Loaded
Config.schema converts its codec to the canonical Schema.StringTree codec and uses the encoded AST to decide which provider representation to load:
- A scalar schema reads the node's scalar value. A record or array node may have a co-located scalar value in addition to its children.
- A struct loads its declared properties and omits children that the provider does not contain. A record schema also loads advertised keys that match its index signature.
- An array or tuple loads its indexed children. Missing positions are represented as
undefinedso the element schema decides whether they are valid. - A union whose members require different shapes materializes each member independently. Schema then applies the union's declared order or
oneOfrule and any checks attached to the original union.
This keeps the provider responsible only for reporting what exists. Schema remains responsible for deciding whether the loaded representation is valid.
Plain Schema.Array and Schema.Record accept structural provider input only. Use Config.Array(Schema.String, "items") for separated scalar input such as "a,b,c", and Config.Record(Schema.String, Schema.String, "items") for input such as "a=1,b=2". Both constructors also accept structural input.
The canonical StringTree encoding must expose a concrete scalar, object, array, or union shape. Config.schema rejects opaque encodings such as Schema.Any, Schema.Unknown, Schema.ObjectKeyword, Schema.Json, and Schema.MutableJson synchronously when the config is constructed, including when they are nested in another schema. Suspended recursive schemas and declarations such as Schema.URL remain supported when their eventual canonical encoding has a concrete shape. To read arbitrary JSON from one scalar provider value, use Schema.fromJsonString(Schema.Json).
Custom Config Logic
There is no public low-level Config.make constructor. For custom validation or transformation, start from one of the public constructors or Config.schema, then use Config.map, Config.mapEffect, Config.all, Config.orElse, or Config.withDefault.
If you need custom lookup behavior for a new backing source, implement a ConfigProvider with ConfigProvider.make instead.
Array and Record Constructors
Config.Array accepts { separator? }, while Config.Record accepts { separator?, keyValueSeparator? }. Pass the options object directly to read the provider root, or place a string or ConfigProvider.Path before it to select a path:
import { Config, Schema } from "effect"
const rootValues = Config.Array(Schema.String, { separator: ";" })
const namedValues = Config.Array(Schema.String, "VALUES", { separator: ";" })
const rootHeaders = Config.Record(Schema.String, Schema.String, { keyValueSeparator: ":" })
const namedHeaders = Config.Record(Schema.String, Schema.String, "HEADERS", { keyValueSeparator: ":" })
ConfigProvider Sources
The concrete built-in source providers fromEnv, fromDotEnvContents, fromDotEnv, fromUnknown, and fromDir treat literal empty strings as missing values by default when they are loaded as values. Container discovery still reflects the source structure, so a key or file can appear in a Record or Array node and then load as missing. Pass { preserveEmptyStrings: true } to preserve empty strings as explicit values.
At the raw provider interface, load(path) succeeds with Node | undefined: a
Node means the path exists, while undefined means it does not. A
SourceError represents a failure to read the source and remains in the Effect
error channel.
Lookup-level undefined is distinct from the value field of a found Record
or Array node. Such a container can exist while
node.value === undefined, which means that it has children but no co-located
scalar value.
ConfigProvider.fromEnv — Environment Variables (Default)
This is the default provider. Path segments are joined with _ for lookup.
import { Config, ConfigProvider, Effect } from "effect"
const provider = ConfigProvider.fromEnv({
env: {
DATABASE_HOST: "localhost",
DATABASE_PORT: "5432"
}
})
const host = Config.String("HOST").parse(
provider.pipe(ConfigProvider.nested("DATABASE"))
)
Effect.runSync(host) // "localhost"
How _ splitting works: env var names are split on _ to build a tree. This means DATABASE_HOST=localhost is accessible at both ["DATABASE_HOST"] (flat) and ["DATABASE", "HOST"] (nested). Querying ["DATABASE"] returns a Record node with child key "HOST".
Pass { env: { ... } } for testing. Omit to use process.env (merged with import.meta.env when available).
ConfigProvider.fromUnknown — Plain JS Objects
Ideal for testing or embedding config in code:
import { Config, ConfigProvider, Effect } from "effect"
const provider = ConfigProvider.fromUnknown({
database: {
host: "localhost",
port: 5432,
credentials: {
username: "admin",
password: "secret"
}
},
servers: ["server1", "server2", "server3"]
})
Path traversal follows standard JS rules: string segments index into object keys, numeric segments index into arrays. Primitive values are automatically stringified.
ConfigProvider.fromDotEnvContents — Parse .env Strings
When you already have the .env content as a string:
import { ConfigProvider } from "effect"
const contents = `
# Database settings
HOST=localhost
PORT=3000
SECRET="my-secret-value"
`
const provider = ConfigProvider.fromDotEnvContents(contents)
Supports export prefixes, single/double/backtick quoting, inline comments, and escaped newlines. Enable variable expansion with { expandVariables: true }:
import { ConfigProvider } from "effect"
const contents = `
PASSWORD=secret
DB_PASS=$PASSWORD
`
const provider = ConfigProvider.fromDotEnvContents(contents, {
expandVariables: true
})
ConfigProvider.fromDotEnv — Load .env Files
Reads a .env file from disk. Returns an Effect (requires FileSystem in context):
import { ConfigProvider, Effect } from "effect"
const program = Effect.gen(function*() {
const provider = yield* ConfigProvider.fromDotEnv()
// or: yield* ConfigProvider.fromDotEnv({ path: "/custom/.env" })
return provider
})
ConfigProvider.fromDir — Directory Trees
Reads config from a file-system tree where each file is a leaf and each directory is a container. Useful for Kubernetes ConfigMap/Secret volume mounts.
/etc/myapp/
database/
host # contains "localhost"
port # contains "5432"
api_key # contains "sk-abc123"
import { ConfigProvider, Effect } from "effect"
const program = Effect.gen(function*() {
const provider = yield* ConfigProvider.fromDir({
rootPath: "/etc/myapp"
})
return provider
})
Requires Path and FileSystem in the Effect context.
Missing files and directories return undefined, so fallback providers can handle the path. Empty files also return undefined by default after trimming their contents, while directory listings still report the file names present on disk; pass { preserveEmptyStrings: true } to preserve them as Value(""). Other file-system failures are reported as SourceError.
ConfigProvider.make — Custom Sources
Build a provider from any backing store:
import { ConfigProvider, Effect } from "effect"
const data: Record<string, string> = {
host: "localhost",
port: "5432"
}
const provider = ConfigProvider.make((path) => {
const key = path.join(".")
const value = data[key]
return Effect.succeed(
value !== undefined ? ConfigProvider.makeValue(value) : undefined
)
})
Return undefined for "not found" and a Node for a path that exists. Only
fail with SourceError when the source itself cannot be read. Providers created
with make automatically support the path-transformation behavior used by
mapInput, constantCase, and nested.
ConfigProvider Combinators
ConfigProvider.orElse — Fallback Sources
Falls back to a second provider when the first returns undefined (path not found). Does not catch SourceError.
import { ConfigProvider } from "effect"
const envProvider = ConfigProvider.fromEnv({
env: { HOST: "prod.example.com" }
})
const defaults = ConfigProvider.fromUnknown({
HOST: "localhost",
PORT: "3000"
})
const combined = ConfigProvider.orElse(envProvider, defaults)
Each side keeps its own path transformations. If you combine providers that were already scoped or mapped, those transformations remain local to that side:
import { ConfigProvider } from "effect"
const envProvider = ConfigProvider.fromEnv({
env: { DATABASE_HOST: "localhost" }
}).pipe(ConfigProvider.constantCase)
const defaults = ConfigProvider.fromEnv({
env: { APP_PORT: "3000" }
}).pipe(ConfigProvider.nested("APP"))
const combined = envProvider.pipe(ConfigProvider.orElse(defaults))
ConfigProvider.nested — Prefix All Lookups
Prepends path segments so that all lookups are scoped:
import { ConfigProvider } from "effect"
const provider = ConfigProvider.fromEnv({
env: { APP_HOST: "localhost", APP_PORT: "3000" }
})
// Lookups for ["HOST"] now resolve to ["APP", "HOST"]
const scoped = ConfigProvider.nested(provider, "APP")
Accepts a single string or a full Path array.
Provider transformations compose in application order. A later nested becomes the outer prefix:
import { ConfigProvider } from "effect"
const provider = ConfigProvider.fromEnv({
env: { B_A_KEY: "value" }
}).pipe(
ConfigProvider.nested("A"),
ConfigProvider.nested("B")
)
// path ["KEY"] resolves to ["B", "A", "KEY"]
When nested is applied to a provider built with ConfigProvider.orElse, the prefix is applied to both operands.
ConfigProvider.constantCase — CamelCase to SCREAMING_SNAKE_CASE
Bridges camelCase schema keys to environment variable naming:
import { ConfigProvider } from "effect"
const provider = ConfigProvider.fromEnv({
env: { DATABASE_HOST: "localhost" }
}).pipe(ConfigProvider.constantCase)
// path ["databaseHost"] now resolves to ["DATABASE_HOST"]
Ordering matters with nested. constantCase is a path transform, so it only converts the path it receives at that point in the pipeline:
import { ConfigProvider } from "effect"
const convertedPrefix = ConfigProvider.fromEnv({
env: { APP_HOST: "localhost" }
}).pipe(
ConfigProvider.nested("app"),
ConfigProvider.constantCase
)
// path ["host"] resolves to ["APP", "HOST"]
const literalPrefix = ConfigProvider.fromEnv({
env: { app_HOST: "localhost" }
}).pipe(
ConfigProvider.constantCase,
ConfigProvider.nested("app")
)
// path ["host"] resolves to ["app", "HOST"]
Put constantCase after nested when the prefix should be converted too.
ConfigProvider.mapInput — Arbitrary Path Transforms
Transform the whole path before lookup:
import { ConfigProvider } from "effect"
const provider = ConfigProvider.fromEnv({
env: { APP_HOST: "localhost" }
})
const upper = ConfigProvider.mapInput(
provider,
(path) => path.map((seg) => typeof seg === "string" ? seg.toUpperCase() : seg)
)
Path transformation is a capability of the ConfigProvider interface. The
exported ConfigProvider.mapInput combinator delegates to that capability,
rather than passing an extra transformation argument to load. This keeps
ordinary lookup fixed as load(path) and allows composite providers to
preserve their own behavior without exposing representation state. Custom
source providers should normally be constructed with ConfigProvider.make,
which implements this capability automatically.
mapInput runs after earlier provider transformations, so it sees the full path produced so far:
import { ConfigProvider } from "effect"
const appendLeaf = ConfigProvider.mapInput((path) => [...path, "leaf"])
const provider = ConfigProvider.fromEnv({
env: { APP_KEY_leaf: "value" }
}).pipe(
ConfigProvider.nested("APP"),
appendLeaf
)
// path ["KEY"] resolves to ["APP", "KEY", "leaf"]
When mapInput is applied to a provider built with ConfigProvider.orElse, the mapping is applied to both operands.
Installing a Provider
Using ConfigProvider.layer
Replaces the active provider for all downstream effects:
import { Config, ConfigProvider, Effect } from "effect"
const TestLayer = ConfigProvider.layer(
ConfigProvider.fromUnknown({ port: 8080 })
)
const program = Effect.gen(function*() {
const port = yield* Config.Int("port")
return port
})
Effect.runSync(Effect.provide(program, TestLayer)) // 8080
Using ConfigProvider.layerAdd
Adds a provider without replacing the existing one. By default, the new provider is a fallback:
import { ConfigProvider } from "effect"
const defaults = ConfigProvider.fromUnknown({
HOST: "localhost",
PORT: "3000"
})
// process.env is tried first; `defaults` is the fallback
const DefaultsLayer = ConfigProvider.layerAdd(defaults)
Set { asPrimary: true } to make the new provider the primary source instead.
Using Effect.provideService
For one-off overrides without layers:
import { Config, ConfigProvider, Effect } from "effect"
const provider = ConfigProvider.fromUnknown({ HOST: "localhost" })
const program = Effect.gen(function*() {
const host = yield* Config.String("HOST")
return host
}).pipe(
Effect.provideService(ConfigProvider.ConfigProvider, provider)
)
Two Ways to Run a Config
-
Yield in
Effect.gen— automatically uses the currentConfigProviderfrom the service map:const program = Effect.gen(function*() { const host = yield* Config.String("HOST") }) -
Call
.parse(provider)directly — useful for testing or when you have a specific provider:const host = Config.String("HOST") const result = Effect.runSync(host.parse(provider))The method accepts only the provider. Use
Config.nestedor the path argument ofConfig.schemato scope lookups.
Error Handling
Config operations fail with ConfigError, which wraps either:
SourceError— the provider could not read data (I/O failure, permission error). Hasmessageand optionalcauseproperties.SchemaError— data was found but didn't match the schema (wrong type, out of range, missing key).
Check error.cause._tag to distinguish:
import { Config, ConfigProvider, Effect } from "effect"
const program = Config.Int("PORT").parse(
ConfigProvider.fromUnknown({ PORT: "not-a-number" })
).pipe(
Effect.tapError((error) =>
Effect.sync(() => {
if (error.cause._tag === "SchemaError") {
console.log("Validation failed:", error.message)
} else {
console.log("Source error:", error.message)
}
})
)
)
Important: Config.withDefault and Config.option recover only from semantic absence. They do not classify SchemaIssue values as “missing.” Validation and source errors still propagate unless explicitly recovered with Config.orElse.
Practical Example: Web Server Config
import { Config, ConfigProvider, Effect, Schema } from "effect"
// Define your config shape
const ServerConfig = Config.schema(
Schema.Struct({
host: Schema.String,
port: Schema.Int,
logLevel: Schema.Literals(["debug", "info", "warn", "error"])
}),
"server"
)
const DbConfig = Config.schema(
Schema.Struct({
url: Schema.String,
poolSize: Schema.Int
}),
"db"
)
const AppConfig = Config.all({
server: ServerConfig,
db: DbConfig,
debug: Config.Boolean("debug").pipe(Config.withDefault(false))
})
// In production, just yield it — reads from process.env
const program = Effect.gen(function*() {
const config = yield* AppConfig
console.log(config)
})
// For testing, provide a specific provider
const testProvider = ConfigProvider.fromUnknown({
server: { host: "localhost", port: 3000, logLevel: "debug" },
db: { url: "postgres://localhost/testdb", poolSize: 5 },
debug: true
})
Effect.runSync(
program.pipe(Effect.provide(ConfigProvider.layer(testProvider)))
)
With environment variables, the same config reads:
server_host=localhost
server_port=3000
server_logLevel=debug
db_url=postgres://localhost/mydb
db_poolSize=10
debug=true