Upgrading from OX Dovecot Pro 2.3.x to Dovecot Pro 3.x

Dovecot Pro

Product Changes

• The Director architecture has been deprecated and removed. Dovecot Pro 3.x only supports the new Dovecot Pro Palomar architecture.
  • See Transition from OX Dovecot Pro 2.3.x Architecture.
• AWS S3 Storage no longer can use object listings. Instead, Dictmap must be used.
  • See Migration from Dovecot Pro 2.3.x.
• sdbox and mdbox are no longer supported for NFS installations. Dovecot Pro 3.x only supports the obox mailbox format. Dovecot Pro 2.3.x NFS/dbox installations MUST migrate users to obox for 3.0.
  • See Obox: NFS.

Added Features

Settings

• metacache_forced_refresh_interval

Removed Features

Feature	Replacement
License Plugin	Plugin has been removed and the license_checksum setting is marked obsolete.

Settings

Settings	Description
metacache_disable_merging	Use metacache_index_merging = none instead.
obox_allow_inconsistency	The setting has been removed as it caused problems with caching IMAP clients, which may lose emails permanently or otherwise become confused about their internal state.
v1 option for metacache_index_merging	Option has been removed.

Dictmap Parameters

See Dictmap Parameters.

Parameter	Description
cleanup-uncertain	Previously, this parameter needed to be explicitly enabled; now it is enabled by default. It can be disabled by no-cleanup-uncertain.

Obox Parameters

See obox_fs.

Parameter	Description
absolute_timeout_msecs	Use absolute_timeout instead.
connect_timeout_msecs	Use connect_timeout instead.
delete_timeout_msecs	Use delete_timeout instead.
read_timeout_msecs	Use read_timeout instead.
slow_warn_msecs	Use slow_warn instead.
timeout_msecs	Use timeout setting instead.
write_timeout_msecs	Use write_timeout setting instead.

Changed Features

Default Settings

Setting	Old Default	New Default
fts_dovecot_mail_flush_interval	0	10
fts_dovecot_max_triplets	0	200
max-parallel-iter	1	10

Service Defaults

IMAP Hibernation

IMAP Hibernation is now enabled by default.

metacache UNIX socket listener

New default:

service metacache {
  unix_listener metacache {
    mode = 0660
    group = $default_internal_group
  }
}

Event Changes

Events

Event	Change
fs_object_write_uncertain	Event was added.

Doveadm

doveadm metacache pull

Added doveadm metacache pull command.

Dovecot Core

Configuration Changes

WARNING

Dovecot 2.3.x settings will NOT work unless the configuration is changed as described in this section.

Required Settings

The first setting in dovecot.conf MUST now be dovecot_config_version. This helps to avoid unexpected configuration changes in the future.

Another new required setting is dovecot_storage_version. This helps to avoid unexpected storage file format incompatibilities.

passdb/userdb Section Naming

passdb and userdb sections now require a name, i.e.:

# This gives an error:
passdb {
  ...
}

# Use this instead:
passdb some_name {
}

Empty userdb Variables

userdb fields can be set to empty value. Previously they became changed to yes value.

Unknown/Invalid Variables

Unknown/invalid %{variables} cause Dovecot errors. This may cause, e.g., authentication failures if the old (broken) behavior was relied on.

base64url Hash Modifier

Added base64url format to hash modifier in variable expansion. Example: %{sha1;format=base64url:username}. See variable modifiers.

fs-crypt

fs-crypt now requires encryption keys by default.

Event Filters

Size units are allowed when specifying event filter values. For example, 100kb is accepted as equivalent to 102400.

Interval units are allowed when specifying event filter values. For example, 1min is accepted as equivalent to 60000000.

Event filters support escaping wildcard * and ? characters by prefixing them with \.

Added Features

Settings

• auth_internal_failure_delay
• fts_message_max_size
• login_socket_path
• quota_mailbox_count
• quota_mailbox_message_count
• submission_add_received_header

Auth Policy Parameters

See authentication policy.

Parameter	Notes
fail_type parameter to auth_policy_request_attributes	Parameter was added.

Cassandra Parameters

See Cassandra configuration.

Parameter	Notes
log_retries	Parameter was added.

Cryptographic Features

Feature	Notes
ARGON2 password scheme	Support for the ARGON2 password scheme was added.
SCRAM-SHA-1, SCRAM-SHA-256	Support SASL mechanisms for outgoing connections.
X25519, X448	mail-crypt plugin and fs-crypt now support these curves.

LDAP Parameters

See LDAP authentication.

Feature	Notes
%{ldap_multi} variable	Variable was added to LDAP configuration file to allow for fetching a multi-valued attribute.

imapc_features Parameters

See imapc_features.

Feature	Notes
no-qresync	Parameter was added.

Removed Features

Backends and Plugins

Backend	Notes
checkpassword auth database	Use Lua authentication database instead.
Dict passdb & userdb driver	Use Lua authentication database instead.
Dict quota; Dirsize quota	These backends are removed. You should use quota count backend instead along with quota-clone plugin. Note that switching to quota count can cause all user's indexes to update, so reserve time for this.
imap-zlib plugin	The IMAP COMPRESS extension is now automatically enabled.
mailbox-alias plugin	Depending on the use case, replacement may be the namespace/mailbox/special_use mailbox setting and/or Sieve filters.
Memcached dict driver	Use Redis instead.
old-stats plugin	Use Statistics instead. auth_stats setting has been removed too.
shadow auth driver	Use PAM authentication database instead.
XZ Compression	You need to perform migration using a different compression format. With Maildir, you can try uncompressing all your mail and compressing them with another algorithm while Dovecot is not running.
zlib plugin	Use mail-compress plugin, with the configuration items mail_compress_save as well as mail_compress_save_level, instead.

Settings

Setting	Notes
auth_debug	Use log_debug filter instead. Example: log_debug=category=auth.
auth_default_realm	Replaced by auth_default_domain.
auth_stats
auth_worker_max_count	Use service-specific process limit.
dict_db_config	Berkeley DB is not supported anymore.
disable_plaintext_auth	Replaced by auth_allow_cleartext.
imap_id_log	Replaced by the imap_id_received event.
login_access_sockets	Use Lua authentication database instead. Dovecot will fail to start if this setting is present in configuration.
push_notification_backend	Use push_notification_driver instead.
quota_set
sieve_dir	See Sieve file storage location and Sieve script locations.
sieve_global_dir	See Sieve file storage location and Sieve script locations.
sieve_global_path	See Sieve file storage location and Sieve script locations.
sieve_vacation_max_subject_codepoints

Other Features

Feature	Notes
Dovecot director role	Replaced with the Dovecot Pro Palomar architecture.
Global ACL directory	Use global ACL file instead. See below for details on migration.
IMAP SETQUOTA command	Quota limits can no longer be modified using the IMAP SETQUOTA command. The set_quota setting has been removed.
IPC process	Has been merged to anvil.
OpenSSL support for older than 1.0.2	Older versions are not supported anymore.
Sieve extensions: notify, imapflags, vnd.dovecot.duplicate	These deprecated Sieve extensions have been removed.
"size.virtual" index record	size.virtual field is no longer written to dovecot.index.cache file as it is duplicating vsize record in dovecot.index file. Reading of the field from old files is supported.
ssl-parameters.dat	This file is no longer converted automatically by config process, you need to set ssl_dh setting if you need non-ECC Diffie-Hellman.
TCP wrapper support	Use Lua authentication database instead.
Weak password schemes	Weak password schemes are disabled by default; you need to use auth_allow_weak_schemes to enable them.

dict Proxy Parameters

See dict proxy.

Parameter	Notes
idle_msecs	Deprecated dict proxy parameter. Use dictionary idle timeout setting setting instead.
warn_slow_msecs	Deprecated dict proxy parameter. Use dictionary slow warning setting setting instead.

Cassandra Parameters

See Cassandra configuration.

Parameter	Notes
Cassandra ssl_verify=cert-dns setting	Removed, as it was deprecated by Cassandra cpp-driver due to it being insecure against MITM attacks.

Changed Features

Settings

Setting	Notes
fts_autoindex_exclude	Now honors namespaces.
mail_crypt_require_encrypted_user_key	Now accepts boolean values.
ssl	Connections from login_trusted_networks are now also required to be SSL/TLS encrypted with the setting ssl=required.
ssl_min_protocol	The SSLv3 option was removed, as it is no longer secure.

Default Settings

Setting	Old Default	New Default	Notes
imapc_features	Features "delay-login", "search", "fetch-headers", "fetch-bodystructure", "fetch-size" by default. Enable "acl" and "modseq" by default, if the remote server supports it.
mail_cache_max_headers_count	unlimited	100	New feature, explicitly set to 0 for the old behavior.
mail_cache_max_header_name_length	unlimited	100	New feature, explicitly set to 0 for the old behavior.
mail_location	empty	NO-NOSELECT	NO-NOSELECT is the new default behavior. To revert to the old default specify KEEP-NOSELECT.
mail_log_prefix	%s(%u)<%{pid}><%{session}>:	%s(%u)<%{process:pid}><%{session}>:	Uses new process key.
service/anvil/chroot	empty	<no value>	Anvil is no longer chrooted.
service/anvil/user	$default_internal_user	<no value>	Anvil runs as root.
service/auth-worker/process_limit	1	30

Service Defaults

LMTP

Default LMTP proxy destination port is now 24.

Doveadm

doveadm batch

The doveadm batch command was removed.

doveadm fs

doveadm fs put can now put metadata also.

doveadm indexer

Added doveadm indexer command.

doveadm save

Added -r received-date parameter. See doveadm save.

dsync

The dsync command symlink was removed. Use doveadm sync or doveadm backup commands directly instead.

Mailbox Commands

USER environment variable is no longer supported.

All mail commands require providing -u, -F or -A parameter. This will always be subject to user database lookup and requires access to auth userdb socket.

--no-userdb-lookup parameter

Added the --no-userdb-lookup parameter to doveadm mail commands.

ACLs

Use Global ACL Files instead of Global ACL Directories

To migrate the ACL directories into their respective files you have to do the following:

1. Create a new consolidated global ACL file.
2. For each subdirectory in the currently configured ACL directory, add a line starting with the mailbox name followed by the appropriate content.
3. Change the vfile parameter to the new ACL file.
4. Remove the old ACL directory parent.

Example

With the following starting configuration:

dovecot.conf

namespace {
  prefix = INBOX/
  separator = /
}

plugin {
  acl = vfile:/etc/dovecot/acls/
}

/etc/dovecot/acls/INBOX

owner lrwstipekxa
anyone lr
user=kim l

/etc/dovecot/acls/INBOX/foo/.DEFAULT

user=timo lr
user=kim lrw

/etc/dovecot/acls/INBOX/foo/bar

user=kim lrw

You have to create the new ACL file:

/etc/dovecot/dovecot-acl

# previously from /etc/dovecot/acls/INBOX
INBOX owner lrwstipekxa
INBOX anyone lr
INBOX user=kim l
# previously from /etc/dovecot/acls/foo/.DEFAULT
INBOX/foo user=timo lr
INBOX/foo user=kim lrw
# previously from /etc/dovecot/acls/foo/bar
INBOX/foo/bar user=kim lrw

Note that at this point you could simplify specific rules, e.g. use mailbox name wildcards to replace lines for a specific user: INBOX/* user=kim lrw.

And re-configure the ACL plugin:

dovecot.conf

plugin {
  acl = vfile:/etc/dovecot/dovecot-acl
}

Afterwards you can remove the old global ACL directory parent:

console

$ rm -rf /etc/dovecot/acls/

Event Changes

Core Events

Event	Change
auth_client_cache_flush_started	Event was removed.
auth_client_cache_flush_finished	Event was removed.
imap_id_received	Event was added.
login_aborted	Event was added.
mail_metadata_accessed	Event was added.
pop3_command_finished	Event was added.

Event Fields

Event	Field	Change
dns_worker_request_finished	cached	Field was added.
Mail user events	service	Field was added.
proxy_session_finished	error_code	Field was added.
proxy_session_finished	idle_usecs	Field was changed from idle_secs.
smtp_server_transaction_rcpt_finished	dest_host	Field was added.
smtp_server_transaction_rcpt_finished	dest_ip	Field was added.
sql_query_finished	consistency	Field was added.
sql_query_finished	error_consistency	Field was added.
Various	net_bytes_in	Field was changed from bytes_in.
Various	net_bytes_out	Field was changed from bytes_out.
Various	transport	transport=trusted was changed to transport=secured. See also secured connections.

Exports

Events can now be exported to a local file or a unix socket. See Event Export Transports.

Doveadm HTTP API

Boolean Request Values

The doveadm HTTP API now requires valid boolean values. Providing invalid boolean values will result in a 400 response.

Lua Authentication

Lua passdb/userdb now passes all args key/values to an initialization function. See Lua authentication initialization.