Implement new IMAP search feature, proposed by egh@e6h.org

2011-07-17  David Maus  <dmaus@ictsoc.de>

* elmo-util.el (elmo-list-difference): New function. Return
difference of two lists.
* elmo-imap4.el (elmo-imap4-search-generate-vector): Use function.

2011-07-03  Erik Hetzner  <egh@e6h.org>

* elmo-imap4.el (elmo-imap4-search-internal-primitive): Removed.
(elmo-imap4-search-build-full-command): New function. Build full
IMAP search command.
(elmo-imap4-search-perform): New function. Perform IMAP search.
(elmo-imap4-search-generate-vector): New function. Generate search
vector.
(elmo-imap4-search-mergeable-p): New function. Return non-nil if
two search conditions are mergeable.
(elmo-imap4-search-mergeable-charset): New function. Return
charset of two searches for merging.
(elmo-imap4-search-generate-uid): New function. Return search for
a set of messages.
(elmo-imap4-search-generate-and): New function. Return search that
returns intersection of two search commands.
(elmo-imap4-search-generate-or): New function. Return search that
returns union of two search commands.
(elmo-imap4-search-generate): New function. Return search in
folder.
(elmo-imap4-search-internal): Use new search functions.

This commit was manufactured by cvs2svn to create branch 'elmo-imap4-new-
search'.

Prevent accidental loss of messages when renaming IMAP4 mailbox

* elmo-imap4.el (elmo-imap4-session-unselect-mailbox): New
function. Leave selected state without silent EXPUNGE.
(elmo-folder-rename-internal): Use function.

CLOSE silently triggers EXPUNGE. Use UNSELECT (RFC3691) if the server
supports this extension, otherwise open mailbox read-only
(i.e. EXAMIME) before calling CLOSE.

Ported from branch elmo-imap4-compliance, deal with merge conflicts
later.

Document missing control strings for wl-summary-line-format

* wl-vars.el (wl-summary-line-format): Document missing control
strings.

Don't mark unread messages with important or answered flag read

* elmo-imap4.el (elmo-imap4-fetch-callback-1-subr): Don't mark unread
  messages with important or answered flag read.

* test-wl-address.el: New file.

* elmo-imap4.el (elmo-network-authenticate-session): Always ask
for capabilities after login.
(elmo-imap4-parse-response): Remove superfluous third argument to
split-string.

* ptexinfmt.el: Fix description comment style.

* ptexinfmt.el: Use lexical binding.
(ptexinfmt-broken-facility): Rename _dummy argument.
(texinfo-enclosure-list, texinfo-alias-list): Add defvar stub for
lexical binding.

* test-elmo-date.el: Add `lexical-binding' file variable.
* test-elmo-imap4.el: Ditto.
* test-elmo-localdir.el: Ditto.
* test-elmo-util.el: Ditto.
* test-rfc2368.el: Ditto.
* test-utf7.el: Ditto.
* test-wl-draft.el: Ditto.
* test-wl-util.el: Ditto.

* test-dist.el: Add `lexical-binding' file variable.
(test-wl-modules-trailing-whitespace, test-elmo-modules-exists)
(test-elmo-modules-trailing-whitespace)
(test-util-modules-exists)
(test-util-modules-trailing-whitespace, test-wl-icon-exists): Fix
let style for `lexical-binding'.

* WL-MK (wl-scan-path): New function.
(wl-scan-source): Use `wl-scan-path'.
(wl-scan-icons): New function.
(uninstall-wl-icons): Use `wl-scan-icons'.
Check existence of `PIXMAPDIR'.

* wl-demo.el (wl-demo-copyright-notice): Add 2011.

* wl-draft.el (wl-user-agent-compose): Add optional argument
  RETURN-ACTION, introduced to `compose-mail' in Emacs 24.

Cf. http://permalink.gmane.org/gmane.emacs.diffs/108339

* elmo-nntp.el (elmo-nntp-folder-msgdb-create): Remove accidental
rebinding of new message db symbol.

* wl-template.el (wl-template-select): Reset draft config exec
flag when selecting template.

Reset `wl-draft-config-exec-flag' so template specific configuration
is applied when sending the message.  Not resetting causes WL to use
configuration of previous template that matched the draft buffer.

* elmo-pop3.el (elmo-folder-open-internal): Don't load location map if
it is already loaded.

* elmo-map.el (elmo-folder-open-internal): Don't load location map if
it is already loaded.

* elmo.el (elmo-folder-open-internal-p)
(elmo-folder-move-messages): Method removed.
* elmo-filter.el (elmo-folder-open-internal-p): Dto.
* elmo-map.el (elmo-folder-open-internal-p): Dto.
* elmo-multi.el (elmo-folder-open-internal-p): Dto.
* elmo-pipe.el (elmo-folder-open-internal-p): Dto.
* elmo-pop3.el (elmo-folder-open-internal-p): Dto.
* elmo-shimbun.el (elmo-folder-open-internal-p): Dto.

Explicitly define method `elmo-folder-open-internal-p' for POP3 and
Shimbun folder class prevent calling this method of the first parent,
elmo-net-folder which falls back to the default behaviour, always
return t.

* elmo-pop3.el (elmo-folder-open-internal-p): Define method for this
class.
* elmo-shimbun.el (elmo-folder-open-internal-p): Dto.
* elmo-multi.el (elmo-folder-open-internal-p): Fix invalid let
statement.

* wl/wl-summary.el (wl-summary-mode): Check with fboundp before calling `make-local-hook'.
* wl/wl-mime.el (wl-draft-preview-message): Ditto.

* elmo-multi.el (elmo-folder-open-internal-p): Evaluate symbol to
return state of child folders.

Original patch by Kazuhiro Ito.

* elmo-multi.el (elmo-folder-open-internal-p): Start with t and
set to nil if one of the child folders is not open.
(elmo-folder-open-internal): Open child folders only if they are
not opened yet.

wl-demo.el: Prune functions provided temporarily to avoid compile warnings in the end.

Update.

Summary: Put spam mark on the message registered as spam and
         remove spam mark from the message registered as non-spam.

* wl/wl-spam.el (wl-spam-register-spam-messages): Put spam mark on
the registered messages unless specified folder is a spam folder.
Add docstring.
(wl-spam-register-good-messages): Remove spam mark from
the registered messages.  Add docstring.
(wl-summary-register-as-spam)
(wl-summary-register-as-spam-region, wl-thread-register-as-spam)
(wl-summary-register-as-spam-all)
(wl-summary-target-mark-register-as-spam)
(wl-summary-register-as-good)
(wl-summary-register-as-good-region, wl-thread-register-as-good)
(wl-summary-register-as-good-all)
(wl-summary-target-mark-register-as-good): Add docstring.

* ptexinfmt.el (texinfo-multitable-widths): Use `make-char' instead of KANJI literal.

* test-dist.el (test-elmo-modules-trailing-whitespace)
(test-util-modules-trailing-whitespace)
(test-wl-modules-trailing-whitespace): New testcases.

* elmo-imap4.el: Remove trailing whitespace.

* wl-summary.el: Delete trailing whitespace.

* wl-addrbook.el: Delete traing whitespace.
* wl-complete.el: Ditto.
* rfc2368.el: Ditto.
* ssl.el: Ditto.

* elmo-localdir.el (elmo-folder-pack-numbers): Fix `elmo-bind-directory' indent.

* elmo-imap4.el (elmo-imap4-folder-list-range): Fix indent (only cosmetic fix).

* wl-summary.el (wl-summary-prefetch-msg): Make the confirmation
message human-readable.

* elmo-util.el (elmo-delete-char): Fix `elmo-set-work-buf' indent.
(elmo-delete-cr, elmo-get-file-string, elmo-save-string)
(elmo-string-to-list, elmo-list-to-string): Ditto.

* elmo-archive.el (elmo-archive-field-condition-match)
(elmo-archive-suffix-alist)
(elmo-archive-create-file, elmo-archive-folder-append-buffer)
(elmo-archive-folder-message-make-temp-files)
(elmo-archive-append-files)
(elmo-archive-field-condition-match): Fix indent.

* wl-e21.el (wl-draft-insert-signature): Fix comment style.
(wl-highlight-folder-current-line): Ditto.
* wl-xmas.el (wl-draft-insert-signature): Ditto.
(wl-highlight-folder-current-line): Ditto.

* elmo-pop3.el (elmo-pop3-read-response): Fix `response-string'.
Avoid `args-out-of-range 0, 1' error.

* wl-address.el (wl-address-make-alist-from-alias-file): Use
`(delete-char -1)' instead of `(delete-backward-char 1)' that
deletes region in Emacs 24.
See delete-active-region described in NEWS.
* wl-draft.el (wl-draft-insert-mail-header-separator): Ditto.
* wl-summary.el (wl-summary-update-persistent-mark): Ditto.

* acap.el (acap-arrival-filter): Use (delete-char (- X)) instead of
(delete-backward-char X) that deletes region in Emacs 24.
See delete-active-region described in NEWS.
* elmo-imap4.el (elmo-imap4-arrival-filter): Ditto.
* elmo-util.el (elmo-get-file-string): Ditto.
* utf7.el (utf7-encode-internal, utf7-decode-internal): Ditto.

* wl-addrbook.el (wl-addrbook-insert-file): Use (delete-char -1)
instead of (delete-backward-char 1) or (backward-deletechar 1).

* ptexinfmt.el (texinfo-format-verb): Use (delete-char -1)
instead of (delete-backward-char 1); For Emacs24.

* wl-summary.el (wl-summary-mode-menu-spec): Add menu option to
edit draft message when in draft folder.

* elmo.el (elmo-folder-open-internal-p): New luna method.
(elmo-folder-move-messages): Open source folder only if necessary.
* elmo-pipe.el (elmo-folder-open-internal-p): New luna method.
* elmo-multi.el (elmo-folder-open-internal-p): Dto.
* elmo-map.el (elmo-folder-open-internal-p): Dto.
* elmo-filter.el (elmo-folder-open-internal-p): Dto.

ssl.el (open-ssl-stream, condition-case): Don't use old-style
backquotes.

Thanks to Daniel Clemente <dcl441-bugs@yahoo.com> for pointing at
this.

* elmo.el (elmo-folder-move-messages): Open source folder before
moving messages.

If move-messages is called during an expire operation in folder-mode,
the source folder is not open.

(wl-summary-put-temp-mark): Use (delete-char -1) instead of
 (delete-backward-char 1) that deletes region in Emacs 24.
 See delete-active-region described in NEWS.

* INSTALL: Update recommended version of APEL.
* INSTALL.ja: Ditto.

2010-07-11  David Maus  <dmaus@ictsoc.de>

* doc/wl.texi (Variables of Summary): Replace unicode character.

* wl-spam.el (wl-summary-register-as-spam-region)
(wl-thread-register-as-spam, wl-summary-register-as-good-region)
(wl-thread-register-as-good): New functions.
(wl-spam-setup): Bind "rks", "rkn", "tks" and "tkn".

Summary: Uninstall *.img files as well.

* WL-MK (uninstall-wl-icons): New function.  Uninstall *.img
files as well.
(uninstall-wl-package): Use `uninstall-wl-icons'.

Don't define vector with images for the icon if there is only one image.

This commit was manufactured by cvs2svn to create branch 'elmo-
imap4-compliance'.

* elmo-imap4.el (elmo-imap4-folder-name-syntax): Allow numbers in
  imap user name.

* elmo-imap4.el (elmo-imap4-disabled-extension): New
variable. List of server extensions that are disabled on the
client side.
(elmo-imap4-session-capable-p): Honour list of disabled
extensions.

Let user disable server extensions on the client side.  Provides way
to work around problematic or bugged server implementations
(e.g. problems with MS Exchange 2007 and ESEARCH capability).

* elmo-imap4.el (elmo-imap4-folder-list-flagged)
(elmo-imap4-search-internal-primitive): Pass filter type to imap
search when performing search for flagged messages.

* elmo-imap4.el (elmo-imap4-folder-list-flagged)
(elmo-imap4-search-internal-primitive): Pass filter type to
imap search when performing search for flagged messages.

Fixes debian bug #573726.

(wl-user-agent-insert-body): Make sure body ends with newline.
(wl-user-agent-compose, wl-user-agent-compose-internal): Fix regexps so as to
 match header tokens strictly.

* etc/icons/unplugged.xpm: Change design. Use `unplugged' style instead of `prohibition sign' style.

(wl-summary-test-spam): Call `wl-summary-unmark-spam' for the message not
 classified as spam.
(wl-summary-test-spam-messages): New function.
(wl-summary-test-spam-region): Use `wl-summary-test-spam-messages' instead of
 `wl-spam-map-spam-messages'.

Define unmark functions for temporary marks.

(wl-summary-action-unmark-docstring): New inline function.
(wl-summary-define-mark-action): Define unmark functions.
(wl-summary-unmark): Add the second argument `mark'.
(wl-summary-delete-all-mark): Pass `mark' to `wl-summary-unmark'.

Inhibit pgp autodecryption for draft preview

Fix date in Changelog.

Ask IMAP server for capabilities after login.

Remove empty entity files from modb cache.

* test-utf7.el (test-utf7-encode-string-alpha): Fix indent.

* test-elmo-date.el (test-elmo-date-get-week): Add assert.

New feature: toggle visibility of MIME buttons.

* elmo-imap4.el (elmo-folder-list-messages-plugged): Use TAB for
indent (only cosmetic fix).

Add ESEARCH feature entry to NEWS & NEWS.ja.

Add `elmo-imap4-set-seen-flag-explicitly' entry to NEWS & NEWS.ja.

New custom `elmo-imap4-set-seen-flag-explicitly' to override setting
of Seen flag for some buggy servers.

Replace deprecated time-stamp-hh:mm:ss by format-time-string

Bump version to 2.15.9

Implement partial UIDs update for IMAP

Better logging for imap4 proto

Added support for ESEARCH feature (RFC4731)

* wl-score.el (wl-score-followup): Remove verbose comment (same as docstring).

* wl-addrbook.el (wl-summary-addrbook-add): Use `with-current-buffer' instead of `save-excursion' & `set-buffer'.

* wl-summary.el (wl-summary-update-persistent-mark-on-event):
Revert `save-excursion' for `wl-summary-jump-to-msg'.

Undo last commit.

* elmo-util.el (elmo-set-work-buf): Revert `save-excursion' for robustness.

Fix last change (comment-style).

* wl.el (wl-toggle-plugged, wl-plugged-dop-queue-info)
(wl-plugged-exit, wl-exit): Fix comment-out style. Use three
semicolons, that should start at the left margin.
See. also (Info-goto-node "(elisp)Comment Tips").
* wl-acap.el (wl-acap-store): Ditto.
* wl-action.el (wl-summary-unset-mark): Ditto.
* wl-address.el (wl-address-ldap-search): Ditto.
* wl-demo.el (wl-demo-insert-image): Ditto.
* wl-dnd.el (wl-dnd-set-drag-starter): Ditto.
* wl-draft.el (wl-draft-normal-send-func, wl-draft-send)
(wl-draft-previous-history-element): Ditto.
* wl-e21.el (wl-draft-key-setup, wl-draft-overload-functions): Ditto.
* wl-folder.el (toplevel, wl-folder-mode-menu-spec)
(wl-folder-mode-map, wl-folder-get-prev-folder)
(wl-folder-jump-to-current-entity, wl-folder-check-entity)
(wl-folder-check-entity-async)
(wl-create-folder-entity-from-buffer): Ditto.
* wl-fldmgr.el (toplevel): Ditto.
* wl-message.el (wl-message-buffer-cache-sort)
(wl-message-redisplay, wl-message-buffer-prefetch-clear-timer):
Ditto.
* wl-mule.el (wl-draft-key-setup, wl-draft-overload-functions):
Ditto.
* wl-summary.el (toplevel, wl-summary-mode)
(wl-summary-edit-addresses, wl-summary-sync-update)
(wl-summary-stick): Ditto.
* wl-thread.el (toplevel, wl-thread-insert-message)
(wl-thread-insert-entity-sub, wl-thread-open-close): Ditto.
* wl-util.el (toplevel): Ditto.
* wl-xmas.el (wl-draft-key-setup, wl-draft-overload-functions):
Ditto.

* acap.el (acap-parse-response): Fix comment-out style. Use three
semicolons, that should start at the left margin.
See. also (Info-goto-node "(elisp)Comment Tips").
* elmo.el (toplevel, elmo-message-match-condition)
(elmo-folder-set-info-max-by-numdb, elmo-folder-move-messages):
Ditto.
* elmo-archive.el (elmo-archive-suffix-alist)
(elmo-archive-tar-method-alist, elmo-archive-tgz-method-alist)
(elmo-archive-method-list)
(elmo-archive-msgdb-create-as-numlist-subr2, elmo-folder-search):
Ditto.
* elmo-imap4.el (toplevel)
(elmo-imap4-send-command, elmo-imap4-check-validity)
(elmo-imap4-fetch-callback-1-subr)
(elmo-network-initialize-session, elmo-server-diff-async)
(elmo-imap4-folder-diff-plugged): Ditto
* elmo-maildir.el (elmo-maildir-temporal-filename): Ditto.
* elmo-msgdb.el (elmo-msgdb-append-element): Ditto.
* elmo-net.el (elmo-network-close-session): Ditto.
* elmo-nntp.el (elmo-nntp-create-msgdb-from-overview-string)
(elmo-nntp-parse-overview-string, elmo-nntp-post): Ditto.
* elmo-pop3.el (elmo-pop3-retrieve-headers):  Ditto.
* elmo-util.el (elmo-set-auto-coding, elmo-passwd-alist-save)
(elmo-number-set-delete)
(elmo-cache-get-oldest-cache-file-entity): Ditto.

Version number is increased to 2.15.8.

* WL-MK (wl-scan-source, wl-uninstall)
(compile-wl-package, install-wl-package)
(compile-wl-package-xmas, install-wl-package-xmas)
(wl-texinfo-format, wl-texinfo-install) : Use `mapc' instead of
`mapcar'. Don't quote `lambda'.

* wl-message.el (wl-message-uu-substring): Suppress compile
warnings; Use `with-current-buffer' instead of `save-excursion' &
`set-buffer'.
* wl-mime.el (wl-draft-yank-current-message-entity)
(wl-mime-preview-follow-no-mime)
(wl-mime-preview-follow-current-region): Ditto.
* wl-summary.el (wl-summary-update-persistent-mark-on-event)
(wl-summary-switch-to-clone-buffer)
(wl-summary-target-mark-forward)
(wl-summary-target-mark-reply-with-citation)
(wl-summary-target-mark-uudecode): Ditto.

* elmo-mime.el (elmo-mime-insert-header-from-buffer): Use
`with-current-buffer' instead of `save-excursion' (for suppress
compile warnings).

* wl-addrmgr.el (wl-addrmgr-replace-field): Use `point-at-bol'.
* wl-action.el (wl-summary-remove-argument): Explicit `point-at-bol'.
* wl-summary.el (wl-summary-narrow-to-region)
(wl-summary-insert-line): Use `point-at-bol', `point-at-eol'.

Fix changelog typo.

* elmo.el (elmo-folder-confirm-appends): Use `number-to-string'
instead of `int-to-string'.
* elmo-archive.el (elmo-archive-message-fetch-internal)
(elmo-archive-folder-message-make-temp-files)
(elmo-archive-folder-append-buffer)
(elmo-folder-delete-messages-internal)
(elmo-archive-msgdb-create-entity)
(elmo-archive-msgdb-create-as-numlist-subr2): Ditto.
* elmo-util.el (elmo-cache-expire-by-age): Ditto.
* elmo-flag.el (elmo-global-flag-set-internal): Ditto.
* elmo-file.el (elmo-folder-message-make-temp-files): Ditto.
* elmo-imap4.el (elmo-imap4-make-number-set-list)
(elmo-folder-list-subfolders): Ditto.
* elmo-localdir.el (elmo-message-file-name)
(elmo-folder-message-make-temp-files)
(elmo-localdir-msgdb-create-entity)
(elmo-folder-append-messages-*-localdir)
(elmo-folder-pack-numbers): Ditto.
* elmo-maildir.el (elmo-folder-message-make-temp-files): Ditto.
* elmo-map.el (elmo-location-map-key): Ditto.
* elmo-nntp.el (elmo-nntp-folder-postfix)
(elmo-nntp-folder-list-subfolders)
(elmo-nntp-folder-msgdb-create): Ditto.

* wl.el (wl-plugged-sending-queue-status): Use `int-to-string'
instead of `number-to-string'.
* wl-dnd.el (wl-dnd-start-drag): Ditto.
* wl-score.el (wl-score-insert-help, wl-summary-increase-score): Ditto.
* wl-summary.el (wl-summary-jump-to-msg, wl-summary-save): Ditto.
* wl-util.el (wl-url-nntp): Ditto.

Fix last change.  Cosmetic fix around `lambda (x)'.

* wl.el (wl-plugged-set-variables, wl-plugged-dop-queue-info)
(wl-plugged-dop-queue-status): Don't quote `lambda'.
* wl-thread.el (wl-thread-delete-message): Ditto
* wl-summary.el (wl-summary-edit-addresses)
(wl-summary-edit-addresses-collect-candidate-fields)
(wl-summary-search-by-subject): Ditto.
* wl-mime.el (wl-mime-node-id-to-string): Ditto.
* wl-fldmgr.el (wl-fldmgr-add-completion-all-completions)
(wl-fldmgr-add-completion-subr): Ditto.
* wl-draft.el (wl-smtp-extension-bind)
(wl-draft-insert-get-message, wl-draft-default-headers)
(wl-jump-to-draft-buffer): Ditto.
* wl-summary.el (wl-summary-cursor-move-surface, wl-summary-up)
(wl-summary-down): Ditto.
* wl-message.el (wl-message-buffer-prefetch-subr): Ditto.
* wl-draft.el (wl-draft-reply, wl-draft-write-sendlog): Ditto.
* wl-folder.el (wl-folder-make-save-access-list)
(wl-folder-update-access-group, wl-folder-pick): Ditto.

* elmo.el (elmo-crosspost-message-alist-save): Don't use
`function' for `lambda'.
* elmo-archive.el (elmo-archive-folder-list-subfolders)
(elmo-folder-append-messages-*-archive)
(elmo-folder-delete-messages-internal): Ditto.
* elmo-date.el (elmo-replace-in-string): Ditto.
* elmo-multi.el (elmo-folder-list-messages, elmo-folder-search)
(elmo-folder-list-flagged): Ditto.
* elmo-maildir.el (elmo-maildir-cleanup-temporal): Ditto.
* elmo-imap4.el (elmo-network-authenticate-session): Ditto.
* modb-standard.el (modb-standard-cleanup-stale-entities): Ditto.

* elmo-dop.el (elmo-dop-spool-folder): Suppress warning "defsubst
`elmo-dop-spool-folder' was used before it was defined"; Use
`defun' instead.

* wl-draft.el (wl-draft-default-headers): Suppress warning
"defsubst `wl-draft-default-headers' was used before it was
defined"; Use `defun' instead of `defsubst'.

* wl-folder.el (wl-folder-get-entity-from-buffer): Macro to function.
* wl-util.el (wl-match-string, wl-match-buffer):  Macro to function.
* wl-summary.el (wl-summary-message-status): Macro to inline-function.
* wl.el (wl-plugged-string): Macro to function.

* pldap.el (ldap/ldif-safe-string-p): macro to function.
* elmo-imap4.el (elmo-imap4-detect-search-charset): Ditto.

* wl-address.el (wl-address-header-extract-address)
(wl-address-header-extract-realname): Fix mail-address in docstring.