* New upstream release (closes: #474301). Important changes not previously

  backported to 4.7p1:
  - 4.9/4.9p1 (http://www.openssh.com/txt/release-4.9):
    + Added chroot(2) support for sshd(8), controlled by a new option
      "ChrootDirectory" (closes: #139047, LP: #24777).
    + Linked sftp-server(8) into sshd(8). The internal sftp server is used
      when the command "internal-sftp" is specified in a Subsystem or
      ForceCommand declaration. When used with ChrootDirectory, the
      internal sftp server requires no special configuration of files
      inside the chroot environment.
    + Added a protocol extension method "posix-rename@openssh.com" for
      sftp-server(8) to perform POSIX atomic rename() operations; sftp(1)
      prefers this if available (closes: #308561).
    + Removed the fixed limit of 100 file handles in sftp-server(8).
    + ssh(8) will now skip generation of SSH protocol 1 ephemeral server
      keys when in inetd mode and protocol 2 connections are negotiated.
      This speeds up protocol 2 connections to inetd-mode servers that
      also allow Protocol 1.
    + Accept the PermitRootLogin directive in a sshd_config(5) Match
      block. Allows for, e.g. permitting root only from the local network.
    + Reworked sftp(1) argument splitting and escaping to be more
      internally consistent (i.e. between sftp commands) and more
      consistent with sh(1). Please note that this will change the
      interpretation of some quoted strings, especially those with
      embedded backslash escape sequences.
    + Support "Banner=none" in sshd_config(5) to disable sending of a
      pre-login banner (e.g. in a Match block).
    + ssh(1) ProxyCommands are now executed with $SHELL rather than
      /bin/sh.
    + ssh(1)'s ConnectTimeout option is now applied to both the TCP
      connection and the SSH banner exchange (previously it just covered
      the TCP connection). This allows callers of ssh(1) to better detect
      and deal with stuck servers that accept a TCP connection but don't
      progress the protocol, and also makes ConnectTimeout useful for
      connections via a ProxyCommand.
    + scp(1) incorrectly reported "stalled" on slow copies (closes:
      #140828).
    + scp(1) date underflow for timestamps before epoch.
    + ssh(1) used the obsolete SIG DNS RRtype for host keys in DNS,
      instead of the current standard RRSIG.
    + Correctly drain ACKs when a sftp(1) upload write fails midway,
      avoids a fatal() exit from what should be a recoverable condition.
    + Fixed ssh-keygen(1) selective host key hashing (i.e. "ssh-keygen -HF
      hostname") to not include any IP address in the data to be hashed.
    + Make ssh(1) skip listening on the IPv6 wildcard address when a
      binding address of 0.0.0.0 is used against an old SSH server that
      does not support the RFC4254 syntax for wildcard bind addresses.
    + Enable IPV6_V6ONLY socket option on sshd(8) listen socket, as is
      already done for X11/TCP forwarding sockets (closes: #439661).
    + Fix FD leak that could hang a ssh(1) connection multiplexing master.
    + Make ssh(1) -q option documentation consistent with reality.
    + Fixed sshd(8) PAM support not calling pam_session_close(), or
      failing to call it with root privileges (closes: #372680).
    + Fix activation of OpenSSL engine support when requested in configure
      (LP: #119295).
  - 5.1/5.1p1 (http://www.openssh.com/txt/release-5.1):
    + Introduce experimental SSH Fingerprint ASCII Visualisation to ssh(1)
      and ssh-keygen(1). Visual fingerprint display is controlled by a new
      ssh_config(5) option "VisualHostKey". The intent is to render SSH
      host keys in a visual form that is amenable to easy recall and
      rejection of changed host keys.
    + sshd_config(5) now supports CIDR address/masklen matching in "Match
      address" blocks, with a fallback to classic wildcard matching.
    + sshd(8) now supports CIDR matching in ~/.ssh/authorized_keys
      from="..." restrictions, also with a fallback to classic wildcard
      matching.
    + Added an extended test mode (-T) to sshd(8) to request that it write
      its effective configuration to stdout and exit. Extended test mode
      also supports the specification of connection parameters (username,
      source address and hostname) to test the application of
      sshd_config(5) Match rules.
    + ssh(1) now prints the number of bytes transferred and the overall
      connection throughput for SSH protocol 2 sessions when in verbose
      mode (previously these statistics were displayed for protocol 1
      connections only).
    + sftp-server(8) now supports extension methods statvfs@openssh.com
      and fstatvfs@openssh.com that implement statvfs(2)-like operations.
    + sftp(1) now has a "df" command to the sftp client that uses the
      statvfs@openssh.com to produce a df(1)-like display of filesystem
      space and inode utilisation (requires statvfs@openssh.com support on
      the server).
    + Added a MaxSessions option to sshd_config(5) to allow control of the
      number of multiplexed sessions supported over a single TCP
      connection. This allows increasing the number of allowed sessions
      above the previous default of 10, disabling connection multiplexing
      (MaxSessions=1) or disallowing login/shell/subsystem sessions
      entirely (MaxSessions=0).
    + Added a no-more-sessions@openssh.com global request extension that
      is sent from ssh(1) to sshd(8) when the client knows that it will
      never request another session (i.e. when session multiplexing is
      disabled). This allows a server to disallow further session requests
      and terminate the session in cases where the client has been
      hijacked.
    + ssh-keygen(1) now supports the use of the -l option in combination
      with -F to search for a host in ~/.ssh/known_hosts and display its
      fingerprint.
    + ssh-keyscan(1) now defaults to "rsa" (protocol 2) keys, instead of
      "rsa1".
    + Added an AllowAgentForwarding option to sshd_config(8) to control
      whether authentication agent forwarding is permitted. Note that this
      is a loose control, as a client may install their own unofficial
      forwarder.
    + ssh(1) and sshd(8): avoid unnecessary malloc/copy/free when
      receiving network data, resulting in a ~10% speedup.
    + ssh(1) and sshd(8) will now try additional addresses when connecting
      to a port forward destination whose DNS name resolves to more than
      one address. The previous behaviour was to try the only first
      address and give up if that failed.
    + ssh(1) and sshd(8) now support signalling that channels are
      half-closed for writing, through a channel protocol extension
      notification "eow@openssh.com". This allows propagation of closed
      file descriptors, so that commands such as "ssh -2 localhost od
      /bin/ls | true" do not send unnecessary data over the wire.
    + sshd(8): increased the default size of ssh protocol 1 ephemeral keys
      from 768 to 1024 bits.
    + When ssh(1) has been requested to fork after authentication ("ssh
      -f") with ExitOnForwardFailure enabled, delay the fork until after
      replies for any -R forwards have been seen. Allows for robust
      detection of -R forward failure when using -f.
    + "Match group" blocks in sshd_config(5) now support negation of
      groups. E.g. "Match group staff,!guests".
    + sftp(1) and sftp-server(8) now allow chmod-like operations to set
      set[ug]id/sticky bits.
    + The MaxAuthTries option is now permitted in sshd_config(5) match
      blocks.
    + Multiplexed ssh(1) sessions now support a subset of the ~ escapes
      that are available to a primary connection.
    + ssh(1) connection multiplexing will now fall back to creating a new
      connection in most error cases (closes: #352830).
    + Make ssh(1) deal more gracefully with channel requests that fail.
      Previously it would optimistically assume that requests would always
      succeed, which could cause hangs if they did not (e.g. when the
      server runs out of file descriptors).
    + ssh(1) now reports multiplexing errors via the multiplex slave's
      stderr where possible (subject to LogLevel in the mux master).
    + Prevent sshd(8) from erroneously applying public key restrictions
      leaned from ~/.ssh/authorized_keys to other authentication methods
      when public key authentication subsequently fails (LP: #161047).
    + Fixed an UMAC alignment problem that manifested on Itanium
      platforms.

1 files changed, 85 insertions, 31 deletions

diff --git a/scp.c b/scp.c
index 5d9e4bc29..e2eee035d 100644
--- a/scp.c
+++ b/scp.c
@@ -1,4 +1,4 @@
-/* $OpenBSD: scp.c,v 1.160 2007/08/06 19:16:06 sobrado Exp $ */
+/* $OpenBSD: scp.c,v 1.163 2008/06/13 18:55:22 dtucker Exp $ */
 /*
  * scp - secure remote copy.  This is basically patched BSD rcp which
  * uses ssh to do the data transfer (instead of using rcmd).
@@ -78,6 +78,13 @@
 #ifdef HAVE_SYS_STAT_H
 # include <sys/stat.h>
 #endif
+#ifdef HAVE_POLL_H
+#include <poll.h>
+#else
+# ifdef HAVE_SYS_POLL_H
+#  include <sys/poll.h>
+# endif
+#endif
 #ifdef HAVE_SYS_TIME_H
 # include <sys/time.h>
 #endif
@@ -109,6 +116,8 @@
 
 extern char *__progname;
 
+#define COPY_BUFLEN     16384
+
 int do_cmd(char *host, char *remuser, char *cmd, int *fdin, int *fdout);
 
 void bwlimit(int);
@@ -290,6 +299,7 @@ void sink(int, char *[]);
 void source(int, char *[]);
 void tolocal(int, char *[]);
 void toremote(char *, int, char *[]);
+size_t scpio(ssize_t (*)(int, void *, size_t), int, void *, size_t, off_t *);
 void usage(void);
 
 int
@@ -449,6 +459,43 @@ main(int argc, char **argv)
         exit(errs != 0);
 }
 
+/*
+ * atomicio-like wrapper that also applies bandwidth limits and updates
+ * the progressmeter counter.
+ */
+size_t
+scpio(ssize_t (*f)(int, void *, size_t), int fd, void *_p, size_t l, off_t *c)
+{
+        u_char *p = (u_char *)_p;
+        size_t offset;
+        ssize_t r;
+        struct pollfd pfd;
+
+        pfd.fd = fd;
+        pfd.events = f == read ? POLLIN : POLLOUT;
+        for (offset = 0; offset < l;) {
+                r = f(fd, p + offset, l - offset);
+                if (r == 0) {
+                        errno = EPIPE;
+                        return offset;
+                }
+                if (r < 0) {
+                        if (errno == EINTR)
+                                continue;
+                        if (errno == EAGAIN || errno == EWOULDBLOCK) {
+                                (void)poll(&pfd, 1, -1); /* Ignore errors */
+                                continue;
+                        }
+                        return offset;
+                }
+                offset += (size_t)r;
+                *c += (off_t)r;
+                if (limit_rate)
+                        bwlimit(r);
+        }
+        return offset;
+}
+
 void
 toremote(char *targ, int argc, char **argv)
 {
@@ -590,8 +637,8 @@ source(int argc, char **argv)
         struct stat stb;
         static BUF buffer;
         BUF *bp;
-        off_t i, amt, statbytes;
-        size_t result;
+        off_t i, statbytes;
+        size_t amt;
         int fd = -1, haderr, indx;
         char *last, *name, buf[2048], encname[MAXPATHLEN];
         int len;
@@ -612,6 +659,10 @@ source(int argc, char **argv)
 syserr:                 run_err("%s: %s", name, strerror(errno));
                         goto next;
                 }
+                if (stb.st_size < 0) {
+                        run_err("%s: %s", name, "Negative file size");
+                        goto next;
+                }
                 unset_nonblock(fd);
                 switch (stb.st_mode & S_IFMT) {
                 case S_IFREG:
@@ -637,8 +688,14 @@ syserr:			run_err("%s: %s", name, strerror(errno));
                          * versions expecting microseconds.
                          */
                         (void) snprintf(buf, sizeof buf, "T%lu 0 %lu 0\n",
-                            (u_long) stb.st_mtime,
-                            (u_long) stb.st_atime);
+                            (u_long) (stb.st_mtime < 0 ? 0 : stb.st_mtime),
+                            (u_long) (stb.st_atime < 0 ? 0 : stb.st_atime));
+                        if (verbose_mode) {
+                                fprintf(stderr, "File mtime %ld atime %ld\n",
+                                    (long)stb.st_mtime, (long)stb.st_atime);
+                                fprintf(stderr, "Sending file timestamps: %s",
+                                    buf);
+                        }
                         (void) atomicio(vwrite, remout, buf, strlen(buf));
                         if (response() < 0)
                                 goto next;
@@ -653,7 +710,7 @@ syserr:			run_err("%s: %s", name, strerror(errno));
                 (void) atomicio(vwrite, remout, buf, strlen(buf));
                 if (response() < 0)
                         goto next;
-                if ((bp = allocbuf(&buffer, fd, 2048)) == NULL) {
+                if ((bp = allocbuf(&buffer, fd, COPY_BUFLEN)) == NULL) {
 next:                   if (fd != -1) {
                                 (void) close(fd);
                                 fd = -1;
@@ -662,27 +719,25 @@ next:			if (fd != -1) {
                 }
                 if (showprogress)
                         start_progress_meter(curfile, stb.st_size, &statbytes);
-                /* Keep writing after an error so that we stay sync'd up. */
+                set_nonblock(remout);
                 for (haderr = i = 0; i < stb.st_size; i += bp->cnt) {
                         amt = bp->cnt;
-                        if (i + amt > stb.st_size)
+                        if (i + (off_t)amt > stb.st_size)
                                 amt = stb.st_size - i;
                         if (!haderr) {
-                                result = atomicio(read, fd, bp->buf, amt);
-                                if (result != amt)
+                                if (atomicio(read, fd, bp->buf, amt) != amt)
                                         haderr = errno;
                         }
-                        if (haderr)
-                                (void) atomicio(vwrite, remout, bp->buf, amt);
-                        else {
-                                result = atomicio(vwrite, remout, bp->buf, amt);
-                                if (result != amt)
-                                        haderr = errno;
-                                statbytes += result;
+                        /* Keep writing after error to retain sync */
+                        if (haderr) {
+                                (void)atomicio(vwrite, remout, bp->buf, amt);
+                                continue;
                         }
-                        if (limit_rate)
-                                bwlimit(amt);
+                        if (scpio(vwrite, remout, bp->buf, amt,
+                            &statbytes) != amt)
+                                haderr = errno;
                 }
+                unset_nonblock(remout);
                 if (showprogress)
                         stop_progress_meter();
 
@@ -788,10 +843,10 @@ bwlimit(int amount)
                         thresh /= 2;
                         if (thresh < 2048)
                                 thresh = 2048;
-                } else if (bwend.tv_usec < 100) {
+                } else if (bwend.tv_usec < 10000) {
                         thresh *= 2;
-                        if (thresh > 32768)
-                                thresh = 32768;
+                        if (thresh > COPY_BUFLEN * 4)
+                                thresh = COPY_BUFLEN * 4;
                 }
 
                 TIMEVAL_TO_TIMESPEC(&bwend, &ts);
@@ -982,7 +1037,7 @@ bad:			run_err("%s: %s", np, strerror(errno));
                         continue;
                 }
                 (void) atomicio(vwrite, remout, "", 1);
-                if ((bp = allocbuf(&buffer, ofd, 4096)) == NULL) {
+                if ((bp = allocbuf(&buffer, ofd, COPY_BUFLEN)) == NULL) {
                         (void) close(ofd);
                         continue;
                 }
@@ -992,26 +1047,24 @@ bad:			run_err("%s: %s", np, strerror(errno));
                 statbytes = 0;
                 if (showprogress)
                         start_progress_meter(curfile, size, &statbytes);
-                for (count = i = 0; i < size; i += 4096) {
-                        amt = 4096;
+                set_nonblock(remin);
+                for (count = i = 0; i < size; i += bp->cnt) {
+                        amt = bp->cnt;
                         if (i + amt > size)
                                 amt = size - i;
                         count += amt;
                         do {
-                                j = atomicio(read, remin, cp, amt);
+                                j = scpio(read, remin, cp, amt, &statbytes);
                                 if (j == 0) {
-                                        run_err("%s", j ? strerror(errno) :
+                                        run_err("%s", j != EPIPE ?
+                                            strerror(errno) :
                                             "dropped connection");
                                         exit(1);
                                 }
                                 amt -= j;
                                 cp += j;
-                                statbytes += j;
                         } while (amt > 0);
 
-                        if (limit_rate)
-                                bwlimit(4096);
-
                         if (count == bp->cnt) {
                                 /* Keep reading so we stay sync'd up. */
                                 if (wrerr == NO) {
@@ -1025,6 +1078,7 @@ bad:			run_err("%s: %s", np, strerror(errno));
                                 cp = bp->buf;
                         }
                 }
+                unset_nonblock(remin);
                 if (showprogress)
                         stop_progress_meter();
                 if (count != 0 && wrerr == NO &&