Forum » Support and Bug Reports »

Post a reply

Before posting, please read how to report bug or request support effectively.

Bug reports without an attached log file are usually useless.

Options
Add an Attachment

If you do not want to add an Attachment to your Post, please leave the Fields blank.

(maximum 10 MB; please compress large files; only common media, archive, text and programming file formats are allowed)

Options

Topic review

martin

selappi wrote:

Sorry about the previous response being a little flippant concerning the delay, I was specifically referring the delay as being caused by the SIZE of the file and NOT by a programming change.

No problem, I've undestood it. I was refering to your previous log:
Received incomplete data packet before end of file, offset: 3767425, size: 3201, requested: 4096

From the offset I can see that more that 3mb was already transfered corretly. In all your other logs I see that even the first packet (few kilobytes) was smaller than requested. The second case I can understand, I just wonder what conditions caused the succesful transfer of 3mb in the first case. If I know it I may be able to make modification, so it works always.

In response to the first question, YES! All files tested will cause the response (see log below) and as with the last tests there is a visible delay (meaning that after the copying file window pops up there is a small delay of maybe a couple of seconds, this appears to be related to the size of the file, the larger the file the longer the delay)

But I suppose that in the case when 3mb were transfered, you must have seen copy progress dialog for some time before the error happened?

Question: I do not know the exact process by which the two computers are talking to each other, but is it possible that the "transfer buffer" on the remote computer is reporting that it's buffer is empty BEFORE the buffer on the my computer has received all of the data packet and therefore the software responds with the error of an incomplete transfer?

It is not so. The error happens on high level protocol (SFTP, not underlying SSH). SFTP packet starts with number indicating its length. So the packet smaller than requested is sent deliberately by your server. But not always (the 3mb case). As I have already said, it is not a bug of your server, it is just very unusual. I have never met this before, with exception of one special case of SSH server on embedded devbice with limited memory).

Anyway you can try older version of WinSCP prior to 3.4, which introduced "Significant acceleration of SFTP transfer performance." These older versions may work with your server. Or use the lastest version, but SCP protocol, if possible.
selappi

Sorry about the previous response being a little flippant concerning the delay, I was specifically referring the delay as being caused by the SIZE of the file and NOT by a programming change.

In response to the first question, YES! All files tested will cause the response (see log below) and as with the last tests there is a visible delay (meaning that after the copying file window pops up there is a small delay of maybe a couple of seconds, this appears to be related to the size of the file, the larger the file the longer the delay)

In response to the second question, NO or more correctly not to my knowledge or in anyway that I can tell, Change only referred to the upgrade not correcting the problem as you had hinted at in the first reply.

Question: I do not know the exact process by which the two computers are talking to each other, but is it possible that the "transfer buffer" on the remote computer is reporting that it's buffer is empty BEFORE the buffer on the my computer has received all of the data packet and therefore the software responds with the error of an incomplete transfer?

--------------------------------------------------------------------------
WinSCP Version 3.5.0 (Build 204)
Login time: Wednesday, January 21, 2004 2:30:11 PM
--------------------------------------------------------------------------
Session name: [email protected]
Host name: chastity.isis.unc.edu (Port: 22)
User name: selappi (Password: No, Key file: No)
Transfer Protocol: SFTP (SCP)
SSH protocol version: 2; Compression: Yes
Agent forwarding: No; TIS/CryptoCard: No; KI: Yes
Ciphers: aes,blowfish,3des,WARN,des; Ssh2DES: No
Ping type: -, Ping interval: 60 sec; Timeout: 15 sec
SSH Bugs: -,-,-,-,-,-,-,-,
Proxy: none
Return code variable: Autodetect; Lookup user groups: Yes
Shell: default, EOL: 0
Local directory: C:\Documents and Settings\Simon Lappi\My Documents\SIMON\Q-Chemistry\betaine, Remote directory: /afs/isis.unc.edu/home/s/e/selappi, Update: Yes, Cache: Yes
Cache directory changes: Yes, Permanent: Yes
Clear aliases: Yes, Unset nat.vars: Yes, Resolve symlinks: Yes
Alias LS: No, Ign LS warn: Yes, Scp1 Comp: No
--------------------------------------------------------------------------
Looking up host "chastity.isis.unc.edu"
Connecting to 152.2.1.128 port 22
Server version: SSH-1.99-OpenSSH_3.6.1p2
We claim version: SSH-2.0-WinSCP-release-3.5
Using SSH protocol version 2
Doing Diffie-Hellman group exchange
Doing Diffie-Hellman key exchange
Host key fingerprint is:
ssh-rsa 1024 32:c4:a5:89:54:10:5a:c1:a8:62:e0:11:75:47:a9:ff
Initialised AES-256 client->server encryption
Initialised AES-256 server->client encryption
Initialised zlib (RFC1950) compression
Initialised zlib (RFC1950) decompression
Using username "selappi".
Keyboard-interactive authentication refused
Session password prompt ([email protected]'s password: )
Asking user for password.
Sent password
Access granted
Opened channel for session
Started a shell/command
--------------------------------------------------------------------------
Using SFTP protocol.
Doing startup conversation with host.
Type: SSH_FXP_INIT, Size: 5, Number: -1
Type: SSH_FXP_VERSION, Size: 5, Number: -1
SFTP version 3 negotiated.
Type: SSH_FXP_EXTENDED, Size: 38, Number: 200
Type: SSH_FXP_STATUS, Size: 38, Number: 200
Status/error code: 8
Server does not recognise WinSCP.
Cached directory change via "/afs/isis.unc.edu/home/s/e/selappi" to "/afs/isis.unc.edu/home/s/e/selappi".
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi".
Type: SSH_FXP_OPENDIR, Size: 43, Number: 267
Type: SSH_FXP_HANDLE, Size: 13, Number: 267
Type: SSH_FXP_READDIR, Size: 13, Number: 524
Type: SSH_FXP_NAME, Size: 4725, Number: 524
Type: SSH_FXP_READDIR, Size: 13, Number: 780
Reading symlink ".kshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 1043
Type: SSH_FXP_STAT, Size: 50, Number: 1297
Type: SSH_FXP_STATUS, Size: 28, Number: 780
Type: SSH_FXP_NAME, Size: 115, Number: 1043
Type: SSH_FXP_ATTRS, Size: 37, Number: 1297
Reading symlink ".profile".
Type: SSH_FXP_READLINK, Size: 52, Number: 1555
Type: SSH_FXP_STAT, Size: 52, Number: 1809
Type: SSH_FXP_NAME, Size: 119, Number: 1555
Type: SSH_FXP_ATTRS, Size: 37, Number: 1809
Reading symlink ".plan".
Type: SSH_FXP_READLINK, Size: 49, Number: 2067
Type: SSH_FXP_STAT, Size: 49, Number: 2321
Type: SSH_FXP_NAME, Size: 45, Number: 2067
Type: SSH_FXP_ATTRS, Size: 37, Number: 2321
Reading symlink ".project".
Type: SSH_FXP_READLINK, Size: 52, Number: 2579
Type: SSH_FXP_STAT, Size: 52, Number: 2833
Type: SSH_FXP_NAME, Size: 51, Number: 2579
Type: SSH_FXP_ATTRS, Size: 37, Number: 2833
Reading symlink ".cshrc".
Type: SSH_FXP_READLINK, Size: 50, Number: 3091
Type: SSH_FXP_STAT, Size: 50, Number: 3345
Type: SSH_FXP_NAME, Size: 115, Number: 3091
Type: SSH_FXP_ATTRS, Size: 37, Number: 3345
Reading symlink ".login".
Type: SSH_FXP_READLINK, Size: 50, Number: 3603
Type: SSH_FXP_STAT, Size: 50, Number: 3857
Type: SSH_FXP_NAME, Size: 115, Number: 3603
Type: SSH_FXP_ATTRS, Size: 37, Number: 3857
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 4100
Type: SSH_FXP_STATUS, Size: 24, Number: 4100
Status/error code: 0
Startup conversation with host finished.
File: "/afs/isis.unc.edu/home/s/e/selappi/insight.log"
Copying "/afs/isis.unc.edu/home/s/e/selappi/insight.log" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 63, Number: 4355
Type: SSH_FXP_HANDLE, Size: 13, Number: 4355
Type: SSH_FXP_READ, Size: 25, Number: 4613
Received incomplete data packet before end of file, offset: 1020, size: 1020, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 5380
Type: SSH_FXP_STATUS, Size: 24, Number: 5380
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
File: "/afs/isis.unc.edu/home/s/e/selappi/insight_logon"
Copying "/afs/isis.unc.edu/home/s/e/selappi/insight_logon" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 65, Number: 5635
Type: SSH_FXP_HANDLE, Size: 13, Number: 5635
Type: SSH_FXP_READ, Size: 25, Number: 5893
Received incomplete data packet before end of file, offset: 46, size: 46, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 6660
Type: SSH_FXP_STATUS, Size: 24, Number: 6660
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
Changing directory to "documents".
Getting real path for '/afs/isis.unc.edu/home/s/e/selappi/documents'
Type: SSH_FXP_REALPATH, Size: 53, Number: 6928
Type: SSH_FXP_NAME, Size: 109, Number: 6928
Real path is '/afs/isis.unc.edu/home/s/e/selappi/documents'
Trying to open directory "/afs/isis.unc.edu/home/s/e/selappi/documents".
Type: SSH_FXP_OPENDIR, Size: 53, Number: 7179
Type: SSH_FXP_HANDLE, Size: 13, Number: 7179
Type: SSH_FXP_CLOSE, Size: 13, Number: 7428
Type: SSH_FXP_STATUS, Size: 24, Number: 7428
Status/error code: 0
Getting current directory name.
Listing directory "/afs/isis.unc.edu/home/s/e/selappi/documents".
Type: SSH_FXP_OPENDIR, Size: 53, Number: 7691
Type: SSH_FXP_HANDLE, Size: 13, Number: 7691
Type: SSH_FXP_READDIR, Size: 13, Number: 7948
Type: SSH_FXP_NAME, Size: 207, Number: 7948
Type: SSH_FXP_READDIR, Size: 13, Number: 8204
Type: SSH_FXP_STATUS, Size: 28, Number: 8204
Status/error code: 1
Type: SSH_FXP_CLOSE, Size: 13, Number: 8452
Type: SSH_FXP_STATUS, Size: 24, Number: 8452
Status/error code: 0
Cached directory change via ".." to "/afs/isis.unc.edu/home/s/e/selappi".
Getting current directory name.
Directory content loaded from cache.
File: "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car"
Copying "/afs/isis.unc.edu/home/s/e/selappi/dmanba2b.car" to local directory started.
Ascii transfer mode selected.
Opening remote file.
Type: SSH_FXP_OPEN, Size: 64, Number: 8707
Type: SSH_FXP_HANDLE, Size: 13, Number: 8707
Type: SSH_FXP_READ, Size: 25, Number: 8965
Received incomplete data packet before end of file, offset: 2998, size: 2998, requested: 4096
5 skipped SSH_FXP_WRITE, SSH_FXP_READ, SSH_FXP_DATA and SSH_FXP_STATUS packets.
Type: SSH_FXP_CLOSE, Size: 13, Number: 9732
Type: SSH_FXP_STATUS, Size: 24, Number: 9732
Status/error code: 0
(ECommand) Copying files from remote side failed.
Received incomplete data packet before end of file.
(EAbort) Operation aborted
Closing connection.
martin

selappi wrote:

In response to the second question, Yes, but it takes longer for the error to appear (on screen, no surprise there), see log below

Well this is suprise for me. I've understood it in the first case, when problem occured immediatelly. But I do not understand, why your server has read requested number of bytes for the 3.5 Mb of data and only then it decided to return less. Does the problem occur with every file? By change: is the file changing on the server while you download it?
selappi