SQL Anywhere database replication - SQL Remote download issue

Author

SQL Remote download issue

Stig Olav Kvam

2005-11-25, 8:23 pm

SQL Anywhere 9.0.2 build 3207 and 3193 (2 development servers)

Greetings from Cyprus!

I hope there is someone frequenting these forums that can help me out
with the following issue:

How to make SQL Remote Agent to DOWNLOAD the opposite servers UPLOAD?

It does replicate up data to a shared FTP server (as described in docs),
it is set up as described in docs, they both UPLOAD data but neither
DOWNLOADs. In one of the folders there are 1 MB of data waiting. The FTP
servers listing/log is as follows:

(Sorry about the length, but need to include enough relevant info)

[2005-11-25 - 22:23:53] - [180] REMOTE: Current Directory: /Root/
[2005-11-25 - 22:23:54] - [180] REMOTE: Start Upload of /Root/consol/.remote
[2005-11-25 - 22:23:54] - [180] REMOTE: File Uploaded:
/Root/consol/.remote (0.09 K/S - 91 bytes)
[2005-11-25 - 22:23:54] - [180] REMOTE: File Rename:
/Root/consol/.remote - /Root/consol/remote.6
[2005-11-25 - 22:25:47] - [179] CONSOL: Start Upload of /Root/remote/.consol
[2005-11-25 - 22:25:47] - [179] CONSOL: File Uploaded:
/Root/remote/.consol (0.21 K/S - 219 bytes)
[2005-11-25 - 22:25:47] - [179] CONSOL: File Rename:
/Root/remote/.consol - /Root/remote/consol.ed
[2005-11-25 - 22:28:16] - [180] REMOTE: Start Upload of /Root/consol/.remote
[2005-11-25 - 22:28:16] - [180] REMOTE: File Uploaded:
/Root/consol/.remote (0.09 K/S - 91 bytes)
[2005-11-25 - 22:28:16] - [180] REMOTE: File Rename:
/Root/consol/.remote - /Root/consol/remote.7
[2005-11-25 - 22:32:40] - [180] REMOTE: Start Upload of /Root/consol/.remote
[2005-11-25 - 22:32:40] - [180] REMOTE: File Uploaded:
/Root/consol/.remote (0.09 K/S - 91 bytes)
[2005-11-25 - 22:32:40] - [180] REMOTE: File Rename:
/Root/consol/.remote - /Root/consol/remote.8

Each FTP server has their unique logical name (for folder
names/address), one is called CONSOL and the other REMOTE. It also posts
the files in correct folders according to description in FTP setup from
manuals, but when it suppose to query for download in the 'opposite'
directory nothing happens...

Here is the output of one of the dbremote sessions (REMOTE in debug mode):

I. 11/25 22:58:55. TYPE A N
I. 11/25 22:58:55. Getting server response:
I. 11/25 22:58:55. 200 Type set to A N.
I. 11/25 22:58:55. Type set.
I. 11/25 22:58:55. listen ok
I. 11/25 22:58:55. PORT 192,168,2,100,7,247
I. 11/25 22:58:55. Getting server response:
I. 11/25 22:58:55. 200 Port command successful.
I. 11/25 22:58:55. Port Set.
I. 11/25 22:58:55. NLST /remote/
I. 11/25 22:58:55. Getting server response:
I. 11/25 22:58:55. 150 Opening data connection for directory list.
I. 11/25 22:58:55. 0 byte read...socket is closed

It DOES list the 'destination' folder for upload: NLST /remote/
but no query for the opposite folder: NLST /consol/

-----------------------------------------------------------------------
a. Please confirm that the FTP logical names should be unique in e.g as
mine one called REMOTE the other CONSOL...
-----------------------------------------------------------------------
b. Is there any server settings on dbremote to 'force' looking for
another download directory?
-----------------------------------------------------------------------
c. All settings seems to be correct in the sense that it does upload, it
identifies all settings, create filenames for the receiver etc.
Any advice on how to troubleshoot the current FTP / SQL Remote situation
is appreciated.
(For the record, all access has been granted for root and subfolders for
all users for all relevant FTP users.)
-----------------------------------------------------------------------

Need to use FTP for a setup on a really remote site with response times
up to 800ms, and FTP could be an easier way to make the real life
transfers happen. Just need to get the dbremotes to start download as
well...

Stig from Cyprus

Stig Olav Kvam

2005-11-26, 11:23 am

Some add'l info:

Set up the SQL remote using FILE and it works as expected, up and
download. When swapping back to FTP it does not download. Using the same
file structure and same 'everything', and it works with FILE and not
with FTP...

- I tried active and passive mode in FTP, no difference...
- All kinds of switches as described in the documentation tried, same
result...

Tried to set up the tutorial db as described, same result: Works fine
with FILE and only UPLOAD using FTP...

Is the FTP option really an option in SQL Remote? I must say that this
FTP option is getting my stress level to high levels, been struggling
with this single issue for 4 days now, and still 'deadlocked' on
downloads...

Stig from Cyprus

Breck Carter [TeamSybase]

2005-11-26, 1:23 pm

FTP does work, and it is by far the most popular technique.

Try the tutorial again, with *one* FTP server. As far as I can tell
from your posting, you are trying to use multiple FTP servers.

Breck

On 25 Nov 2005 13:10:26 -0800, Stig Olav Kvam <stig@kvam.org.uk>
wrote:

>SQL Anywhere 9.0.2 build 3207 and 3193 (2 development servers)
>
>Greetings from Cyprus!
>
>I hope there is someone frequenting these forums that can help me out
>with the following issue:
>
>How to make SQL Remote Agent to DOWNLOAD the opposite servers UPLOAD?
>
>It does replicate up data to a shared FTP server (as described in docs),
>it is set up as described in docs, they both UPLOAD data but neither
>DOWNLOADs. In one of the folders there are 1 MB of data waiting. The FTP
>servers listing/log is as follows:
>
>(Sorry about the length, but need to include enough relevant info)
>
>[2005-11-25 - 22:23:53] - [180] REMOTE: Current Directory: /Root/
>[2005-11-25 - 22:23:54] - [180] REMOTE: Start Upload of /Root/consol/.remote
>[2005-11-25 - 22:23:54] - [180] REMOTE: File Uploaded:
>/Root/consol/.remote (0.09 K/S - 91 bytes)
>[2005-11-25 - 22:23:54] - [180] REMOTE: File Rename:
>/Root/consol/.remote - /Root/consol/remote.6
>[2005-11-25 - 22:25:47] - [179] CONSOL: Start Upload of /Root/remote/.consol
>[2005-11-25 - 22:25:47] - [179] CONSOL: File Uploaded:
>/Root/remote/.consol (0.21 K/S - 219 bytes)
>[2005-11-25 - 22:25:47] - [179] CONSOL: File Rename:
>/Root/remote/.consol - /Root/remote/consol.ed
>[2005-11-25 - 22:28:16] - [180] REMOTE: Start Upload of /Root/consol/.remote
>[2005-11-25 - 22:28:16] - [180] REMOTE: File Uploaded:
>/Root/consol/.remote (0.09 K/S - 91 bytes)
>[2005-11-25 - 22:28:16] - [180] REMOTE: File Rename:
>/Root/consol/.remote - /Root/consol/remote.7
>[2005-11-25 - 22:32:40] - [180] REMOTE: Start Upload of /Root/consol/.remote
>[2005-11-25 - 22:32:40] - [180] REMOTE: File Uploaded:
>/Root/consol/.remote (0.09 K/S - 91 bytes)
>[2005-11-25 - 22:32:40] - [180] REMOTE: File Rename:
>/Root/consol/.remote - /Root/consol/remote.8
>
>Each FTP server has their unique logical name (for folder
>names/address), one is called CONSOL and the other REMOTE. It also posts
>the files in correct folders according to description in FTP setup from
>manuals, but when it suppose to query for download in the 'opposite'
>directory nothing happens...
>
>Here is the output of one of the dbremote sessions (REMOTE in debug mode):
>
>I. 11/25 22:58:55. TYPE A N
>I. 11/25 22:58:55. Getting server response:
>I. 11/25 22:58:55. 200 Type set to A N.
>I. 11/25 22:58:55. Type set.
>I. 11/25 22:58:55. listen ok
>I. 11/25 22:58:55. PORT 192,168,2,100,7,247
>I. 11/25 22:58:55. Getting server response:
>I. 11/25 22:58:55. 200 Port command successful.
>I. 11/25 22:58:55. Port Set.
>I. 11/25 22:58:55. NLST /remote/
>I. 11/25 22:58:55. Getting server response:
>I. 11/25 22:58:55. 150 Opening data connection for directory list.
>I. 11/25 22:58:55. 0 byte read...socket is closed
>
>It DOES list the 'destination' folder for upload: NLST /remote/
>but no query for the opposite folder: NLST /consol/
>
>-----------------------------------------------------------------------
>a. Please confirm that the FTP logical names should be unique in e.g as
>mine one called REMOTE the other CONSOL...
>-----------------------------------------------------------------------
>b. Is there any server settings on dbremote to 'force' looking for
>another download directory?
>-----------------------------------------------------------------------
>c. All settings seems to be correct in the sense that it does upload, it
>identifies all settings, create filenames for the receiver etc.
>Any advice on how to troubleshoot the current FTP / SQL Remote situation
>is appreciated.
>(For the record, all access has been granted for root and subfolders for
>all users for all relevant FTP users.)
>-----------------------------------------------------------------------
>
>Need to use FTP for a setup on a really remote site with response times
>up to 800ms, and FTP could be an easier way to make the real life
>transfers happen. Just need to get the dbremotes to start download as
>well...
>
>Stig from Cyprus

--
SQL Anywhere Studio 9 Developer's Guide
Buy the book: http://www.amazon.com/exec/obidos/A...7/risingroad-20
bcarter@risingroad.com
RisingRoad SQL Anywhere and MobiLink Professional Services
www.risingroad.com

Stig Olav Kvam

2005-11-26, 8:38 pm

Hi

Sorry if I was unclear in my wording, I was referring to one
consolidated and one remote server (2 servers) in my test environment,
and just one FTP server as the link.

I just tried so many ways, and the frustrating part is that it's
'almost' working: It UPLOADS but no DOWNLOADs... I have a feeling that
it is just a very minor thing that needs adjustment, I just can't seem
to figure it out what's missing.

Any tip to get me forward would be highly apreciated...

Breck Carter [TeamSybase] wrote:
> FTP does work, and it is by far the most popular technique.
>
> Try the tutorial again, with *one* FTP server. As far as I can tell
> from your posting, you are trying to use multiple FTP servers.
>
> Breck
>
> On 25 Nov 2005 13:10:26 -0800, Stig Olav Kvam <stig@kvam.org.uk>
> wrote:
>
>

Breck Carter [TeamSybase]

2005-11-26, 8:38 pm

Since you got the FILE message type to work, you understand
everything. It is almost as if you forgot to change the publication
and/or subscription on one side or the other when you changed from
FILE to FTP. SQL Remote is very much a two-way setup, each side is
(almost) a mirror-image of the other.

The good news is, it will feel wonderful when you finally solve it...
that first pint down at the local will taste FINE :)

Breck

On 26 Nov 2005 13:50:34 -0800, Stig Olav Kvam <stig@kvam.org.uk>
wrote:
[color=darkred]
>Hi
>
>Sorry if I was unclear in my wording, I was referring to one
>consolidated and one remote server (2 servers) in my test environment,
>and just one FTP server as the link.
>
>I just tried so many ways, and the frustrating part is that it's
>'almost' working: It UPLOADS but no DOWNLOADs... I have a feeling that
>it is just a very minor thing that needs adjustment, I just can't seem
>to figure it out what's missing.
>
>Any tip to get me forward would be highly apreciated...
>
>Breck Carter [TeamSybase] wrote:

--
SQL Anywhere Studio 9 Developer's Guide
Buy the book: http://www.amazon.com/exec/obidos/A...7/risingroad-20
bcarter@risingroad.com
RisingRoad SQL Anywhere and MobiLink Professional Services
www.risingroad.com

Stig Olav Kvam

2005-11-27, 9:23 am

Hi again

Yes, I do understand the concept and methods used.

- When I swap back to FILE on both sides it works again.
- When then changing both setups to FTP it uploads but no downloads.
- Back to FILE again, and it downloads and uploads.

I do know that the only change done on both sides are the transfer
protocol, which have the same address (same subfolders) and do deliver
messages to the right locations, but no downloads when using FTP.

It is almost like there is a missing switch or something, but I've gone
through the list and tried the ones that seems relevant, but still 'no
go'...

I can not use file transfer as a transfer method half way around the
globe, I need to use something more 'certain' than that, file 'sharing'
over internet is NOT a good method on Windows platforms with all the
protocol overhead those systems have. If it was Linux or UNIX, then it
could be a considdered as a 'maybe', but with Windows; No thanks.

Breck Carter [TeamSybase] wrote:
> Since you got the FILE message type to work, you understand
> everything. It is almost as if you forgot to change the publication
> and/or subscription on one side or the other when you changed from
> FILE to FTP. SQL Remote is very much a two-way setup, each side is
> (almost) a mirror-image of the other.
>
> The good news is, it will feel wonderful when you finally solve it...
> that first pint down at the local will taste FINE :)
>
> Breck
>
> On 26 Nov 2005 13:50:34 -0800, Stig Olav Kvam <stig@kvam.org.uk>
> wrote:
>
>

Breck Carter [TeamSybase]

2005-11-27, 8:23 pm

There is something going wrong with your FTP setup, and you probably
need someone to help you on a realtime basis to work through it.
Everything you are saying makes sense, except the part about it not
working <g>... FTP *is* the preferred choice over FILE, and FTP *does*
work... many many many people use it.

Anyway, you need to open a case with tech support, call one of the
numbers at http://www.sybase.com/contactus/support#tech and get
someone to work it through with you. Everyone on *this* newsgroup
works on a volunteer basis; in cases like this, you get what you pay
for :)

Breck

On 27 Nov 2005 06:09:26 -0800, Stig Olav Kvam <stig@kvam.org.uk>
wrote:
[color=darkred]
>Hi again
>
>Yes, I do understand the concept and methods used.
>
>- When I swap back to FILE on both sides it works again.
>- When then changing both setups to FTP it uploads but no downloads.
>- Back to FILE again, and it downloads and uploads.
>
>I do know that the only change done on both sides are the transfer
>protocol, which have the same address (same subfolders) and do deliver
>messages to the right locations, but no downloads when using FTP.
>
>It is almost like there is a missing switch or something, but I've gone
>through the list and tried the ones that seems relevant, but still 'no
>go'...
>
>I can not use file transfer as a transfer method half way around the
>globe, I need to use something more 'certain' than that, file 'sharing'
>over internet is NOT a good method on Windows platforms with all the
>protocol overhead those systems have. If it was Linux or UNIX, then it
>could be a considdered as a 'maybe', but with Windows; No thanks.
>
>
>
>Breck Carter [TeamSybase] wrote:

--
SQL Anywhere Studio 9 Developer's Guide
Buy the book: http://www.amazon.com/exec/obidos/A...7/risingroad-20
bcarter@risingroad.com
RisingRoad SQL Anywhere and MobiLink Professional Services
www.risingroad.com

Stig Olav Kvam

2005-11-28, 8:25 pm

Hi all

The mysterious FTP blocking has been solved; It all boiled down to the
FTP server...

Last days lessons: Never trust the FTP server...

I have used TYPSoft FTP server together with SQL Remote replication, and
it created a lot of grief and headache. The TYPSoft works fine for all
other applications and use that's been tried, but not any success with
my SQL Remote setup. So between these products there is something not
100% compatible

Have tested with different free FTP servers, and so far got the best
result with FileZilla in beta 0.9.11 (See
http://sourceforce.net/projects/filezilla if any interest...)

The good thing with the 'headache' is that the setup has been so
thoroughly gone through, that the setup of SQL Remote are almost in the
'fingers' now. In the 'creative' process I also came up with a 'HYBRID'
solution between FILE and FTP if anyone is interested, only using
standard components in Windows and SQL Anywhere Studio.

Please send me a mail if you want the 'recipie' for the FILE-FTP hybrid,
it is far to long to post here...

:)

Stig from Cyprus

Sponsored Links