topic WARNING - deployment receiver is DANGEROUS in Alfresco Archive

WARNING - deployment receiver is DANGEROUS

ftoth — Thu, 13 Dec 2007 20:34:06 GMT

Hi again,Not one response from Alfresco on my previous post, eh?I know a little bit more about this now. It's completely repeatable, and hasto do with, apparently, only the initial deploy to a "fresh" deployment receiver.Be very cautious when you define the value for "root" in the targetDataproperty

Re: WARNING - deployment receiver is DANGEROUS

vijay_alfresco — Thu, 13 Dec 2007 22:00:28 GMT

It depends on where you set the target, for example

If you have created a webproject (website1) and want to maintain within Alfresco WCM then you need to have complete project in Alfresco WCM and while setting the deployment folder, make sure it deploys to the correct location

like, in Tomcat, the webapplication should go to

…webapps\website1 and alfresco will manage(delete, update, add..etc) the content within this website1 only.

–Vijay

Re: WARNING - deployment receiver is DANGEROUS

ftoth — Thu, 13 Dec 2007 22:41:13 GMT

By default, WCM wants to deploy to "ROOT", right?

So, by your logic, like in tomcat, you would want deployment to
go to "/webapps/ROOT". To accomplish this, you have to set the
deployment receiver's target to "/webapps".

What I'm calling a bug is that, if you do the above, the deployment
receiver will happily delete everything else under /webapps. If you happen
to have other webapps there, they're now gone.

This is not a bug?

Thanks,

Fred

Re: WARNING - deployment receiver is DANGEROUS

mikeh — Thu, 13 Dec 2007 22:54:01 GMT

It does sound like a bug.

Please raise in JIRA.

Thanks,
Mike

Re: WARNING - deployment receiver is DANGEROUS

vijay_alfresco — Fri, 14 Dec 2007 15:34:10 GMT

Actually, I have extended alfresco to edit the ROOT webappfolder while creating the webproject, you can find this at

http://forums.alfresco.com/viewtopic.php?t=9499

and hence I can specify the target as ….webapps/website1, so that only the
website1 will be managed and not entire webapps.

Re: WARNING - deployment receiver is DANGEROUS

kvc — Sun, 16 Dec 2007 04:14:36 GMT

Everyone:

Alfresco ensures that when you deploy a snapshot, what you get on the remote end is what you have in your snapshot, excepting for any limitations you put on source path and excludes (newly exposed in our upcoming 2.2 in our new deployment configuration wizard).

Whether deploying to a remote file system or remote Alfresco server, the sending server connects and verifies what snapshot exists on the second machine. If everything is OK, the sending side calcs deltas and send over a stream of files (to elimate unnecessary over the wire comparisons). It then snapshots the remote server, which in the case of a remote FS receiver means updating book-keeping entries (computed hash values to compare in future deployments) to note the transactionally delivered snapshot.

If you are deploying for the first time, or if something is awry in the remote server such that the snapshot it thinks it has is not indeed correct (site was hacked files were removed, for example), Alfresco does a FULL synchronization. That includes what you saw; it removes things that as far is it knows should not be there.

The server does source regex excludes in the event you do need to deploy your content to a root source but leave certain non-managed files or directories on the remote end. That capability is not exposed for configuration via our GUI until release 2.2 in the next few weeks.

The deployment receiver is doing exactly as intends; it is dangerous only in that if not targeted in the right way with the right config, you will get exactly what it's intended to do. If it succeeds, what you thought you were deploying it exactly what is on the other server.

I will take note to put a warning in our wiki that what transactional deployment means is that the remote server is essentially slave to the sending server. Whatever your target directory is, do take care: aside from our 2.2 excludes, that directory is a strongly managed one.

Kevin

Re: WARNING - deployment receiver is DANGEROUS

ftoth — Sun, 16 Dec 2007 15:55:46 GMT

Thanks for your explanation, Kevin. However, this behavior is a
show-stopper for me. Here's why…

Let me start with observed behavior:

1. On an initial deploy, the receiver will synchronize completely. This
means that anything under the target that alfresco doesn't know about
will be removed. If your target happens to be <tomcat_home>/webapps,
you will lose all of your webapps other than ROOT. And ROOT will
be cleaned out of any extra files.

2. After the intial deploy, however, this extra synchronization no longer takes
place. The target can have any number of non-alfresco files and folders
and the deployment receiver will ignore them.

Until your post, I thought #1 was a bug, but #2 was a work-around
I could live with. According to your post, #2 may well be a bug! You're
warning us that the target is "strongly managed". So it sounds like
I can't rely on #2. Some future version might allow later deploys to
delete non-alfresco stuff.

As I've mentioned before, we are attempting to manage just a portion
of our site with alfresco. For example, we have several high-level
categories, "news", "reviews", "research", "reports", etc. We are
attempting to deploy alfresco to help manage our "news" section.

It appears that I have to abandon the deployment receiver, or wall it
off somehow in a safe sandbox where it can't do any harm to the rest
of my site.

So one engineer, Mike, said that #1 was a bug and asked me to raise
a JIRA issue. http://issues.alfresco.com/browse/WCM-996

Now Kevin has said #1 is not a bug and observed behavior #2 may not
be reliable.

Further clarification would we welcome.

Thanks,

Fred

Re: WARNING - deployment receiver is DANGEROUS

kvc — Mon, 17 Dec 2007 14:27:13 GMT

Fred:

Yes, #2 is the bug … #1 is expected behavior.

Aside from exposing exclude paths in our 2.2 deployment config wizard, there are probably two other enhancements to note here for future releases:

* Expose ability to 'test' deployments. The server supports a dry-run
    facility to show what would deploy if it really did. You'd have been
    able to catch the unexpected (even if intended) behavior in that case.
    That capability even in 2.2 is not exposed in the web client.

* Support a 'dont_delete' option. This was intended to be in the
    original version of the FSR, but ultimately it did not make the cut.
    Really, although we are doing what we think is the right thing, you
    may want different behavior. It should be a configuration option.

And I do apologize for your troubles. At a minimum, this points to
better documentation on our wiki so that others know what to expect
when deployment happens.

And in advance of that, your sharing your experience on the forums is
appreciated. I hope everyone is reading this thread!!!

Kevin

Re: WARNING - deployment receiver is DANGEROUS

scottf — Wed, 15 Apr 2009 02:59:06 GMT

Hi,
I am seeing the same behaviour at the moment and I am using the recent ENT 3.1 release.

Is there a solution to this problem?

Like Fred I am using Alfresco to manage only the static content of my site, so cannot have the FSR deleting non-alfresco content when deploying snapshots.

Kevin, if you are around can you shed some light on if there has been any progress on this for 3.1? or is this still the behaviour? Is it configurable at all? you mentioned a "do not delete option"?

Fred, if you are still around, how did you address this problem?

Thanks for any help.

Re: WARNING - deployment receiver is DANGEROUS

mrogers — Wed, 15 Apr 2009 08:17:48 GMT

http://wiki.alfresco.com/wiki/FSR

The behaviour of the FSR was changed in the 3.0 to only delete content managed by Alfresco. Are you using a V3 FSR?

When you start up a V3 FSR you should see messages in the log relating to validating the filesystem.

Re: WARNING - deployment receiver is DANGEROUS

ftoth — Wed, 15 Apr 2009 11:04:20 GMT

Hi Scott,

I'm still around!

However, we're still running 2.1 community, so I'm not sure if my solution is still relevant.

We ended up taking advantage of the "post deploy" feature of the deployer. We point
the deployment receiver to a safe directory that it's free to manage. We then have
a post deploy script that runs on every deploy. Our script is free to do whatever we
need, including ignoring alfresco delete commands if necessary.

Hope that helps.

Fred

Re: WARNING - deployment receiver is DANGEROUS

scottf — Wed, 15 Apr 2009 13:15:19 GMT

Thanks very much for the replies guys.

mrogers - yes I am using a 3.1 FSR, but the "errorOnOverwrite" was set to the default false. I'll change it to true and re-test.

Fred - thanks for the information. That's definitely a good option if I don't get the out-of-the-box functionality I need.

I'll post back here after I run some tests to let others know.

Thanks again,
Scott.

Re: WARNING - deployment receiver is DANGEROUS

scottf — Wed, 15 Apr 2009 14:53:54 GMT

Ok,
Some interesting behaviour.

I've retested after setting errorOnOverWrite to true and restarting my FSR.

Within Alfresco Explorer I then created a webapp sub-folder I know already exists in my deployment location and I added a single file.

I then submitted my changes and deployed to that FSR. With errorOnOverWrite set to true an error is thrown and the deployment fails. I think this is expected.

09:59:26,385 WARN  [org.alfresco.deployment.impl.server.DeploymentReceiverServiceImpl] writing to pre-existing directory, path:C:\Toolkit\Stores\WebContent\StoreOne\javascript
09:59:26,385 ERROR [org.alfresco.deployment.impl.server.DeploymentReceiverTransportImpl] error in mkdir ticket:b4bd1304-228f-4c9e-a9b9-7ece18fa9f2e, path:/javascript, guid:7f16cbc7-6f8f-4372-9f98-c81d19562074
org.alfresco.deployment.impl.DeploymentException: directory already exists, path:C:\Toolkit\Stores\WebContent\StoreOne\javascript‍‍‍

In this case the new file doesn't get pushed to the FSR.

When I run the FSR with errorOnOverWrite set to false the following happens:
Within Alfresco Explorer I created another webapp sub-folder I know already exists in my deployment location and I added a single file.

When I then browsed the file system the folder was there but all it now contains is the single file I added through the client, all my non-alfresco files and folders that were stored in the same folder on the file system have now been deleted.

In the deployment.log file it does mention that it is writing to a pre-existing directory, but it still goes ahead and deletes that folder's contents anyway….seems odd:


    09:30:28,167 WARN  [org.alfresco.deployment.impl.server.DeploymentReceiverServiceImpl] writing to pre-existing directory, path:C:\Toolkit\Stores\WebContent\StoreOne\css
‍‍‍

To re-cap I am using Alfresco 3.1 on windows XP, derby DB (for evaluating and testing), and a 3.1 FSR also on windows XP.

Is this the standard behavior for 3.1? or is this a bug?

What I need is for the FSR the be able to copy content into an existing folder, but not delete the non-alfresco content in that folder. Is this possible?

I need to get this working as the plan is to use Alfresco for managing the static content of a very large website.

mrogers - any ideas?

Re: WARNING - deployment receiver is DANGEROUS

mrogers — Wed, 15 Apr 2009 15:41:32 GMT

I've just checked the code and it looks like a bug Alfresco taking over the directory "C:\Toolkit\Stores\WebContent\StoreOne\css" has been too agressive.

Could you raise your scenario in Jira please?

As an immediate work around deploy from alfresco first and then copy in your extra content.

Or if you want to patch your source code replace the DeploymentReceiverServiceImpl.java lines #276-281 with if(!f.exists()) { f.mkdir(); }

Re: WARNING - deployment receiver is DANGEROUS

scottf — Wed, 15 Apr 2009 16:24:18 GMT

wow…that is bad news, thanks for investigating.

I added an issue in JIRA (my first one, so it might be incorrect), but I could only mark it againts labs, not ENT 3.1.

Maybe you could move it? https://issues.alfresco.com/jira/browse/ALFCOM-2784

I am currently not working from SVN, so the code change is not really an option at the moment.

Re: WARNING - deployment receiver is DANGEROUS

mrogers — Wed, 15 Apr 2009 16:53:29 GMT

ALFCOM-2784 is now fixed on HEAD.