Showing posts with label Orchestrator Integration Toolkit. Show all posts
Showing posts with label Orchestrator Integration Toolkit. Show all posts

Tuesday, September 18, 2012

SCOrch FTP Integration Pack Update v1.3

I've just released v1.3 of the Orchestrator IP for FTP/SFTP.  You can find it on codeplex at this link:


Please install this in a test environment before deploying to production!  Also, please comment on any issues/bugs you may encounter.

********
Since adding the extra "UsePassive" and "UseBinary" input fields, please note the following steps required for existing installs upgraded to v1.3.  These fields must be commited to the database in the existing activity before they will work.

1)  Stop runbooks where the activities are located.
2)  Check out the runbook
3)  Open the activity and click "Finish" (no changes required)
4)  Check in the runbook
(Thanks to Jeff for the insight for commiting the added fields to existing activities!)
********

Activity Change Log:
 
Create Folder
Resolve issue where host key is not saved and cmd to change directory fails
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

Delete File
Resolve issue where host key is not saved and cmd to change directory fails
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

Delete Folder
Resolve issue where host key is not saved and cmd to change directory fails
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

Download File
Resolve issue where host key is not saved and cmd to change directory fails
Add option for deleting source file(s)
Add option for bin/ascii transfer
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

List Folder
Resolve issue where host key is not saved and cmd to change directory fails
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

Rename File
Resolve issue where host key is not saved and cmd to change directory fails
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling

Upload File
Resolve issue where host key is not saved and cmd to change directory fails
Add option for deleting source file(s)
Add option for bin/ascii transfer
Add option for passive/active connection
Allow Paths/Filenames with spaces
Adjust FTP Timeout
Dir Change Error Handling
Empty File/0 byte Error Handling

Tuesday, June 19, 2012

FTP Integration Pack Update v1.2

****Update 20120918****
I've just released v1.3 of the FTP/SFTP IP.
Post:
http://jmattivi.blogspot.com/2012/09/scorch-ftp-integration-pack-update-v13.html
CodePlex:
https://scorchestrator.codeplex.com/releases/view/94807


 ****Update****
I've updated the IP to v1.2 to fix an issue w/ the List Folder activity when using Secure = False.  Updated build has been posted to codeplex.
https://scorchestrator.codeplex.com/releases/view/89913


I've kicked the tires on the FTP Integration Pack a bit more and have updated the List Folder activity.  It will now only output the directory contents rather than displaying the entire verbose output (which is kinda redundant from the results published data).

I've also updated the download to Stable from Beta.  Please let me know if any bugs are encountered and/or if there are any feature requests.

Unfortunately, the FTPWebRequest class doesn't support wildcards for Secure = False (FTP). However, the Secure = True method (SFTP) in the IP does support using wildcards such as * or *.txt.

One way to get around the FTP method using wildcards would be to use the List Folder activity to find the files in the folder, parse them, and then pass each into the Download File activity.

For instance, use List Folder to get the files in the Output published data:
07-12-12 08:56AM 0 asdf.txt
07-12-12 08:56AM 0 blah.txt

Parse the Output and pass asdf.txt and blah.txt to the Download File activity.


The Integration Pack can be downloaded from this link below:
https://scorchestrator.codeplex.com/releases/view/89913



Tuesday, June 12, 2012

Integration Pack for FTP

****Update 20120918****
I've just released v1.3 of the FTP/SFTP IP.
Post:

http://jmattivi.blogspot.com/2012/09/scorch-ftp-integration-pack-update-v13.html
CodePlex:

https://scorchestrator.codeplex.com/releases/view/94807

********Please see this post for the updated v1.2
http://jmattivi.blogspot.com/2012/06/ftp-integration-pack-update-v11.html
********

I've just published an FTP/SFTP Integration Pack that can be downloaded from https://scorchestrator.codeplex.com/releases/view/89427.

Here are the current activities supported in the IP.  The SFTP portion is based off of Putty's psftp software (documentation can be referenced here).  The FTP functionality is based off of the System.Net.FtpWebRequest Class (documentation can be referenced here).  I was looking to provide roughly the same functionality the FTP Integration Pack for Opalis had.



All fields are required for each activity.   Secure and AutoAcceptKey are set to True by default

Secure = True
 --SFTP

 Secure = False
 --FTP

AutoAcceptKey only applies if Secure = True
AutoAcceptKey  = True
--Automatically accept the host key presented by the server
****This can be insecure****

AutoAcceptKey = False
--This will technically cause the application to prompt to accept the key, which in turn would cause the activity to fail.  However, you can proactively manually store the host key and leave this set to false if security requires it.


Unfortunately, the FTPWebRequest class doesn't support wildcards for Secure = False (FTP). However, the Secure = True method (SFTP) in the IP does support using wildcards such as * or *.txt.

One way to get around the FTP method using wildcards would be to use the List Folder activity to find the files in the folder, parse them, and then pass each into the Download File activity.

For instance, use List Folder to get the files in the Output published data:
07-12-12 08:56AM 0 asdf.txt
07-12-12 08:56AM 0 blah.txt

Parse the Output and pass asdf.txt and blah.txt to the Download File activity.
 

Upload File Example:




Download File Example:



Please kick the tires on this and let me know if you find any bugs or see the potential for functionality improvements.

This is the first time I've really poked around w/ the OIT command line activity wizard....now I have to teach myself C# here shortly to start building projects in Visual Studio w/ the SDK going forward. :)