SOA 12c - FTP Adapter (Chunked Get File)

Here we go!
Information that you need to know:

In the outbound direction, the Oracle FTP Adapter works the same way as the File Chunked Read operation of the Oracle File Adapter in that operation enables you to process large files and uses a BPEL Invoke activity within a while loop to process the target file.
The FileAdapter allows the BPEL process modeler to use an Invoke activity to retrieve a logical chunk from a huge file, enabling the file to stay within memory constraints. The process calls the chunked-interaction in a loop in order to process the entire file, one logical chunk at a time. The intent is to achieve de-batchability on a file's outbound processing.

* The major difference is that the Oracle FTP Adapter is used for remote file exchanges.
* Chunked Read is not supported in SFTP.

For more detailed information read the following URL: https://docs.oracle.com/middleware/1213/adapters/develop-soa-adapters/GUID-088EFFE9-AE8B-4A35-B9DB-0A0DDA1BBBE7.htm#TKADP275

In this post, we will learn how create a SOA Project with FTP Adapter - Operation Type: Chunked Get File (outbound operation).

The next images are the SOA Project execution:

Now we are going to open JDeveloper IDE and click on File menu > New > Application.

For example:


On the Application window, set the next values, and click on next button.
Application Name FTPAdapter
Directory C:\JDeveloper\mywork\FTPAdapter
Application Package Prefix

For example:


On the Project window, set the next values, and click on next button.
Project Name  ChunkedGetFile
Directory C:\JDeveloper\mywork\FTPAdapter\ChunkedGetFile

For example:


On the Configure SOA settings window, set the next values, and click on finish button.
Standard Composite  Empty Composite

For example:


After clicking on finish button, the JDeveloper IDE has the next appearance:

Then the next step, on External References section right click > Insert > FTP, then enter the ftpReference value on Name, then click on next button.

For Example:

Then on Adapter Interface click on next button.

Then on FTP Server Connection put your value, in this practice we already created a FTP Server Connection on Weblogic: eis/Ftp/FtpAdapter click on next button.

Then on Operation select Ascii as a File Type, Chunked Get File as a Operation type and 5 as a Chuck Size, click on next button.
Note:  The Chunk Size parameter governs the number of nodes or records (not lines) that are returned.

For example, if you have an address book as a native CSV file and you have specified a ChunkSize of 5, each call to the Invoke activity returns an XML file containing 5 address book nodes; that is, five rows of CSV records in XML format.
In that sense, the ChunkSize parameter is analogous to the PublishSize parameter used by the FileAdapter for an inbound transaction.

Then on File Directories, put the directory for incoming file, then click on next button.

Then on File Name, set iscfgg.txt as a File Name, then click on next button.

For Example:

Then on Message, click on Define Schema for Native Format.

For Example:

Note: If you already created the XSD file you can just select it.

Once the Native Format Builder window is displayed we have 8 steps to generate our XSD.



Then on File Name and Directory, set the next values, and click on next button.

File Name nxsd_schema1.xsd
Directory Name  C:\JDeveloper\mywork\FTPAdapter\ChunkedGetFile\SOA\Schemas
For Example:

Then on Choose Type, select Delimited such as Select file type.

Select file type  Delimited (Contains records whose fileds are delimited by a scpecial character)
For Example:

Then on File Description, we need specify name of the file that you want to sample. So, we need do click on Browse button and then select its respective file.
In our case we are going to change the value of Character set by UTF-8, then click on next button.
Note: We will leave the rest of the values as they are by default.

For Example:

Then on Record Organization, we are going to select File contains multiple record instances, then select Multiple records are of single type.
Click on next button.

For Example:

Then on Specify Elements, we are going to fill the target namespace and the element names.

For the Target namespace we are going to put http://TargetNamespace.com/ftpReference, this value is pupulated by default.
By default the name of the element containing multiple records are Root-Element we are going to maintain the same value.
We are going to put employee such as name for element that will represent record.
Click on next button.

For Example:

Then on Specify Delimiters, we are goint to select End of Line($eol) such as records delimiter and select Comma (,) such as fields delimiter, and the rest of the values will be kept by default.
Note: The delimiter depends of your delimiter file, in our case we have "," such as delimiter.
Click on next button.

For Example:

Then on Field Properties, we are going to specify the field names and field properties.
We are going to check "use the first record as the field names", then click on next button.

For Example:

In the current window we are going to view our generated native format schema.
We are going to do click on Test button just to validate if all the previously steps are success.

For Example:

Then on Finish, click on finish button.

Then, returning to the Message step, we are going to select our xsd generated and the Root-Element such as Schema Element, then click on next and click on finish.

Then the next step, we need to select the BPEL Process component, this component is located on the right side, on Components section, when you found this, select it and drag it to Components section on work area.

For Example:

On the Create BPEL Process window, set the next values, and click on ok button.

BPEL Specification  BPEL 2.0 Specification
Name BPELProcessChunkedGetFile
Namespace http://xmlns.oracle.com/FTPAdapter/ChunkedGetFile/BPELProcessChunkedGetFile
Directory C:\JDeveloper\mywork\FTPAdapter\ChunkedGetFile\SOA\BPEL
Template Type Web Service
Template Asynchronous BPEL Process
Service Name bpelprocessChunkedgetfile_client
Expose as a SOAP Service  Checked
Delivery async.persist
Transaction
Input {http://xmlns.oracle.com/FTPAdapter/ChunkedGetFile/BPELProcessChunkedGetFile}process
Output {http://xmlns.oracle.com/FTPAdapter/ChunkedGetFile/BPELProcessChunkedGetFile}processResponse

For example:

Now we need drag to add a new Service, with this action we will have available the Partner Links on .bpel file.

For example:

Now we are going to do double click on component: BPELProcessChunkedGetFile, then on BPELProcessChunkedGetFile.bpel file, we need to select the Invoke activity and drag to work area, then change the name to InvokeFtpReference

For example:

Then we need to drag onto a Partner Link to make a Web Service connection. On the Edit Invoke window, set the next values, and click on ok button.

Input Variable  chunkedRead_InputVariable
Type {http://xmlns.oracle.com/pcbpel/adapter/ftp/FTPAdapter/ChunkedGetFile/ftpReference}Empty_msg
Output Variable  chunkedRead_OutputVariable
Type {http://xmlns.oracle.com/pcbpel/adapter/ftp/FTPAdapter/ChunkedGetFile/ftpReference}SynchRead_msg

For example:

Until this part of this exercise we already covered the Chunked Get File operation from the FTP Adapter Reference, if you run the service you should be able to see a successful reading of the files, but at this point we can do whatever you want, in my case I am going to leave the practice up to this point, I hope the information has helped you.

Now the next step is create a jar file to can deploy it on WebLogic Server, we need to select the ChunkedGetFile project and righ click, then chose the ChunkedGetFile... option.

For example:


On the Deployment Action window, set the next values, and click on next button.
Deployment Action  Generate SAR File

For example:


On the Deployment Configuration window, set the next values, and click on next button.
New Revision ID  1.0

For example:


On the Deployment Summary window, click on Finish button.
For example:


If all steps were successful, then you will view on yours JDeveloper IDE the correctly deployment.
For example:

Comments

Post a Comment

Popular posts from this blog

SOA 12c - Fault Handling (Creating Fault Policies and Fault Bindings)

Image
Here we go! Information that you need to know: Using Fault Handling in a BPEL Process. Fault handling allows a BPEL process service component to handle error messages or other exceptions returned by outside web services, and to generate error messages in response to business or runtime faults. For more detailed information read the following URLs: https://docs.oracle.com/cloud/latest/soa121300/SOASE/GUID-FE546F09-E9DF-4859-AEF6-A1C7A3F40C75.htm#SOASE478 Fault management framework is used to catch faults and perform user-specified actions defined in a fault policy file. In SOA Suite 12c we have a wizard to create fault policies and fault binding files. In this post, we will learn how to add a Fault Policy in an SOA project. We need to start the JDeveloper IDE. Click on File menu, then click on New option, followed immediately by Application option. For Example: Then on the New Gallery window, choose Applications option in General Category, then choose SOA Application ...
Read more

SOA 12c - DB Adapter (Poll for New or Changed Records in a Table)

Image
Here we go! Information that you need to know: Polling Strategies The inbound receive enables you to listen to and detect events and changes in the database, which in turn can be the initiators of a business process. This is not a one-time action, but rather an activation. A polling thread is started, which polls a database table for new rows or events. Whenever a new row is inserted into the MOVIES table, the polling operation raises it to the SCA Run Time. The strategy is to poll every record once. The initial SELECT has to be repeated over time, to receive the rows that exist at the start and all new rows as they are inserted over time. However, a new row once read is not likely to be deleted, and therefore can possibly be read repeatedly with each polling. The various ways to poll for events, called polling strategies, also known as after-read strategies or publish strategies, range from simple and intrusive to sophisticated and nonintrusive. Each strategy employs a dif...
Read more

SOA 12c - DB Adapter (Perform an Operation on a Table)

Image
Here we go! Information that you need to know: Data manipulation language (DML) operations align with basic SQL INSERT , UPDATE , and SELECT operations. SQL INSERT , UPDATE , DELETE , and SELECT are all mapped to Web Service operations of the same name. The MERGE is either an INSERT or UPDATE , based on the results of an existence check. A distinction is made between the data manipulation operations—called outbound writes—and the SELECT operations—called outbound reads. The connection between the Web Service and the SQL for merge (the default for outbound write) and queryByExample are not as obvious as for basic SQL INSERT , UPDATE , and SELECT . For more detailed information read the following URL: https://docs.oracle.com/cd/E28280_01/integration.1111/e10231/adptr_db.htm#CHDFGBGD In this post, we will learn how create a SOA Project with Database Adapter - Operation Type: Perform an Operation on a Table The next images are the SOA Project execution: We are going...
Read more