How to use Pipe-It: A small working example

You can use Pipe-It to "pipe" together your project from bottom-up or top-down. Each software application being launched is called a Process. Any file connected with a Process is called a Resource. You can chain together as many Processes as needed using Connectors, in any order (parallel and/or series). A collection of Processes can be grouped into a Composite. The total collection of all Processes, Resources, and Composites is a Pipe-It Project. An entire Pipe-It Project can be run time-and-again with changes to any input data using the Optimizer.The Runner orchestrates, without user intervention, intelligent and efficient launching of all Processes in a Pipe-It Project. And by using Linkz, any data in Resource files can be accessed and used for further operation.

In this page, you will find a step-by-step procedure to build a very simple Pipe-It project. This example will help you to start the interaction with Pipe-It. A detailed description of a Pipe-It element can be examined by clicking the referenced item (a hyperlink).

Pipe-It Example: Launch a GAWK program

In this example, we will utilize Pipe-It to launch a gawk program ( that will extract data from a text file. Windows version of GAWK is installed with Pipe-It as part of Unix-Utils, to facilitate execution of Pipe-It projects across operating systems.

00 Thomas Manager Sales $5,000
200 Jason Developer Technology $5,500
300 Sanjay Sysadmin Technology $7,000
400 Nisha Manager Marketing $9,500
500 Randy DBA Technology $6,000



gawk -f actions-file data-file [> result-file]

Congratulations! You have just created your first Pipe-It project and run it.

This Pipe-It project example is very simple and far from what Pipe-It can do in real application. This exercise comes with the intention to help new users to start the basic interaction with Pipe-It.

For some real Pipe-It project examples, please refer to Pipe-It Example Projects on the website.

Copyright © 2008-2013 Petrostreamz