Team:Berkeley Software/KeplerTutorial
From 2009.igem.org
Line 50: | Line 50: | ||
One of the key challenges for biology tool development is how to effectively share and cooperate. This year we strengthened the possibility of establishing a connection between Clotho and other software tools. In particular, the Clotho platform and Kepler can connect and send data through the a remote API interface via Java RMI. This RMI connection will guarantee Clotho and Kepler to talk to any Java software that import the same interface. | One of the key challenges for biology tool development is how to effectively share and cooperate. This year we strengthened the possibility of establishing a connection between Clotho and other software tools. In particular, the Clotho platform and Kepler can connect and send data through the a remote API interface via Java RMI. This RMI connection will guarantee Clotho and Kepler to talk to any Java software that import the same interface. | ||
- | <center>[[Image:BerkeleySoftware_ClothoConnection.png|left|thumb|550px|<span style="font-family: Georgia, serif;">RMI Connection</span>]]<br></center> | + | <center>[[Image:BerkeleySoftware_ClothoConnection.png|left|thumb|550px|<span style="font-family: Georgia, serif;">RMI Connection and Clotho Interaction</span>]]<br></center> |
<br clear="all"> | <br clear="all"> | ||
Line 79: | Line 79: | ||
</code> | </code> | ||
- | [[Image:BerkeleySoftware_KeplerGetString.png| GetString | + | [[Image:BerkeleySoftware_KeplerGetString.png|thumb|left|300px|<span style="font-family: Georgia, serif;">GetString Actor Interface</span>]]<br> |
+ | |||
This is the configuration of the Kepler actor GetString. This actor can read data from tools in Clotho and send out a String object to output ports. In the image, we want to read data from the tool AlgorithmManager, if there are multiple data fields, we can further specify what data we want with the other two parameters. | This is the configuration of the Kepler actor GetString. This actor can read data from tools in Clotho and send out a String object to output ports. In the image, we want to read data from the tool AlgorithmManager, if there are multiple data fields, we can further specify what data we want with the other two parameters. | ||
==User Options== | ==User Options== | ||
In an assembly workflow, it is needed to to have some user options such as antibiotic choices or stage choices. The problem can get user to select a choice at runtime, along with displaying some information about the current data so the user knows better about about their preferred choice. However, if the same workflow needs to run multiple times, with almost the same data and choice, repeatedly asks the user to click similar things each time is not ideal. With Kepler workflow, we present two ways of giving users' choices, either at runtime or parameters before workflow starts. For example, the Dialog Option actor for antibiotic choices will pop up a dialog for choosing antibiotic at runtime, after Kepler get the assembly graph and gives explanation about what is inside each choices. Alternatively, experienced user can also input an integer as antibiotic index before clicking run, and the workflow will run to finish without pause & pop-up dialog. These dual ways of user options enable the workflow to run as a regular tool step-by-step choices and a fully automated process for a large numbers of similar run, even without graphic interface. | In an assembly workflow, it is needed to to have some user options such as antibiotic choices or stage choices. The problem can get user to select a choice at runtime, along with displaying some information about the current data so the user knows better about about their preferred choice. However, if the same workflow needs to run multiple times, with almost the same data and choice, repeatedly asks the user to click similar things each time is not ideal. With Kepler workflow, we present two ways of giving users' choices, either at runtime or parameters before workflow starts. For example, the Dialog Option actor for antibiotic choices will pop up a dialog for choosing antibiotic at runtime, after Kepler get the assembly graph and gives explanation about what is inside each choices. Alternatively, experienced user can also input an integer as antibiotic index before clicking run, and the workflow will run to finish without pause & pop-up dialog. These dual ways of user options enable the workflow to run as a regular tool step-by-step choices and a fully automated process for a large numbers of similar run, even without graphic interface. | ||
- | [[Image:BerkeleySoftware_AntibioticChoices.png|600px| Dialog | + | [[Image:BerkeleySoftware_AntibioticChoices.png|thumb|left|600px|<span style="font-family: Georgia, serif;">Dialog Option Illustration for Antibiotic Selection</span>]]<br> |
+ | <br clear="all"> | ||
The stage chooser also is designed with flexibility, allowing user to further modify the stage choice by putting an array of stage numbers, or another dialog option. | The stage chooser also is designed with flexibility, allowing user to further modify the stage choice by putting an array of stage numbers, or another dialog option. | ||
Revision as of 00:19, 22 October 2009
Kepler Tutorial
Introduction
The Kepler design environment helps scientists design models and perform analysis across a broad range of scientific and engineering disciplines. We were interested in answering the question, "can Kepler be used in synthetic biology efficiently". In order to investigate this more we introduced Kepler into synthetic biology by building a set of new Kepler actors for assembly automation and to provide a remote connection to Clotho. Our goal was to create a set of reusable actors and workflows which in the face of constant change could adapt to reflect the latest lab protocols and design flows. For more information on Kepler we invite you to check out the [http://kepler-project.org/ Kepler Project Website]. In addition, much of the work we performed was with the [http://chess.eecs.berkeley.edu Center for Hybrid Embedded Software Systems (CHESS)] as Kepler was born of the [http://ptolemy.eecs.berkeley.edu/ Ptolemy Project].
Components
In Kepler, a workflow is built from a collection of process steps that run under the control of a supervisor system.
Those separate steps are called "actors", they are represented as square icons but inside them resides code determining what to run in a "step" of a workflow simulation. A step can be an input/output operation, a computational function, or even another workflow. Actors can support hierarchical construction where composite actors contain multiple primitive actors. These actors are supervised by the "director", which keeps track of when to run each actor.
Kepler comes with a library of available actors for many tasks, and user can always write their custom actors and share.
The online manuals provide detailed instruction for installing and making workflows: Kepler Documentation. We highly recommend those interested read this material as it contains much more detailed descriptions then we will provide here.
Automated Assembly Workflow
As described in the Kepler project page, this workflow receives assembly information from Clotho's Algorithm Manager, and outputs files for the liquid handling robot as well as human readable instructions.
Detailed Actor List
A. OpenClothoConnection: connect Kepler to Clotho while the Clotho RMI Tool is running. If successful, this actor will output the connection with Clotho RMI methods so the next actors can use them.
B. GetAssemblyGraph & GetString: both receive data from Clotho, such as an assembly graph or some debugging information. These actors output either genetic Object data or a special structure such as the assembly information.
C. GraphProcessing: process the assembly information, check & prepare data for further options.
D. DialogOption: allows for users to make antibiotic choices, either at runtime or the user can provide a choice as a parameter before workflow runs.
E. AutomationScheduler
F. Constant: Input for the stage number. This is only a constant number, thus it is easy for future modifications such as using an array so that multiple stages can be specified in one run.
G. OneStageProcessing: Creates the files from an assembly graph, the choice of stage, and antibiotic selection.
H. Display actors: Use to display information, such as when the workflow is finished getting data and the names of created files.
Clotho RMI Connection
One of the key challenges for biology tool development is how to effectively share and cooperate. This year we strengthened the possibility of establishing a connection between Clotho and other software tools. In particular, the Clotho platform and Kepler can connect and send data through the a remote API interface via Java RMI. This RMI connection will guarantee Clotho and Kepler to talk to any Java software that import the same interface.
In our assembly workflow, we made a custom actor which opens a Clotho RMI connection. We also made actors that read data from Clotho tools. These actors support communication via genetic data objects (for maximum flexibility) and have parameters for tool name and object fields, thus they will work with any future Clotho tools, as long as those tools support Clotho Data API methods.
Clotho RMI interface:
/** * Get data from a Clotho tool. The tool must already instantiated in Clotho. * Data will be called from the core method getData * @param toolName - exact class name in up & lower case of a Clotho tool * @param object * @param field * @return data as Object, need to cast back to the correct class * @throws java.rmi.RemoteException */ public Object getData(String toolName, String object, String field) throws RemoteException; /** * Send data to an instantiated Clotho tool. * Data will be sent by the core method sendData without operation code * @param toolName -exact class name in up & lower case of a Clotho tool * @param object * @param field * @param data - Data to be sent * @throws java.rmi.RemoteException */ public void sendData(String toolName, String object, String field, Object data) throws RemoteException;
This is the configuration of the Kepler actor GetString. This actor can read data from tools in Clotho and send out a String object to output ports. In the image, we want to read data from the tool AlgorithmManager, if there are multiple data fields, we can further specify what data we want with the other two parameters.
User Options
In an assembly workflow, it is needed to to have some user options such as antibiotic choices or stage choices. The problem can get user to select a choice at runtime, along with displaying some information about the current data so the user knows better about about their preferred choice. However, if the same workflow needs to run multiple times, with almost the same data and choice, repeatedly asks the user to click similar things each time is not ideal. With Kepler workflow, we present two ways of giving users' choices, either at runtime or parameters before workflow starts. For example, the Dialog Option actor for antibiotic choices will pop up a dialog for choosing antibiotic at runtime, after Kepler get the assembly graph and gives explanation about what is inside each choices. Alternatively, experienced user can also input an integer as antibiotic index before clicking run, and the workflow will run to finish without pause & pop-up dialog. These dual ways of user options enable the workflow to run as a regular tool step-by-step choices and a fully automated process for a large numbers of similar run, even without graphic interface.
The stage chooser also is designed with flexibility, allowing user to further modify the stage choice by putting an array of stage numbers, or another dialog option.
Demo