Team:Berkeley Software/Kepler

From 2009.igem.org

(Difference between revisions)
m
Line 46: Line 46:
[[Image:BerkeleySoftware_KeplerBlank.png|center|thumb|480px|<span style="font-family: Georgia, serif;"><center>Starting Kepler (Blank Kepler Design Palette)</center></span>]]
[[Image:BerkeleySoftware_KeplerBlank.png|center|thumb|480px|<span style="font-family: Georgia, serif;"><center>Starting Kepler (Blank Kepler Design Palette)</center></span>]]
-
===3. Specify devices to assemble===
+
===3. Specify Devices to Assemble===
-
This action is done in Clotho's Algorithm Manager - a tool constructed by Berkeley_Software iGEM team 2008.<br>  
+
This process is performed with [https://2008.igem.org/Team:UC_Berkeley_Tools/Project#Algorithm_Manager Clotho's Algorithm Manager], a tool constructed by Berkeley_Software iGEM team 2008.<br>  
-
[[Image:Berkeley_Software2009_ClothoAlgoManager.png|left|thumb|500px|<span style="font-family: Georgia, serif;">Clotho Algorithm Manager with running example.</span>]]
+
 
 +
[[Image:Berkeley_Software2009_ClothoAlgoManager.png|left|thumb|500px|<span style="font-family: Georgia, serif;"><center>Clotho Algorithm Manager Importing Our Running Example</center></span>]]
 +
 
 +
[[Image:Berkeley_Software2009_Reporter1.png|thumb|250px|<span style="font-family: Georgia, serif;"><b>Reporter #1. </b>View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]</span>]]  
 +
[[Image:Berkeley_Software2009_Reporter2.png|thumb|250px|<span style="font-family: Georgia, serif;"><b>Reporter #2.</b> View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]</span>]]   
 +
[[Image:Berkeley_Software2009_Reporter3.png|thumb|250px|<span style="font-family: Georgia, serif;"><b>Reporter #3.</b> View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]</span>]]   
 +
[[Image:Berkeley_Software2009_Reporter4.png|thumb|298px|<span style="font-family: Georgia, serif;"><b>Reporter #4.</b>View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]</span>]]
 +
   
 +
Devices are specified in a string format where basic parts are separated by dots (.) to represent the overall goal part (e.g. A.B.C.D). Each goal part (desired device) is entered on a separate line. This can be done either manually, or imported from a file, or imported directly from [[Team:Berkeley_Software/Spectacles|Spectacles]].<br>
-
[[Image:Berkeley_Software2009_Reporter1.png|thumb|250px| <b>Reporter #1. </b>View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]]]
 
-
[[Image:Berkeley_Software2009_Reporter2.png|thumb|250px| <b>Reporter #2.</b> View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]]]   
 
-
[[Image:Berkeley_Software2009_Reporter3.png|thumb|250px|<b>Reporter #3.</b> View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]]]   
 
-
[[Image:Berkeley_Software2009_Reporter4.png|thumb|298px|<b>Reporter #4.</b>View in [[Team:Berkeley_Software/Spectacles|Spectacles.]]]]   
 
-
Devices are specified in a string format where basic parts are separated by dots to represent the overall goal part. Each goal part is entered on a separate line. This can be done either manually, or imported from a file, or imported from [[Team:Berkeley_Software/Spectacles|Spectacles]].<br>
 
In our example we can assume that parts were designed in [[Team:Berkeley_Software/Spectacles|Spectacles]] and imported into Clotho's Algorithm Manager.
In our example we can assume that parts were designed in [[Team:Berkeley_Software/Spectacles|Spectacles]] and imported into Clotho's Algorithm Manager.
<br clear="all">
<br clear="all">
-
In the Clotho's Algorithm Manager, input parts are converted into the efficient assembly graph which is exported into the Kepler's workflow as <u>Assembly Info</u>. For our example assembly graph can be represented visually as:<br>
 
-
[[Image:Berkeley_Software2009_AssemblyGraph.png|center|thumb|1000px|<span style="font-family: Georgia, serif;">Assembly graph for reporter family construction.</span>]]
 
-
===4. Launch tool to connect Clotho & Kepler===
+
In the Clotho's Algorithm Manager, the designs imported are converted into an efficient assembly graph which is exported into the Kepler's workflow as <u>Assembly Info</u>. Our example assembly graph can be represented visually as:<br>
-
[[Image:BerkeleySoftware_RMITool.png|center|thumb|500px|<span style="font-family: Georgia, serif;">RMI Tool to connect Clotho to Kepler.</span>]]
+
 
 +
[[Image:Berkeley_Software2009_AssemblyGraph.png|center|thumb|1000px|<span style="font-family: Georgia, serif;"><center>Assembly Graph Example for Reporter Family Construction.</center></span>]]
 +
 
 +
===4. Launch Tool to Connect Clotho & Kepler===
 +
[[Image:BerkeleySoftware_RMITool.png|center|thumb|500px|<span style="font-family: Georgia, serif;"><center>Clotho Remote Method Invocation (RMI) Tool to Connect Clotho to Kepler</center></span>]]
-
This tool provides the mean to import assembly graph as assembly information (<u>Assembly Info</u>) object into the Kepler environment. Further explanation about the Clotho-Kepler connection can be found on the tutorial page : [https://2009.igem.org/Team:Berkeley_Software/KeplerTutorial#Clotho_RMI_Connection Clotho-Kepler Connection.]
+
This tool provides the means to import an assembly graph as an assembly information (<u>Assembly Info</u>) object into the Kepler environment. Further explanation about the Clotho-Kepler connection can be found on the tutorial page : [https://2009.igem.org/Team:Berkeley_Software/KeplerTutorial#Clotho_RMI_Connection Clotho-Kepler Connection.]
-
===5. Launch Kepler assembly automation assignment workflow===
+
===5. Launch Kepler Assembly Automation Assignment Workflow===
-
Load the automation workflow file into Kepler, choose the stage number then click the Run icon.
+
The steps to begin this process are: load the automation workflow file into Kepler, choose the stage number (where you wish to begin in the assembly graph), then click the "Run" icon.
-
[[Image:BerkeleySoftware_KeplerStart.png|center|thumb|600px|<span style="font-family: Georgia, serif;">Automation workflow in Kepler.</span>]]<br>
+
[[Image:BerkeleySoftware_KeplerStart.png|center|thumb|600px|<span style="font-family: Georgia, serif;"><center>Automation Workflow in Kepler</center></span>]]<br>
Further technical explanation about the workflow can be found on the tutorial page: [https://2009.igem.org/Team:Berkeley_Software/KeplerTutorial#Assembly_Workflows Assembly workflow].
Further technical explanation about the workflow can be found on the tutorial page: [https://2009.igem.org/Team:Berkeley_Software/KeplerTutorial#Assembly_Workflows Assembly workflow].
-
===6. Process <u>Info</u> according to stage number===
+
===6. Process <u>Info</u> According to the Stage Number===
-
In this part we process assembly information(<u>Assembly Info</u>) according to stage number, reading Assembly Graph in arrays of parts united with the same index. That results in sorted assembly graph:<br>
+
In this step we process assembly information(<u>Assembly Info</u>) according to stage number, reading the Assembly Graph in arrays of parts united with the same index. That results in sorted assembly graph:<br>
[[Image:Berkeley_Software2009_sortedAssemblyGraph.png|center|thumb|1000px|<span style="font-family: Georgia, serif;">Processed assembly graph for our running example.</span>]]
[[Image:Berkeley_Software2009_sortedAssemblyGraph.png|center|thumb|1000px|<span style="font-family: Georgia, serif;">Processed assembly graph for our running example.</span>]]
<br clear="all">
<br clear="all">

Revision as of 23:15, 21 October 2009


Automated Assembly and Kepler Integration

Introduction

Kepler - Wise Astronomer and Workflow Wizard (Courtesy of Christine Tsin)

Two of the key requirements for introducing automation into the biological design process are reproducibility of specific protocols and formally capturing these protocols. Often these are very complicated, take considerable time to develop and “debug”, and are lab/equipment specific. A highly modular, expressive, and extensible framework to capture and design these workflows would be useful. Our project integrated the Kepler workflow design environment with the existing Clotho platform, in order to formally capture a number of specific design protocols related to composite part assembly.

Kepler is a multi-university design effort focusing on scientific workflows, and is used by a wide variety of projects in different fields. This work is done in conjunction with one of our sponsors, the Center for Hybrid & Embedded Software Systems (CHESS). We are improving protocol automation and also creating material for a larger audience as well.

There are two main components to our discussion: The first, on this page, discusses the way in which we can go from a composite device, to an assembly graph (an object representing its efficient assembly), and finally to commands for a liquid handling robot. The second discussion involves more information about the way we converted this process into a Kepler workflow and provides an overview of the Kepler design software. We hope these pages provide all the information you need to understand this project and we would love to answer any questions you have either via email or at the jamboree!




Automated Assembly "Big Picture"

Our Design Flow Integrating Both Clotho and Kepler

Preliminaries

Our "big picture" design flow has been implemented for the 2ab assembly protocol that is used in J.Christopher Anderson's lab. In addition we have been working on alternative, non-binary, one-pot assembly protocols (e.g. Golden Gate), parallel sequencing, and parts packaging with the Joint BioEnergy Institute. The latest projects were started in August and we are continuing to develop them.

Initially, the assembly automation workflow had been constructed as a plug-in in Clotho Classic (last year's iGEM project), but its conversion to Kepler's workflow allowed for more user-choices and pre-defined settings explained in more detail here.

Running Example for Automated Assembly

As we are going through steps in the workflow, we will be using a "running example" to provide a consistent frame of reference. We will show the construction of a family of reporters which consists of four devices:

  1. Reporter #1 - BBa_I13521
  2. Reporter #2 - BBa_I763007
  3. Reporter #3 - BBa_J5526
  4. Reporter #4 - BBa_J3901

Zooming In

1. Start Clotho

Starting Clotho (Main GUI)

2. Start Kepler

Starting Kepler (Blank Kepler Design Palette)

3. Specify Devices to Assemble

This process is performed with Clotho's Algorithm Manager, a tool constructed by Berkeley_Software iGEM team 2008.

Clotho Algorithm Manager Importing Our Running Example
Reporter #1. View in Spectacles.
Reporter #2. View in Spectacles.
Reporter #3. View in Spectacles.
Reporter #4.View in Spectacles.

Devices are specified in a string format where basic parts are separated by dots (.) to represent the overall goal part (e.g. A.B.C.D). Each goal part (desired device) is entered on a separate line. This can be done either manually, or imported from a file, or imported directly from Spectacles.

In our example we can assume that parts were designed in Spectacles and imported into Clotho's Algorithm Manager.

In the Clotho's Algorithm Manager, the designs imported are converted into an efficient assembly graph which is exported into the Kepler's workflow as Assembly Info. Our example assembly graph can be represented visually as:

Assembly Graph Example for Reporter Family Construction.

4. Launch Tool to Connect Clotho & Kepler

Clotho Remote Method Invocation (RMI) Tool to Connect Clotho to Kepler

This tool provides the means to import an assembly graph as an assembly information (Assembly Info) object into the Kepler environment. Further explanation about the Clotho-Kepler connection can be found on the tutorial page : Clotho-Kepler Connection.

5. Launch Kepler Assembly Automation Assignment Workflow

The steps to begin this process are: load the automation workflow file into Kepler, choose the stage number (where you wish to begin in the assembly graph), then click the "Run" icon.

Automation Workflow in Kepler

Further technical explanation about the workflow can be found on the tutorial page: Assembly workflow.

6. Process Info According to the Stage Number

In this step we process assembly information(Assembly Info) according to stage number, reading the Assembly Graph in arrays of parts united with the same index. That results in sorted assembly graph:

Processed assembly graph for our running example.


From this part, the modified assembly information is sent to 8 and basic parts (parts in the 1st row without a stage number) are sent to 7.

7. Choose to supply additional Info location

In this step, basic parts (parts in the 1st row without a stage number) are displayed with their assigned vectors, and the user is asked to choose an option that works the best for him/her. Since the algorithm that generates the assembly graph initially assumes parts sharing, only 6 possible combination-choices for vector option in which to put basic parts are available. A person can choose:

  • the flow that was assigned by algorithm and follow further with parts (do pre-selected Kepler option which avoids display of this dialog);
  • his/her own vector selection out of 6 available choices which were constructed by computer and proceed with his/her flow;
  • to supply a file with the available parts (which are not yet in database) and let the program make a choice for him/her;
  • the option which requires minimum amount of transfers of basic part from one vector into another based on what is available in the database.

This part is still under implementation.

8. Process Info according to user's Choice

In this step, the assembly information that was modified in 6, is modified according to user choice in 7 updating and locking vectors in which parts will reside through out the device construction project.

9. Select stage number

This part allows the user to select a stage number from available stages. If the user selects a stage number out of range, the program will not proceed, keep asking the user for stage number input.
In the plug-in to Clotho Classic, stage selection is a user's dialog, in Kepler this is a number shown in the workflow. Further explanation about Kepler user options.

10. Single Stage processing

Selection of stage in 9 leads to picking parts from arrays (which were constructed during 6 and modified during 8) that are required for construction of composite parts in this stage as well as composite parts themselves. It is illustrated in a less confusing way in the following picture:
Basic parts and composite parts, constructed out of basic parts, in stage 1 of our running example.

In this part the main processing and file construction occurs. All files have a stage number appended to the end of their name thus they are not overwritten when the new stage is executed.
Once the parts required for this stage are picked, they are sorted depending on whether they are lefty, righty, or represent the final device (refer to 2ab protocol for more explanations) and depending on the type of vector that the parts are in. It becomes important for arrangement of the final parts of each stage for further user processing. Then plates are created:

  • stock plate - plate with minipreps
  • bigStock plate - enzyme plate with antibiotics, digestion mix, ligation mix and buffer
  • dilution plate - plate with diluted minipreps
  • rxnPlate - plate with 2 diluted mini-preps mixed together, where digestion mix, and then ligase mix are added
  • platting plates - the plates where resultant parts are plated with antibiotics

About created files:

  • by default all newly-created files are stored in the projects folder in the same folder where Clotho lives
  • dilutionFile(stage#).csv - contains commands for the robot to transfer minipreps for dilution (it is assumed that buffer pippetting is done by multi-channel); (file with similar name dilution4Jenn(stage#) contains user-friendly version of the above file for ease of checking the correctness of the produced instructions).
  • reationFile(stage#).csv - contains commands for robot; built according to user 2ab protocol inquiry;(file reaction4Jenn(stage#).csv is a user-friendly version for the correctness check).
  • platting(stage#).csv - contains instructions for robot about antibiotic transfer for selection process; based on that, reactants will be transferred one to one from the reaction plate by multi-channel pipette.
  • userInstructions(stage#) - file contains instructions about what the user has to have in plates, what decks the user has to put plates on, and what will be the outcome of following those instructions.

Then assignment of wells proceeds. Parts used for construction are assigned to stock plate(s) and then to dilution plate, and then their final products are assigned to reaction plate depending on the sorted order. Then the volume check is performed and if a single part is used repeatedly, its quantity is reduced to one well or to the necessary number of wells in the dilution procedure (to achieve the necessary volume of diluted miniprep prior to reaction). Also at this stage a user can specify the stock plates that he wants the program to use. The assignment of wells in stock plates and their path to dilution plate will be modified. Going further, the dilution plate is assumed to be pre-filled with dilution buffer using a multi-pipetteman on robot. Once well assignment is completed, each plate in dilution step is assigned to an available deck on the robot, these assignments are recorded into the text file with user instructions, and a .csv file with cherry-picking commands for robot is produced. Then the robot decks are freed from the plates that participated in dilution and available decks are assigned to plates that participate in reaction procedure. Another .csv reaction file with commands for robot is constructed. The addition of the digestion mix and ligation mix is also recorded as cherry-picking commands for robot in that file. After this step, the deck assignment is recorded into the user instructions file, together with the amount of buffer required for dilution, amount of digestion and ligation mixes required for reaction to occur. After that the assignments of wells, where the composite parts for this stage will reside, are also recorded.
Robot decks are freed one more time. Another array of plates for platting the resultants with antibiotics (selection of successful parts) is created. Resultant parts are assigned to the platting plates. The plates are assigned to available decks on the robot and another .csv file with commands for robot to perform plating with antibiotics is created.
Information about decks and final parts location is recorded into the file with user instructions. The program notifies the user that it has completed stage that was requested.
The most important part on the theory behind this step in workflow is illustrated in the animation below:

11. Robot

Once the workflow is completed, the user can organize produced .csv Files to input to the robot, as well as open the human instruction file for a certain stage and prepare the plates and their layout according to instructions.

Robot receives .csv Files, follows the commands in them, and produces plates with composite parts and devices for the user.

More on Automation Assembly Assignment Workflow

  • the file with constants can be used to modify the maximum volume that the user wants for a single well in his/her plate to hold in dilution, reaction plates, transfer volumes, etc.
  • the user can generate files for robot starting from any stage at any time as long as he has the initial parts from which he started; or he can generate files for all stages of the ongoing project in a default folder and then rename that folder to prevent files from being overwritten and start working on another assembly project;
  • assigning plates by rows or by columns can be changed by physically going inside of the plugin and setting fillThePlateByRow parameter when the plate is initialized (or changing that default parameter in the constructor of the PlateClass class);
  • the size of the plates is adjustable and can be anything specified as maxR (maximum number of rows) and maxC (maximum number of columns) when the plate is initialized; in the workflow currently 8X12 and 2X12 plates are used.