Team:Berkeley Software/Kepler

From 2009.igem.org

(Difference between revisions)
m
m
Line 10: Line 10:
[[Image:Kepler.png|280px|right|thumb|Kepler - ]]
[[Image:Kepler.png|280px|right|thumb|Kepler - ]]
<font size="4">T</font>wo of the key requirements for introducing automation into the biological design process are reproducibility of specific protocols and formally capturing these protocols. Often these are very complicated, take considerable time to develop and “debug”, and are lab/equipment specific. A highly modular, expressive, and extensible framework to capture and design these workflows would be useful. Our project integrated the Kepler workflow design environment with the existing Clotho platform, in order to formally capture a number of specific design protocols related to composite part assembly. <br>
<font size="4">T</font>wo of the key requirements for introducing automation into the biological design process are reproducibility of specific protocols and formally capturing these protocols. Often these are very complicated, take considerable time to develop and “debug”, and are lab/equipment specific. A highly modular, expressive, and extensible framework to capture and design these workflows would be useful. Our project integrated the Kepler workflow design environment with the existing Clotho platform, in order to formally capture a number of specific design protocols related to composite part assembly. <br>
-
Kepler is a multi-university design effort focusing on scientific workflows, and is used by a wide variety of projects in different fields. This work is done in conjunction with the [http://chess.eecs.berkeley.edu/ Center for Hybrid & Embedded Software Systems (CHESS)]. We are improving protocol automation and also create material for a larger audience as well.<br>
+
Kepler is a multi-university design effort focusing on scientific workflows, and is used by a wide variety of projects in different fields. This work is done in conjunction with the [http://chess.eecs.berkeley.edu/ Center for Hybrid & Embedded Software Systems (CHESS)]. We are improving protocol automation and also creating material for a larger audience as well.<br>
Line 140: Line 140:
Allow to sort by lefty/righty final parts <br>
Allow to sort by lefty/righty final parts <br>
Antibiotic selection/plating step-file creation  <br>
Antibiotic selection/plating step-file creation  <br>
-
 
-
 
-
==Tutorial==
 
-
[https://2009.igem.org/Team:Berkeley_Software/KeplerTutorial Kepler Tutorial]
 
}}
}}

Revision as of 07:37, 21 October 2009


Automated Assembly and Kepler Integration

Contents

Introduction

Kepler -

Two of the key requirements for introducing automation into the biological design process are reproducibility of specific protocols and formally capturing these protocols. Often these are very complicated, take considerable time to develop and “debug”, and are lab/equipment specific. A highly modular, expressive, and extensible framework to capture and design these workflows would be useful. Our project integrated the Kepler workflow design environment with the existing Clotho platform, in order to formally capture a number of specific design protocols related to composite part assembly.
Kepler is a multi-university design effort focusing on scientific workflows, and is used by a wide variety of projects in different fields. This work is done in conjunction with the [http://chess.eecs.berkeley.edu/ Center for Hybrid & Embedded Software Systems (CHESS)]. We are improving protocol automation and also creating material for a larger audience as well.






Big Picture

A workflow between Clotho and Kepler

Important to Know

Our big picture has been implemented for 2ab assembly protocol that is used in [http://bioeng.berkeley.edu/cv/canderson.php J.Christopher Anderson]'s lab. Besides that we have been working on the alternative assembly protocols (e.g. Golden Gate), parallel sequencing and parts packaging collaborating with [http://www.jbei.org/ Joint BioEnergy Institute]. The latest projects had been started in August and are still under implementation.
At first, automation assembly assignment workflow had been constructed as a plug-in in Clotho Classic, but its conversion to Kepler's workflow allowed for more user-choices and pre-set settings explained precisely here Workflow user options.

Physical Assembly Running Example

As we are going through steps in the workflow, we will show the construction of a family of reporters which consists of four devices:

  1. [http://partsregistry.org/wiki/index.php?title=Part:BBa_I13521 Reporter #1 - BBa_I13521]
  2. [http://partsregistry.org/wiki/index.php?title=Part:BBa_I763007 Reporter #2 - BBa_I763007]
  3. [http://partsregistry.org/wiki/index.php?title=Part:BBa_J5526 Reporter #3 - BBa_J5526]
  4. [http://partsregistry.org/wiki/index.php?title=Part:BBa_J3901 Reporter #4 - BBa_J3901]

Zooming In

1. Start Clotho

Starting Clotho

2. Start Kepler

Starting Kepler

3. Specify devices to assemble

This action is done in Clotho's Algorithm Manager - a tool constructed by Berkeley_Software iGEM team 2008.

Clotho Algorithm Manager with running example.
Reporter #1. View in Spectacles.
Reporter #2. View in Spectacles.
Reporter #3. View in Spectacles.
Reporter #4.View in Spectacles.

Devices are specified in a string format where basic parts are separated by dots to represent the overall goal part. Each goal part is entered on a separate line. This can be done either manually, or imported from a file, or imported from Spectacles.
In our example we can assume that parts were designed in Spectacles and imported into Clotho's Algorithm Manager.
In the Clotho's Algorithm Manager, input parts are converted into the efficient assembly graph which is exported into the Kepler's workflow as Assembly Info. For our example assembly graph can be represented visually as:

Assembly graph for reporter family construction.

4. Launch tool to connect Clotho & Kepler

RMI Tool to connect Clotho to Kepler.

This tool provides the mean to import assembly graph as assembly information (Assembly Info) object into the Kepler environment. Further explanation about the Clotho-Kepler connection can be found on the tutorial page : Clotho-Kepler Connection.

5. Launch Kepler assembly automation assignment workflow

Load the automation workflow file into Kepler, choose the stage number then click the Run icon.

Automation workflow in Kepler.

Further technical explanation about the workflow can be found on the tutorial page: Assembly workflow.

6. Process Info according to stage number

In this part we process assembly information(Assembly Info) according to stage number, reading Assembly Graph in arrays of parts united with the same index. That results in sorted assembly graph:

Processed assembly graph for our running example.


From this part, the modified assembly information is sent to 8 and basic parts (parts in the 1st row without a stage number) are sent to 7.

7. Choose to supply additional Info location

In this step, basic parts (parts in the 1st row without a stage number) are displayed with their assigned vectors, and the user is asked to choose an option that works the best for him/her. Since the algorithm that generates the assembly graph initially assumes parts sharing, only 6 possible combination-choices for vector option in which to put basic parts are available. A person can choose:

  • the flow that was assigned by algorithm and follow further with parts (do pre-selected Kepler option choice which avoids display of this dialog);
  • his/her own vector selection out of 6 available choices which were constructed by computer and proceed with his/her flow;
  • to supply a file with the available parts(which are not yet in database) and let the program make a choice for him/her;
  • the option which requires minimum amount of transfers of basic part from one vector into another based on what is available in the database.

This part is still under implementation.

8. Process Info according to user's Choice

In this step, the assembly information that was modified in 6, is modified according to user choice in 7 updating and locking vectors in which parts will reside through out the device construction project.

9. Select stage number

This part allows the user to select a stage number from available stages. If the user selects a stage number out of range, the program will not proceed, keep asking the user for stage number input.
In the plug-in to Clotho, stage selection is a user's dialog, in Kepler this is a number shown in the workflow. Further explanation about Kepler user options.

10. Single Stage processing

Selection of stage in 9 leads to picking parts from arrays (which were constructed during 6 and modified during 8) that are required for construction of composite parts in this stage as well as composite parts themselves. It is illustrated in a less confusing way in the following picture:
Basic parts and composite parts, constructed out of basic parts, in stage 1 of our running example.

In this part the main processing and file construction occurs. All files have the stage number appended to the end of their name thus they are not overwritten when the new stage is executed.
Once the parts required for this stage are picked, they are sorted depending on whether they are lefty, righty, or represent the final device (refer to 2ab protocol for more explanations) and depending on the type of vector that the parts are in. It becomes important for arrangement of the final parts of each stage for further user processing. Then plates are created:

  • stock plate - plate with minipreps
  • bigStock plate - enzyme plate with antibiotics, digestion mix, ligation mix and buffer
  • dilution plate - plate with diluted minipreps
  • rxnPlate - plate with 2 diluted mini-preps mixed together, where digestion mix, and then ligase mix are added
  • platting plates - the plates where resultant parts are plated with antibiotics

About created files:

  • by default all newly-created files are stored in the projects folder in the same folder where Clotho lives
  • dilutionFile(stage#).csv - contains commands for the robot to transfer mini-preps for dilution (it is assumed that buffer pippetting is done by multi-channel); (file with similar name dilution4Jenn(stage#) contains user-friendly version of the above file for ease of checking the correctness of the produced instructions).
  • reationFile(stage#).csv - contains commands for robot; built according to user 2ab protocol inquiry;(file reaction4Jenn(stage#).csv is a user-friendly version for the correctness check).
  • platting(stage#).csv - contains instructions for robot about antibiotic transfer for selection process based on that reactants will be transferred one to one from the reaction plate by multi-channel pippette.
  • userInstructions(stage#) - file contains instructions about what the user has to have in a plates, what decks the user has to put plates on, and what will be the outcome of following those instructions.

Then assignment of wells proceeds. Parts used for construction are assigned to stock plate(s) and then to dilution plate, and then their final products are assigned to reaction plate depending on the sorted order. Then the volume check is performed and if a single part is used repeatedly, its quantity is reduced to one well or to the necessary number of wells in the dilution procedure (to achieve the necessary volume of diluted part prior to reaction). Also at this stage a user can specify the stock plates that he wants the program to use. The assignment of wells in stock plates and their path to dilution plate will be modified. Going further, the dilution plate is assumed to be pre-filled with dilution buffer using a multi-pipetteman on robot. Once well assignment is completed, each plate in dilution step is assigned to an available deck on the robot, these assignments are recorded into the text file with user instructions, and a .csv file with cherry-picking commands for robot is produced. Then the robot decks are freed from the plates that participated in dilution and available decks are assigned to plates that participate in reaction procedure. Another .csv reaction file with commands for robot is constructed. The addition of the digestion mix and ligation mix is also recorded as cherry-picking commands for robot in that file. After this step, the deck assignment is recorded into the user instructions file, together with the amount of buffer required for dilution, amount of digestion and ligation mixes required for reaction to occur. After that the assignments of wells, where the composite parts for this stage will reside, are also recorded.
Robot decks are freed one more time. Another array of plates for platting the resultants with antibiotics (selection of successful parts) is created. Resultant parts are assigned to the platting plates. The plates are assigned to available decks on the robot and another .csv file with commands for robot to perform plating with antibiotics is created.
Information about decks and final parts location is recorded into the file with user instructions. The program notifies the user that it has completed stage that was requested.
The most important part on the theory behind this part of workflow is illustrated in the animation below:

11. Robot

Once the workflow is completed, the user can organize produced .csv Files to input to the robot, as well as open the human instruction file for a certain stage and prepare the plates and their layout according to instructions.

More on automation assembly assignment workflow

The file with constants can be used to modify the maximum volume that the user wants for a single well in his plate to hold in dilution, reaction plates, transfer volumes, etc.
The good part about algorithm that user can generate files for robot starting from any stage at any time as long as he has the initial parts from which he started; or he can generate files for all stages of the ongoing project in a default folder and then rename that folder to prevent files from being overwritten and start working on another assembly project.

Assigning plates by rows or by columns can be changed right now by physically going inside of the plugin and setting fillThePlateByRow parameter when the plate is initialized. The size of the plates are adjustible and can be anything specified as maxR (maximum number of rows) and maxC (maximum number of collumns) when the plate is initialized. In the workflow currently 8X12 and 2X12 plates are used.
Allow to sort by lefty/righty final parts
Antibiotic selection/plating step-file creation