Ep 38: Workflow Infrastructure

Also available on YouTube: https://youtu.be/i9oT5ku11is Summary In this episode, Kevin and Andrew discuss different mechanisms to run and support bioinformatics pipelines. They explore the use of workflows, workflow managers, and graphic user interfaces for pipeline execution. They highlight popular workflow options such as Nextflow, Terra, and Galaxy, and discuss the benefits of using standardized workflow languages. They also emphasize the importance of scalability and the drawbacks of creating in-house pipeline systems. The conversation concludes with a discussion on the differences in data models and administrative overhead among the different workflow options. Takeaways Understanding workflows is a fundamental skill in bioinformatics. Popular workflow options include Nextflow, Terra, and Galaxy. Standardized workflow languages help standardize development and execution. Using out-of-the-box solutions reduces the need for creating in-house pipeline systems. Consider the data model and administrative overhead when choosing a workflow option.