Code Details ... Where do you think the problem is ? Can you help ?

Posted By

Posted 6 years ago by :

Code Analytics

Coders Engaged
Number of Solutions Posted
Code's Engagement Score


Add Your Solution

Can you help with this code ? hit the button above and add your contribution. See next page for more instructions

Code Details

Next Generation Sequencing

Code Title

How to create a Bioinformatics pipeline using Spotify !

Code Description

A lot of big streaming companies like Spotify, Pandora, etc are more and more pushing towards a better and more stable frameworks and the best thing to do that is to go open source and get useful feedbacks and keep working on making the platform better.

Spotify developed a platform called Luigi, a python framework to handle users logs, and mine them intuitively by plugging several machine learning algorithms to improve their recommendation systems and their suggestions to clients.

Luigi works almost like any make-like python framework for pipeline development, like Ruffus or  Snakemake etc.., but it has a plus over these solutions, it is designed to create Hadoop friendly pipelines and also comes with a visual diagnostic of each part of your pipeline while it is running. Another feature I like is that it notifies you via email when a task fails.

Here is a simple adaptation of Luigi for Bioinformatics. This pipeline :

  • takes a fastq samples list, align them via bwa_mem 
  • Convert Sam files to Bam files
  • Sort the bam files
  • Index them
  • Call variants using samtools mpileup
  • Convert bcf to vcf
Enjoy !


The pipeline tasks

The pipeline status

Source Code

Rate this Code / Problem

Rating will help to get users interact more with each others. Hit the vote button below to see how well this code is rated !
Error Description:
Code Size (with regards to the task):

Suggested Solutions

No Solutions Posted Yet .. Be The First To Make Someone's Day Awesome

Click Here To Add Your Solution

The Bla-Bla-Board : Let's Chat about this code

If you want to embed code in your comment here, please use these tags :
def HelloCrowd( str ):
   "This is a function to welcome CodersCrowd members"
   print str
HelloCrowd("We Love Bioinformatics")
comments powered by Disqus