Unconfigured Ad

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Gus
    Member
    • Dec 2009
    • 29

    #1

    Streamlined tophat/bowtie python pipeline

    Hello everyone,

    I am not sure if this is the correct place for this but I welcome this thread being moved if there is a better place.

    I have developed a streamlined tophat/cufflinks pipeline that can run all steps for multiple sample groups/experiments with a single command if so desired. Log files record settings and output messages for easy tracking and methods writing months after you actually ran your data through the pipe. Email notifications are available and a single stage failure does not cause the whole run to fail.

    It has a feature for running these analyses in a an SGE administered cluster environment as well.

    I have not encoded ALL options from every program yet but welcome fellow programmers adding options/features that they use/need and pushing their changes to github for inclusion in the next release.

    The project is quite functional for me but it is still considered below a v1.0 release at the present moment.

    I have written the docs using sphinx and they are hosted on github as well.

    I have tried to make the code as 'self documenting' as possible with liberal use of docstrings as well.

    My main point in posting this here is to get feed back and attract collaboration on developing 'blacktie' to the point that people with a minimal command line comfort level will feel confident using these valuable tools. There may be other pipelines out there in the wild but I did not find any that were marketed past a single lab's needs.

    Please try it out and give me feed back or feature requests if you feel the call.


    Links:
    github project repo: https://github.com/xguse/blacktie
    docs: http://xguse.github.com/blacktie/

    for up to the hour builds pull from the 'develop' branch


    blacktie is also listed on the PyPI so v0.1-dev is install-able via:
    Code:
    $ [sudo] pip install blacktie
    Thank you for your time and help,

    Gus
    Last edited by Gus; 03-21-2013, 12:18 PM. Reason: Title had typo in it...
    In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
    --Stephen Jay Gould
  • Gus
    Member
    • Dec 2009
    • 29

    #2
    Bumped version to 0.1.1

    Hi everyone. I just bumped the PyPI version to 0.1.1 after adding some option checking and making sure that the CufflinksCall objects properly dealt with --GTF vs --GTF-guide options.

    I also updated the docs.

    If you installed via pip you should:
    Code:
    $ [sudo] pip install -U blacktie

    Gus
    In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
    --Stephen Jay Gould

    Comment

    • Gus
      Member
      • Dec 2009
      • 29

      #3
      I have released a new version of blacktie (0.2.0rc1) which has a number of minor fixes and new features.

      A major gotcha will be that the yaml config file has been changed slightly to facilitate the inclusion of biological replicate data. So please take a look at the demo config file in the docs posted at: http://xguse.github.io/blacktie/tuto...iguration-file

      Thanks and please let me know what you think. I need your input to make improvements.

      Gus

      Code:
      News
      ====
      
      0.2.0rc1
      --------
      
      *Release date: 2013-04-19*
      
      * git tag: 'v0.2.0rc1'
      * email_notification is now adjustable for other email servers
      * Added support for handling biological replicates in cuffdiff runs.
      * Major changes to yaml config:
          * condition_queue[index].group_id --> condition_queue[index].experiment_id
          * addition of condition_queue[index].replicate_id to track replicate data
          * condition_queue[index].name now represents description of an 'experimental condition' and will be shared by replicates.
      Last edited by Gus; 04-19-2013, 02:25 PM. Reason: formatting issues in the news
      In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
      --Stephen Jay Gould

      Comment

      • Gus
        Member
        • Dec 2009
        • 29

        #4
        This is an update.

        I have cummerbund working inside of rpy2 and expect a new release containing automation of the basic functionality of cummerbund very soon.

        Gus
        In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
        --Stephen Jay Gould

        Comment

        • Gus
          Member
          • Dec 2009
          • 29

          #5
          I have a new blacktie release that now integrates automated cummeRbund plots.

          Blacktie v0.2.1 with screenshots!
          In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
          --Stephen Jay Gould

          Comment

          • Gus
            Member
            • Dec 2009
            • 29

            #6
            BUGFIX release: 0.2.1.2

            0.2.1.2
            -----------
            *Release date: 2013-07-17*

            * version number system adopted to conform to PEP386
            * This is a hot fix to squash a bug described in github issue: https://github.com/xguse/blacktie/issues/10
            * **in short:** on a Mac ``pprocess`` complained "AttributeError: 'module' object has no attribute 'poll'" when trying to set up a queue.
            * the quick fix is to look for that exception and continue without ``pprocess`` if encountered to avoid the fatal exception.

            Attention:
            - It is recommended that all users update to 0.2.1.2 to avoid this issue.
            - Anyone with knowledge of this issue is encouraged to comment on the `issues thread <https://github.com/xguse/blacktie/issues/10>`_ above or in the Comments section below.
            Last edited by Gus; 07-19-2013, 02:13 PM. Reason: Forgot attention part
            In science, "fact" can only mean "confirmed to such a degree that it would be perverse to withhold provisional assent." I suppose that apples might start to rise tomorrow, but the possibility does not merit equal time in physics classrooms.
            --Stephen Jay Gould

            Comment

            Latest Articles

            Collapse

            • SEQadmin2
              New Genomics Technologies Take Aim at Long-Standing Limits
              by SEQadmin2


              Researchers using sequencing and genomics tools often have to make trade-offs. They can choose between speed or scale, short reads or long-range information, or targeted panels or a view of the whole transcriptome. New technologies that have been released this year are built to address those tough choices.

              We asked six companies the same four questions to learn about their latest products. The new technologies bring a lot to the table, including rethinking sequencing
              ...
              Yesterday, 10:25 AM
            • SEQadmin2
              How Immunogenomics Decodes Immunity’s Genetic Blueprint
              by SEQadmin2




              The immune system’s power comes from its genetic diversity, allowing myriad threats to be neutralized through first recognizing foreign antigens. That diversity is also what makes the immune system so difficult to study. Recent advances in sequencing technology and computational biology, however, are giving researchers new tools to understand immune responses and immune-related diseases in greater detail.

              This convergence of genetics, immunology, and computation...
              09-01-2026, 05:41 AM

            ad_right_rmr

            Collapse

            News

            Collapse

            Topics Statistics Last Post
            Started by SEQadmin2, 09-25-2026, 09:06 AM
            0 responses
            28 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 09-23-2026, 11:05 AM
            0 responses
            24 views
            0 reactions
            Last Post SEQadmin2  
            Started by SEQadmin2, 09-18-2026, 11:37 AM
            1 response
            46 views
            0 reactions
            Last Post pekgio
            by pekgio
             
            Started by SEQadmin2, 09-16-2026, 10:23 AM
            1 response
            55 views
            0 reactions
            Last Post pekgio
            by pekgio
             
            Working...