Seqanswers Leaderboard Ad

Collapse

Announcement

Collapse
No announcement yet.
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • SQL vs NoSQL databases for next-gen data?

    I am interested in people's best practices in using a database to store sequencing data.

    I perform lots of immune sequencing, and each one of my reads gets highly annotated. Early on, when I would want to compute something, I used to iterated through an entire flatfile, building some data structure in python (typically dictionaries of dictionaries). Then I realized that I am doing exactly what databases were designed for, including searching, grouping, etc.

    So I elected to try MongoDB, which is a noSQL database. It was easy to use, as you can just dump JSON objects into it, which was a very natural conversion from python. So far, the performance has been very fast, and I am quite pleased.

    But I am now preparing to generate a large amount of additional data, and was wondering whether it would make sense to try out a traditional SQL database, like MySQL or Postgres. Any thoughts as to how they all compare for sequencing data? How do people typically organize their data in a relational database?

    Thanks!
    Uri

  • #2
    Maybe you should try an ORM(Object Relational Mapper) that mixes the features of Object and relational database. I strongly recommend sqlalchemy, which is written in python and has clear documents and examples.

    Comment

    Latest Articles

    Collapse

    • seqadmin
      Recent Advances in Sequencing Analysis Tools
      by seqadmin


      The sequencing world is rapidly changing due to declining costs, enhanced accuracies, and the advent of newer, cutting-edge instruments. Equally important to these developments are improvements in sequencing analysis, a process that converts vast amounts of raw data into a comprehensible and meaningful form. This complex task requires expertise and the right analysis tools. In this article, we highlight the progress and innovation in sequencing analysis by reviewing several of the...
      05-06-2024, 07:48 AM
    • seqadmin
      Essential Discoveries and Tools in Epitranscriptomics
      by seqadmin




      The field of epigenetics has traditionally concentrated more on DNA and how changes like methylation and phosphorylation of histones impact gene expression and regulation. However, our increased understanding of RNA modifications and their importance in cellular processes has led to a rise in epitranscriptomics research. “Epitranscriptomics brings together the concepts of epigenetics and gene expression,” explained Adrien Leger, PhD, Principal Research Scientist...
      04-22-2024, 07:01 AM

    ad_right_rmr

    Collapse

    News

    Collapse

    Topics Statistics Last Post
    Started by seqadmin, 05-07-2024, 06:57 AM
    0 responses
    12 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 05-06-2024, 07:17 AM
    0 responses
    16 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 05-02-2024, 08:06 AM
    0 responses
    22 views
    0 likes
    Last Post seqadmin  
    Started by seqadmin, 04-30-2024, 12:17 PM
    0 responses
    24 views
    0 likes
    Last Post seqadmin  
    Working...
    X