galaxy tools and samtools error

[doc.ramses]

Hi,

on a local installation of the latest "galaxy-tools" I mapped with "Bowtie for Illumina" and also performed "Filter SAM". It both worked well for the 22GB big fow and rev pe reads. When running "SAM-to-BAM" on the resulting 54GB file, I get the following error message:

An error occurred running this job: Samtools Version: 0.1.12a (r862)
python(4996,0x7fff70df9ca0) malloc: *** mmap(size=140735421464576) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
Error extracting alignments from

I assume it has something to do with the memory. Although I can't believe that this is a size problem, as I'm doing this on the latest 12core macpro with 16GB-RAM.

Another issue that I have in galaxy-tools is that I'm not able to save the filtered file (app. 50GB).

Thank you for your help!

[maubp]

Originally Posted by doc.ramses

When running "SAM-to-BAM" on the resulting 54GB file, I get the following error message:

An error occurred running this job: Samtools Version: 0.1.12a (r862)
python(4996,0x7fff70df9ca0) malloc: *** mmap(size=140735421464576) failed (error code=12)
*** error: can't allocate region
*** set a breakpoint in malloc_error_break to debug
Error extracting alignments from

I assume it has something to do with the memory. Although I can't believe that this is a size problem, as I'm doing this on the latest 12core macpro with 16GB-RAM.

I'm fairly sure that size in in bytes... and 140735421464576 bytes = 137436935024 KB = 134215756 MB = 131070 GB = 127 PB
(using 1024 rather than 1000 for pedants)

Which is lot more than 16GB which explains why malloc fails to allocate enough memory, but on the other hand 127 PB is so big that perhaps something had gone wrong before that?