RAREMETAL is a program that facilitates the meta-analysis of rare variants from genotype arrays or sequencing.
Allocate an interactive session and run the program.
Sample session (user input in bold):
[user@biowulf ~]$ sinteractive --cpus-per-task=4 --mem=8G --gres=lscratch:10 salloc.exe: Pending job allocation 42848391 salloc.exe: job 42848391 queued and waiting for resources salloc.exe: job 42848391 has been allocated resources salloc.exe: Granted job allocation 42848391 salloc.exe: Waiting for resource configuration salloc.exe: Nodes cn3101 are ready for job srun: error: x11: no local DISPLAY defined, skipping [user@cn3101 ~]$ cd /lscratch/$SLURM_JOB_ID [user@cn3101 42848391]$ cp -r /fdb/raremetal/4.15.1/raremetal_tutorial . [user@cn3101 42848391]$ cd raremetal_tutorial/ [user@cn3101 raremetal_tutorial]$ module load raremetal samtools [+] Loading raremetal 4.15.1 on cn3101 [+] Loading singularity 3.4.2 on cn3101 [+] Loading samtools 1.9 ... [user@cn3101 raremetal_tutorial]$ raremetalworker --ped example1.ped --dat example1.dat --vcf example1.vcf.gz \ --traitName QT1 --inverseNormal --makeResiduals --kinSave --kinGeno \ --prefix STUDY1 RAREMETALWORKER 4.15.1 -- A Forerunner of RareMetal (c) 2012-2016 Shuang Feng, Dajiang Liu, Sai Chen, Goncalo Abecasis [...snip...] [user@cn3101 raremetal_tutorial]$ raremetalworker --ped example2.ped --dat example2.dat --vcf example2.vcf.gz \ --traitName QT1 --inverseNormal --makeResiduals --kinSave --kinGeno \ --prefix STUDY2 RAREMETALWORKER 4.15.1 -- A Forerunner of RareMetal (c) 2012-2016 Shuang Feng, Dajiang Liu, Sai Chen, Goncalo Abecass [...snip...] [user@cn3101 raremetal_tutorial]$ bgzip STUDY1.QT1.singlevar.score.txt [user@cn3101 raremetal_tutorial]$ tabix -c "#" -s 1 -b 2 -e 2 STUDY1.QT1.singlevar.score.txt.gz [user@cn3101 raremetal_tutorial]$ bgzip STUDY1.QT1.singlevar.cov.txt [user@cn3101 raremetal_tutorial]$ tabix -c "#" -s 1 -b 2 -e 2 STUDY1.QT1.singlevar.cov.txt.gz [user@cn3101 raremetal_tutorial]$ bgzip STUDY2.QT1.singlevar.score.txt [user@cn3101 raremetal_tutorial]$ tabix -c "#" -s 1 -b 2 -e 2 STUDY2.QT1.singlevar.score.txt.gz [user@cn3101 raremetal_tutorial]$ bgzip STUDY2.QT1.singlevar.cov.txt [user@cn3101 raremetal_tutorial]$ tabix -c "#" -s 1 -b 2 -e 2 STUDY2.QT1.singlevar.cov.txt.gz [user@cn3101 raremetal_tutorial]$ cat >summaryfiles<<"EOF" STUDY1.QT1.singlevar.score.txt.gz STUDY2.QT1.singlevar.score.txt.gz EOF [user@cn3101 raremetal_tutorial]$ cat >covfiles<<"EOF" STUDY1.QT1.singlevar.cov.txt.gz STUDY2.QT1.singlevar.cov.txt.gz EOF [user@cn3101 raremetal_tutorial]$ raremetal --summaryFiles summaryfiles --covFiles covfiles \ --groupFile group.file --SKAT --burden --MB --VT --longOutput \ --tabulateHits --hitsCutoff 1e-05 --prefix COMBINED.QT1 --hwe 1.0e-05 \ --callRate 0.95 - RAREMETAL 4.15.1 -- A Tool for Rare Variants Meta-Analyses for Quantitative Traits (c) 2012-2017 Shuang Feng, Dajiang Liu, Sai Chen, Goncalo Abecasis [...snip...] [user@cn3101 raremetal_tutorial]$ ls COMBINED.QT1.meta.burden.results example2.vcf.gz COMBINED.QT1.meta.MB.results example2.vcf.gz.tbi COMBINED.QT1.meta.plots.pdf group.file COMBINED.QT1.meta.singlevar.results STUDY1.Empirical.Kinship.gz COMBINED.QT1.meta.SKAT_.results STUDY1.QT1.additive.plots.pdf COMBINED.QT1.meta.tophits.burden.tbl STUDY1.QT1.singlevar.cov.txt.gz COMBINED.QT1.meta.tophits.MB.tbl STUDY1.QT1.singlevar.cov.txt.gz.tbi COMBINED.QT1.meta.tophits.SKAT.tbl STUDY1.QT1.singlevar.score.txt.gz COMBINED.QT1.meta.tophits.VT.tbl STUDY1.QT1.singlevar.score.txt.gz.tbi COMBINED.QT1.meta.VT_.results STUDY1.singlevar.log COMBINED.QT1.raremetal.log STUDY2.Empirical.Kinship.gz command_to_use STUDY2.QT1.additive.plots.pdf covfiles STUDY2.QT1.singlevar.cov.txt.gz example1.dat STUDY2.QT1.singlevar.cov.txt.gz.tbi example1.ped STUDY2.QT1.singlevar.score.txt.gz example1.vcf.gz STUDY2.QT1.singlevar.score.txt.gz.tbi example1.vcf.gz.tbi STUDY2.singlevar.log example2.dat summaryfiles example2.ped [user@cn3101 raremetal_tutorial]$ exit exit salloc.exe: Relinquishing job allocation 42848391 [user@biowulf ~]$
Create a batch input file (e.g. raremetal.sh). For example:
#!/bin/bash set -e module load raremetal raremetal --summaryFiles summaryfiles --covFiles covfiles \ --groupFile group.file --SKAT --burden --MB --VT --longOutput \ --tabulateHits --hitsCutoff 1e-05 --prefix COMBINED.QT1 --hwe 1.0e-05 \ --callRate 0.95 -
Submit this job using the Slurm sbatch command.
sbatch [--cpus-per-task=#] [--mem=#] raremetal.sh
Create a swarmfile (e.g. raremetal.swarm). For example:
raremetal --summaryFiles summaryfiles --covFiles covfiles \ --groupFile group.file --SKAT --burden --MB --VT --longOutput \ --tabulateHits --hitsCutoff 1e-05 --prefix COMBINED.QT1 --hwe 1.0e-05 \ --callRate 0.95 - raremetal --summaryFiles summaryfiles --covFiles covfiles \ --groupFile group.file --SKAT --burden --MB --VT --longOutput \ --tabulateHits --hitsCutoff 1e-05 --prefix COMBINED.QT2 --hwe 1.0e-05 \ --callRate 0.95 - raremetal --summaryFiles summaryfiles --covFiles covfiles \ --groupFile group.file --SKAT --burden --MB --VT --longOutput \ --tabulateHits --hitsCutoff 1e-05 --prefix COMBINED.QT3 --hwe 1.0e-05 \ --callRate 0.95 -
Submit this job using the swarm command.
swarm -f raremetal.swarm [-g #] [-t #] --module raremetalwhere
-g # | Number of Gigabytes of memory required for each process (1 line in the swarm command file) |
-t # | Number of threads/CPUs required for each process (1 line in the swarm command file). |
--module raremetal | Loads the RAREMETAL module for each subjob in the swarm |