May the source be with you, but remember the KISS principle ;-)
Home Switchboard Unix Administration Red Hat TCP/IP Networks Neoliberalism Toxic Managers
(slightly skeptical) Educational society promoting "Back to basics" movement against IT overcomplexity and  bastardization of classic Unix

Specifying Ethernet Interface Instead of Infiniband


High Performance Computing (HPC)

Recommended Links

mpirun command

Running MPI jobs

Testing openMPI environment on SGE FAQ Running jobs under SGE
InfiniBand Tuning the run-time characteristics of Infiniband communications MCA Parameters Specifying ethernet interface instead of infiniband Installing Mellanox InfiniBand Driver on RHEL 6.5 SGE Parallel Environment VASP Performance optimization
Troubleshooting ulimit - locked memory limit   HPC cluster Architecture  Admin Horror Stories Humor Etc

FAQ Tuning the run-time characteristics of MPI sm communications

2. How do I specify use of sm for MPI messages? 

Typically, it is unnecessary to do so; OMPI will use the best BTL available for each communication.

Nevertheless, you may use the MCA parameter btl. You should also specify the self BTL for communications between a process and itself. Further, if not all processes in your job will run on the same, single node, then you also need to specify a BTL for internode communications. For example:

shell$ mpirun --mca btl self,sm,tcp -np 16 ./a.out