BlueGene
Contents
IBM Blue Gene/(L,P)
A collection of information on how to use TAU with IBM Blue Gene/L systems.
Building PDT
Configure and build PDT:
./configure -XLC make clean install
Building TAU for the back-end
for IBM BG/P
./configure -arch=bgp -mpi -pdt=<dir> -pdt_c++=xlC make clean install
for IBM BG/L
./configure -arch=bgl -mpi -pdt=<dir> -pdt_c++=xlC make clean install
Building front-end tools
The binaries in <taudir>/bgl/bin are not usable on the front-end, to build tools for the front-end, use:
./configure make clean install
This will build and install tools (such as Paraprof, pprof) in the <taudir>/ppc64/bin directory.
Fast BGL Timers
BlueGene systems have a special clock cycle counter that can be used for low overhead timings, to use it with TAU configure with
-BGLTIMERS
A Sample Session
Following is a set of commands and their output which should work on most BlueGene systems
# aqcuire sources wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz # build PDT tar -xzf pdt_latest.tar.gz cd pdtoolkit-3.10 ./configure make install cd .. # build front-end tar -xzf tau_latest.tar.gz cd tau-* ./configure make clean install # build back-end ./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++ make clean install # build and run example auto-instrumented MPI fortran 90 application cd examples/pdt_mpi/f90 make cqsub -t5 -n4 ./ring # after job completes, view simple report ../../../ppc64/bin/pprof
Typescript Output:
% # aqcuire sources
% wget http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
--23:27:54-- http://www.cs.uoregon.edu/research/paracomp/proj/pdtoolkit/Download/pdt_latest.tar.gz
=> `pdt_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 110,312,097 [application/x-tar]
100%[=====================================================================================================>] 110,312,097 400.94K/s ETA 00:00
23:32:25 (397.35 KB/s) - `pdt_latest.tar.gz' saved [110312097/110312097]
% wget http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
--23:32:25-- http://www.cs.uoregon.edu/research/paracomp/tau/tauprofile/dist/tau_latest.tar.gz
=> `tau_latest.tar.gz'
Resolving www.cs.uoregon.edu... 128.223.4.25
Connecting to www.cs.uoregon.edu[128.223.4.25]:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 15,381,525 [application/x-tar]
100%[=====================================================================================================>] 15,381,525 398.22K/s ETA 00:00
23:33:03 (395.82 KB/s) - `tau_latest.tar.gz' saved [15381525/15381525]
%
% # build PDT
% tar -xzf pdt_latest.tar.gz
% cd pdtoolkit-3.10
% ./configure
Program Database Toolkit (PDT) Configuration
--------------------------------------------
Looks like a Linux machine ...
Looking for C++ compilers .. done
Unpacking ppc64/bin ...
Unpacking ppc64/bin/gfortran ...
==> ARCH is PPCLINUX
==> PLATFORM is ppc64
==> Using /usr/bin/g++
==> Default compiler options are -O2
==> Makefiles were configured
==> cparse was configured
==> cxxparse was configured
==> f90parse was configured
==> f95parse was configured
==> gfparse was configured
Configuration is complete!
Run "make" and "make install"
Add "/home/amorris/wiki/pdtoolkit-3.10/ppc64//bin" to your path
% make install
(cd ductape; make "MAKE=make" all)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd lib; make "MAKE=make" all CXX="g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE " CXXAR="ar cr " RANLIB="echo Built libpdb.a" PRELINK="echo Building libpdb.a" EXTRAOBJS="")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbRead.cc
true pdbRead.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbMisc.cc
true pdbMisc.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbItem.cc
true pdbItem.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbGroup.cc
true pdbGroup.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbClass.cc
true pdbClass.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbModule.cc
true pdbModule.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbRoutine.cc
true pdbRoutine.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbCRoutine.cc
true pdbCRoutine.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbFRoutine.cc
true pdbFRoutine.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbTemplate.cc
true pdbTemplate.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbGroupField.cc
true pdbGroupField.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbWrite.cc
true pdbWrite.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbMacro.cc
true pdbMacro.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbNamespace.cc
true pdbNamespace.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbType.cc
true pdbType.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbFile.cc
true pdbFile.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbSimpleItem.cc
true pdbSimpleItem.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbTemplateItem.cc
true pdbTemplateItem.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbFatItem.cc
true pdbFatItem.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbTemplateArg.cc
true pdbTemplateArg.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbPragma.cc
true pdbPragma.cc
echo Building libpdb.a
Building libpdb.a
ar cr libpdb.a pdbRead.o pdbMisc.o pdbItem.o pdbGroup.o pdbClass.o pdbModule.o pdbRoutine.o pdbCRoutine.o pdbFRoutine.o pdbTemplate.o pdbGroupField.o pdbWrite.o pdbMacro.o pdbNamespace.o pdbType.o pdbFile.o pdbSimpleItem.o pdbTemplateItem.o pdbFatItem.o pdbTemplateArg.o pdbPragma.o
echo Built libpdb.a
Built libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/lib'
(cd src; make "MAKE=make" all CXX="g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE ")
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbconv.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbconv.o -o pdbconv ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbtree.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbtree.o -o pdbtree ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbmerge.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbmerge.o -o pdbmerge ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbcomment.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbcomment.o -o pdbcomment ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbstmt.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbstmt.o -o pdbstmt ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c xmlgen.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc xmlgen.o -o xmlgen ../lib/libpdb.a
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc -c pdbhtml.cc
g++ -O2 -w -Wall -ansi -D_XOPEN_SOURCE -I../inc pdbhtml.o -o pdbhtml ../lib/libpdb.a
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
/bin/rm -f /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib/libpdb.a
(cd ductape; make "MAKE=make" install)
make[1]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
(cd src; make "MAKE=make" install)
make[2]: Entering directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
cp pdbconv pdbtree pdbmerge pdbcomment pdbstmt xmlgen pdbhtml /home/amorris/wiki/pdtoolkit-3.10/ppc64//bin
make[2]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape/src'
make[1]: Leaving directory `/home/amorris/wiki/pdtoolkit-3.10/ductape'
cp ./ductape/lib/libpdb.a /home/amorris/wiki/pdtoolkit-3.10/ppc64//lib
echo "*****DONE*****"
*****DONE*****
% cd ..
%
% # build front-end
% tar -xzf tau_latest.tar.gz
% cd tau-*
% ./configure
-------------------- TAU configure script ---------------
The TAU source code has just been configured to use the
tau root directory /home/amorris/wiki/tau-2.16.1.
If you move the Tau distribution, you must either
* set an environment variable TAUROOT containing the new
location before running any TAU tools
or
* run configure again and recompile
-----------------------------------------------------------------
Attempting to auto-configure system, determining architecture...
I think this is a ppc64...
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Default C++ compiler will be g++ version 3.3.3 (SuSE Linux)
Default C compiler will be gcc version 3.3.3 (SuSE Linux)
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Supporting GNU RTTI options
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Using GNU lib dir as /usr/lib/gcc-lib/powerpc-suse-linux/3.3.3/
Found an IBM PPC-64 Linux configuration definition
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/ppc64/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/ppc64/lib
TAU: installing tools in /home/amorris/wiki/tau-2.16.1/ppc64/bin
NOTE: *** IBM pSeries Linux environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: GNU g++ options used
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................
Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf......
Configuration complete!
Please add /home/amorris/wiki/tau-2.16.1/ppc64/bin to your path
Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
Determining Configuration...
System previously configured as a ppc64
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c pprof.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c function_data.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c user_event_data.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_reduce.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c pprof_elem.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_merge.c
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_events.cpp
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/ppc64/bin
g++ -I../include -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/ppc64/bin
if [ -d /home/amorris/wiki/tau-2.16.1/ppc64/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/ppc64/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/ppc64/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c Profiler.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TulipTimers.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c UserEvent.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c FunctionInfo.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c RtsLayer.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c RtsThread.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauCAPI.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauFAPI.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauMapping.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauHooks.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauHandler.cpp
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauMemory.cpp
ar rcv libtau-gnu.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built" libtau-gnu.a
Built libtau-gnu.a
Installing libtau-gnu.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libtau-gnu.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/ppc64/lib/Makefile.tau-gnu
g++ -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_GNU -DTAU_DOT_H_LESS_HEADERS -fPIC -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauDisable.cpp
ar rcv libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built" libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/ppc64/lib
g++ -shared -o libTAUsh-gnu.so Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
Installing libTAUsh-gnu.so in /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/cp libTAUsh-gnu.so /home/amorris/wiki/tau-2.16.1/ppc64/lib
/bin/rm -rf /home/amorris/wiki/tau-2.16.1/ppc64/lib/libTAU.so
cd /home/amorris/wiki/tau-2.16.1/ppc64/lib && ln -s libTAUsh-gnu.so libTAU.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
%
% # build back-end
% ./configure -arch=bgl -mpi -pdt=`pwd`/../pdtoolkit-3.10 -pdt_c++=g++
-------------------- TAU configure script ---------------
The TAU source code has just been configured to use the
tau root directory /home/amorris/wiki/tau-2.16.1.
If you move the Tau distribution, you must either
* set an environment variable TAUROOT containing the new
location before running any TAU tools
or
* run configure again and recompile
-----------------------------------------------------------------
WARNING!! Auto-detect:ppc64 overridden with bgl
-PROFILE and/or -TRACE should be specified. Choosing -PROFILE as the default
Default C++ compiler will be IBMs xlC C++ compiler
which: no xlf90 in (/home/amorris/tau2/ppc64/bin:/opt/ibmll/LoadL/full/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/bgl/BlueLight/ppcfloor/bglsys/bin:/usr/local/bin:/usr/bin:/usr/X11R6/bin:/bin:/usr/games:/opt/gnome/bin:/opt/kde3/bin:/usr/lib/java/bin)
Not using the thread-safe version of the IBM compiler
Thread-safe MPI interface is defined...
MPI-2 Interface is defined...
MPI-2 Grequest Interface is defined...
MPI-2 MPI_Datarep_conversion_function Interface is defined...
MPI-2 Comm_create_errhandler Interface is defined...
MPI-2 MPI*attr_functions are defined...
MPI-2 MPI_Type_dup and MPI_Exscan are defined...
MPI-2 MPI_Add_error* functions are defined...
MPI_Status f2c/c2f found...
NOTE: MPI library does not have a threaded _r suffix
Default C compiler will be blrts_xlc
Checking if open takes O_LARGEFILE... yes
C++ compiler supports Std Runtime Type Information (default)
Testing for Standard C++ Library support for string class
Found support for Standard C++ Library string
NOTE: Compiling Profiling Library and Applications with -DTAU_STDCXXLIB
***********************************************************************
Found an IBM PPC-64 BGL Linux configuration definition
PDT supports Fortran Loop Level information
TAU: installing TAU's ParaProf profile browser
jdk version 1.4 or better found
TAU: installed paraprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed ParaProf, PerfDMF, PerfExplorer and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
TAU: installed tau_compiler.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_load.sh in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed TAU's Java trace writer api tf_writer.jar
TAU: installing TAU's PerfDMF database utilities in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed tau_analyze in /home/amorris/wiki/tau-2.16.1/bgl/bin
TAU: installed Makefile.inc in /home/amorris/wiki/tau-2.16.1/tools/src/TauIL
TAU: installed TauIL and supporting jars in /home/amorris/wiki/tau-2.16.1/bgl/lib
TAU: installing tools in /home/amorris/wiki/tau-2.16.1/bgl/bin
NOTE: *** IBM BlueGene/L development environment found. ***
NOTE: Enabled Profiling. Compiling with -DPROFILING_ON
NOTE: Using the IBM xlC C++ compiler
NOTE: IBM xlf90 compiler specific options used
NOTE: Using the TAU MPI Profiling Interface
NOTE: Using the TAU MPI_Init_thread Profiling Interface Wrapper
NOTE: Using TAU's MPI-2 extensions
NOTE: Using TAU's MPI-2 Grequest extensions
NOTE: Using TAU's MPI-2 Datarep_conversion extensions
NOTE: Using TAU's MPI-2 Error handler extensions
NOTE: Using TAU's MPI-2 Attr extensions
NOTE: Using TAU's MPI-2 Type and Exscan extensions
NOTE: Using TAU's MPI-2 Add_error extensions
NOTE: Using default cc compiler.
NOTE: Using the O_LARGEFILE flag to open
NOTE: Using Standard C++ Library
NOTE: Using PDT for TAU Source Code Instrumentation ***
NOTE: Using a different compiler for tau_instrumentor
Script to modify Makefiles created.
Applying script to all Makefiles, please wait, this may take a while...
...................................................................................................................
Configuring TAU Build scripts...
Modifying Makefiles in the examples subdirectory...
Platform does not support JOGL, no 3d displays will be available in ParaProf..................
Configuration complete!
Please add /home/amorris/wiki/tau-2.16.1/bgl/bin to your path
Type "make install" to begin compilation
% make clean install
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
/bin/rm -rf *.o tau_reduce pprof tau_convert tau_merge tau_instrumentor *.dep lib*.a *.ii *.ti ti_files cxx_repository ii_files rii_files
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
/bin/rm -rf *.ii *.ti ti_files cxx_repository ii_files rii_files *.a *.o *.so
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
/bin/rm -f simple.o simple
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/instrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/threads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/cthreads'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
/bin/rm -f hello.o hello
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/fortran'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
/bin/rm -f cubes.o cubes
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/f90'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
/bin/rm -f cpi.o cpi
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/pi'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
rm -f core
rm -f *~ */core */*~ */*.o */npbparams.h */*.obj */*.exe
rm -f MPI_dummy/test MPI_dummy/libmpi.a
rm -f sys/setparams sys/makesuite sys/setparams.h
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/NPB2.3'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/autoinstrument'
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
/bin/rm -f klargest.o klargest.inst.cpp klargest klargest.pdb *.refined* profile* pprof.dat
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/examples/reduce'
Determining Configuration...
System previously configured as a bgl
*********** RECURSIVELY MAKING SUBDIRECTORIES ***********
*** COMPILING utils DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/utils'
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c pprof.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c function_data.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c user_event_data.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE pprof.o user_event_data.o function_data.o -o pprof -lm
Installing pprof in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp pprof /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_reduce.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c pprof_elem.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_reduce.o pprof_elem.o -o tau_reduce -lm
Installing tau_reduce in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_reduce /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_merge.c
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -c tau_events.cpp
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_merge.o tau_events.o -o tau_merge -lm
Installing tau_merge in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_merge /home/amorris/wiki/tau-2.16.1/bgl/bin
blrts_xlC -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_convert.c -o tau_convert -lm
Installing tau_convert in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_convert /home/amorris/wiki/tau-2.16.1/bgl/bin
g++ -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrumentor.cpp
g++ -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_instrument.cpp
g++ -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/include -c tau_selective.cpp
g++ -I../include -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -w -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE tau_instrumentor.o tau_instrument.o tau_selective.o -o tau_instrumentor -L/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/lib -lpdb -lm
Installing tau_instrumentor in /home/amorris/wiki/tau-2.16.1/bgl/bin
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/bin ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/bin ;fi
/bin/cp tau_instrumentor /home/amorris/wiki/tau-2.16.1/bgl/bin
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/utils'
*** COMPILING src/Profile DIRECTORY
make[1]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c Profiler.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TulipTimers.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c UserEvent.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c FunctionInfo.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c RtsLayer.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c RtsThread.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauCAPI.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauFAPI.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauMapping.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauHooks.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauHandler.cpp
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauMemory.cpp
ar rcv libtau-mpi-pdt.a Profiler.o TulipTimers.o UserEvent.o FunctionInfo.o RtsLayer.o RtsThread.o TauCAPI.o TauFAPI.o TauMapping.o TauHooks.o TauHandler.o TauMemory.o
a - Profiler.o
a - TulipTimers.o
a - UserEvent.o
a - FunctionInfo.o
a - RtsLayer.o
a - RtsThread.o
a - TauCAPI.o
a - TauFAPI.o
a - TauMapping.o
a - TauHooks.o
a - TauHandler.o
a - TauMemory.o
echo "Built" libtau-mpi-pdt.a
Built libtau-mpi-pdt.a
Installing libtau-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libtau-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp /home/amorris/wiki/tau-2.16.1/include/Makefile /home/amorris/wiki/tau-2.16.1/bgl/lib/Makefile.tau-mpi-pdt
blrts_xlC -DTAU_LIBRARY_SOURCE -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/home/amorris/wiki/tau-2.16.1/include -c TauDisable.cpp
ar rcv libTauDisable.a TauDisable.o
a - TauDisable.o
echo "Built" libTauDisable.a
Built libTauDisable.a
Installing libTauDisable.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
/bin/cp libTauDisable.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make -f Makefile.wrapper
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
blrts_xlc -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/bgl/BlueLight/ppcfloor/bglsys/include -c TauMpi.c
blrts_xlc -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/bgl/BlueLight/ppcfloor/bglsys/include -c TauFMpi.c
"TauFMpi.c", line 4088.54: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4235.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 4906.48: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
"TauFMpi.c", line 5011.79: 1506-280 (W) Function argument assignment between types "struct MPI_Status*" and "int*" is not allowed.
blrts_xlc -I/home/amorris/wiki/tau-2.16.1/include -DPROFILING_ON -DTAU_STDCXXLIB -DTAU_DOT_H_LESS_HEADERS -DTAU_XLC -DTAU_MPI -DTAU_MPI_THREADED -DTAU_MPIGREQUEST -DTAU_MPIDATAREP -DTAU_MPIERRHANDLER -DTAU_MPIATTRFUNCTION -DTAU_MPITYPEEX -DTAU_MPIADDERROR -DTAU_LARGEFILE -D_LARGEFILE64_SOURCE -I/bgl/BlueLight/ppcfloor/bglsys/include -c TauMpiExtensions.c
ar rcv libTauMpi-mpi-pdt.a TauMpi.o TauFMpi.o TauMpiExtensions.o
a - TauMpi.o
a - TauFMpi.o
a - TauMpiExtensions.o
echo "Built" libTauMpi-mpi-pdt.a
Built libTauMpi-mpi-pdt.a
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make -f Makefile.wrapper install
make[2]: Entering directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
Installing libTauMpi-mpi-pdt.a in /home/amorris/wiki/tau-2.16.1/bgl/lib
if [ -d /home/amorris/wiki/tau-2.16.1/bgl/lib ] ; then true; \
else mkdir /home/amorris/wiki/tau-2.16.1/bgl/lib ;fi
/bin/cp libTauMpi-mpi-pdt.a /home/amorris/wiki/tau-2.16.1/bgl/lib
make[2]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
make[1]: Leaving directory `/home/amorris/wiki/tau-2.16.1/src/Profile'
***************** DONE ************************
% # build and run example auto-instrumented MPI fortran 90 application
% cd examples/pdt_mpi/f90
% make
/home/amorris/wiki/tau-2.16.1/../pdtoolkit-3.10/bgl/bin/f95parse ring.f90 -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include ; ../../../bgl/bin/tau_instrumentor ring.pdb ring.f90 -o ring.inst.f90 ; blrts_xlf90 -I/home/amorris/wiki/tau-2.16.1/include -I/bgl/BlueLight/ppcfloor/bglsys/include -qsuffix=f=f90 -c ring.inst.f90 -o ring.o ; rm -f ring.pdb ;
** func === End of Compilation 1 ===
** main === End of Compilation 2 ===
1501-510 Compilation successful for file ring.inst.f90.
blrts_xlf90 ring.o -o ring -L/home/amorris/wiki/tau-2.16.1/bgl/lib -lTauMpi-mpi-pdt -L/bgl/BlueLight/ppcfloor/bglsys/lib -lmpich.rts -lmsglayer.rts -ldevices.rts -lrts.rts -ldevices.rts -lrt -L/home/amorris/wiki/tau-2.16.1/bgl/lib -ltau-mpi-pdt -L/usr/bin/../blrts_dev_lib -L/usr/bin/../blrts_lib -L/opt/ibmcmp/vacpp/bg/8.0/blrts_lib -libmc++ -L/bgl/BlueLight/ppcfloor/blrts-gnu/powerpc-bgl-blrts-gnu/lib-lstdc++
% cqsub -t5 -n4 ./ring
5332
% # after job completes, view simple report
% ../../../ppc64/bin/pprof
Reading Profile files in profile.*
NODE 0;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.088 1 1 5 1420 MAIN
54.9 0.606 0.78 1 4 780 FUNC
37.5 0.532 0.532 1 0 532 MPI_Init()
8.5 0.121 0.121 1 0 121 MPI_Recv()
1.7 0.024 0.024 1 0 24 MPI_Send()
1.5 0.021 0.021 1 0 21 MPI_Bcast()
0.8 0.012 0.012 1 0 12 MPI_Finalize()
0.6 0.008 0.008 1 0 8 MPI_Barrier()
0.3 0.004 0.004 1 0 4 MPI_Comm_rank()
0.3 0.004 0.004 1 0 4 MPI_Comm_size()
---------------------------------------------------------------------------------------
USER EVENTS Profile :NODE 0, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples MaxValue MinValue MeanValue Std. Dev. Event Name
---------------------------------------------------------------------------------------
1 40 40 40 0 Message size for broadcast
1 40 40 40 0 Message size received from all nodes
1 40 40 40 0 Message size sent to all nodes
---------------------------------------------------------------------------------------
NODE 1;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.086 1 1 5 1414 MAIN
52.1 0.55 0.736 1 4 736 FUNC
37.1 0.525 0.525 1 0 525 MPI_Init()
7.8 0.11 0.11 1 0 110 MPI_Bcast()
4.1 0.058 0.058 1 0 58 MPI_Finalize()
2.8 0.039 0.039 1 0 39 MPI_Recv()
1.5 0.021 0.021 1 0 21 MPI_Barrier()
1.1 0.016 0.016 1 0 16 MPI_Send()
0.4 0.005 0.005 1 0 5 MPI_Comm_size()
0.3 0.004 0.004 1 0 4 MPI_Comm_rank()
---------------------------------------------------------------------------------------
USER EVENTS Profile :NODE 1, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples MaxValue MinValue MeanValue Std. Dev. Event Name
---------------------------------------------------------------------------------------
1 40 40 40 0 Message size for broadcast
1 40 40 40 0 Message size received from all nodes
1 40 40 40 0 Message size sent to all nodes
---------------------------------------------------------------------------------------
NODE 2;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.083 1 1 5 1415 MAIN
54.2 0.544 0.767 1 4 767 FUNC
37.3 0.528 0.528 1 0 528 MPI_Init()
5.7 0.08 0.08 1 0 80 MPI_Recv()
4.8 0.068 0.068 1 0 68 MPI_Bcast()
4.1 0.058 0.058 1 0 58 MPI_Barrier()
2.0 0.028 0.028 1 0 28 MPI_Finalize()
1.2 0.017 0.017 1 0 17 MPI_Send()
0.4 0.005 0.005 1 0 5 MPI_Comm_size()
0.3 0.004 0.004 1 0 4 MPI_Comm_rank()
---------------------------------------------------------------------------------------
USER EVENTS Profile :NODE 2, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples MaxValue MinValue MeanValue Std. Dev. Event Name
---------------------------------------------------------------------------------------
1 40 40 40 0 Message size for broadcast
1 40 40 40 0 Message size received from all nodes
1 40 40 40 0 Message size sent to all nodes
---------------------------------------------------------------------------------------
NODE 3;CONTEXT 0;THREAD 0:
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.086 1 1 5 1411 MAIN
53.2 0.55 0.751 1 4 751 FUNC
37.0 0.522 0.522 1 0 522 MPI_Init()
8.6 0.121 0.121 1 0 121 MPI_Recv()
3.0 0.043 0.043 1 0 43 MPI_Finalize()
2.6 0.036 0.036 1 0 36 MPI_Barrier()
1.9 0.027 0.027 1 0 27 MPI_Bcast()
1.2 0.017 0.017 1 0 17 MPI_Send()
0.4 0.005 0.005 1 0 5 MPI_Comm_size()
0.3 0.004 0.004 1 0 4 MPI_Comm_rank()
---------------------------------------------------------------------------------------
USER EVENTS Profile :NODE 3, CONTEXT 0, THREAD 0
---------------------------------------------------------------------------------------
NumSamples MaxValue MinValue MeanValue Std. Dev. Event Name
---------------------------------------------------------------------------------------
1 40 40 40 0 Message size for broadcast
1 40 40 40 0 Message size received from all nodes
1 40 40 40 0 Message size sent to all nodes
---------------------------------------------------------------------------------------
FUNCTION SUMMARY (total):
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.343 5 4 20 1415 MAIN
53.6 2 3 4 16 758 FUNC
37.2 2 2 4 0 527 MPI_Init()
6.4 0.361 0.361 4 0 90 MPI_Recv()
4.0 0.226 0.226 4 0 56 MPI_Bcast()
2.5 0.141 0.141 4 0 35 MPI_Finalize()
2.2 0.123 0.123 4 0 31 MPI_Barrier()
1.3 0.074 0.074 4 0 18 MPI_Send()
0.3 0.019 0.019 4 0 5 MPI_Comm_size()
0.3 0.016 0.016 4 0 4 MPI_Comm_rank()
FUNCTION SUMMARY (mean):
---------------------------------------------------------------------------------------
%Time Exclusive Inclusive #Call #Subrs Inclusive Name
msec total msec usec/call
---------------------------------------------------------------------------------------
100.0 0.0858 1 1 5 1415 MAIN
53.6 0.562 0.758 1 4 758 FUNC
37.2 0.527 0.527 1 0 527 MPI_Init()
6.4 0.0902 0.0902 1 0 90 MPI_Recv()
4.0 0.0565 0.0565 1 0 56 MPI_Bcast()
2.5 0.0352 0.0352 1 0 35 MPI_Finalize()
2.2 0.0307 0.0307 1 0 31 MPI_Barrier()
1.3 0.0185 0.0185 1 0 18 MPI_Send()
0.3 0.00475 0.00475 1 0 5 MPI_Comm_size()
0.3 0.004 0.004 1 0 4 MPI_Comm_rank()
%
