Read the Docs build information Build id: 2662267 Project: advanced-micro-devices-gpu-cluster-networking Version: latest Commit: f94b80ae6c74c3c93d4287a5d6db6fb4525f999b Date: 2024-12-04T23:41:08.337264Z State: finished Success: True [rtd-command-info] start-time: 2024-12-05T00:47:34.345464Z, end-time: 2024-12-05T00:47:44.135686Z, duration: 9, exit-code: 0 python -m sphinx -T -b html -d _build/doctrees -D language=en . $READTHEDOCS_OUTPUT/html Running Sphinx v8.1.3 loading translations [en]... done making output directory... done Remote mappings will be fetched from ROCm/rocm-docs-core branch=develop WARNING: Current project 'gpu-cluster-networking' not found in projects. Did you forget to set 'external_projects_current_project' to the name of the current project? myst v4.0.0: MdParserConfig(commonmark_only=False, gfm_only=False, enable_extensions={'dollarmath', 'replacements', 'html_image', 'colon_fence', 'fieldlist', 'substitution'}, disable_syntax=[], all_links_external=False, links_external_new_tab=False, url_schemes=('http', 'https', 'mailto', 'ftp'), ref_domains=None, fence_as_directive=set(), number_code_blocks=[], title_to_header=False, heading_anchors=3, heading_slug_func=None, html_meta={}, footnote_sort=True, footnote_transition=True, words_per_minute=200, substitutions={}, linkify_fuzzy_links=True, dmath_allow_labels=True, dmath_allow_space=True, dmath_allow_digits=True, dmath_double_inline=False, update_mathjax=True, mathjax_classes='tex2jax_process|mathjax_process|math|output_area', enable_checkboxes=False, suppress_warnings=[], highlight_code_blocks=True) loading intersphinx inventory 'amdmigraphx' from https://rocm.docs.amd.com/projects/AMDMIGraphX/en/latest/objects.inv ... loading intersphinx inventory 'amdsmi' from https://rocm.docs.amd.com/projects/amdsmi/en/latest/objects.inv ... loading intersphinx inventory 'composable_kernel' from https://rocm.docs.amd.com/projects/composable_kernel/en/latest/objects.inv ... loading intersphinx inventory 'hip' from https://rocm.docs.amd.com/projects/HIP/en/latest/objects.inv ... loading intersphinx inventory 'hipblas' from https://rocm.docs.amd.com/projects/hipBLAS/en/latest/objects.inv ... loading intersphinx inventory 'hipblaslt' from https://rocm.docs.amd.com/projects/hipBLASLt/en/latest/objects.inv ... loading intersphinx inventory 'hipcc' from https://rocm.docs.amd.com/projects/HIPCC/en/latest/objects.inv ... loading intersphinx inventory 'hipcub' from https://rocm.docs.amd.com/projects/hipCUB/en/latest/objects.inv ... loading intersphinx inventory 'hipfft' from https://rocm.docs.amd.com/projects/hipFFT/en/latest/objects.inv ... loading intersphinx inventory 'hipfort' from https://rocm.docs.amd.com/projects/hipfort/en/latest/objects.inv ... loading intersphinx inventory 'hipify' from https://rocm.docs.amd.com/projects/HIPIFY/en/latest/objects.inv ... loading intersphinx inventory 'hip-python' from https://rocm.docs.amd.com/projects/hip-python/en/latest/objects.inv ... loading intersphinx inventory 'hiprand' from https://rocm.docs.amd.com/projects/hipRAND/en/latest/objects.inv ... loading intersphinx inventory 'hipsolver' from https://rocm.docs.amd.com/projects/hipSOLVER/en/latest/objects.inv ... loading intersphinx inventory 'hipsparse' from https://rocm.docs.amd.com/projects/hipSPARSE/en/latest/objects.inv ... loading intersphinx inventory 'hipsparselt' from https://rocm.docs.amd.com/projects/hipSPARSELt/en/latest/objects.inv ... loading intersphinx inventory 'hiptensor' from https://rocm.docs.amd.com/projects/hipTensor/en/latest/objects.inv ... loading intersphinx inventory 'hip-vs' from https://rocm.docs.amd.com/projects/hip-vs/en/latest/objects.inv ... loading intersphinx inventory 'instinct' from https://dcgpu.docs.amd.com/objects.inv ... loading intersphinx inventory 'llvm-project' from https://rocm.docs.amd.com/projects/llvm-project/en/latest/objects.inv ... loading intersphinx inventory 'miopen' from https://rocm.docs.amd.com/projects/MIOpen/en/latest/objects.inv ... loading intersphinx inventory 'mivisionx' from https://rocm.docs.amd.com/projects/MIVisionX/en/latest/objects.inv ... loading intersphinx inventory 'omniperf' from https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv ... loading intersphinx inventory 'omnitrace' from https://rocm.docs.amd.com/projects/omnitrace/en/latest/objects.inv ... loading intersphinx inventory 'python' from https://docs.python.org/3/objects.inv ... loading intersphinx inventory 'rccl' from https://rocm.docs.amd.com/projects/rccl/en/latest/objects.inv ... WARNING: failed to reach any of the inventories with the following issues: intersphinx inventory 'https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv' not fetchable due to : 404 Client Error: Not Found for url: https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv loading intersphinx inventory 'rdc' from https://rocm.docs.amd.com/projects/rdc/en/latest/objects.inv ... loading intersphinx inventory 'radeon' from https://rocm.docs.amd.com/projects/radeon/en/latest/objects.inv ... loading intersphinx inventory 'rocal' from https://rocm.docs.amd.com/projects/rocAL/en/latest/objects.inv ... loading intersphinx inventory 'rocalution' from https://rocm.docs.amd.com/projects/rocALUTION/en/latest/objects.inv ... loading intersphinx inventory 'rocblas' from https://rocm.docs.amd.com/projects/rocBLAS/en/latest/objects.inv ... loading intersphinx inventory 'rocdbgapi' from https://rocm.docs.amd.com/projects/ROCdbgapi/en/latest/objects.inv ... loading intersphinx inventory 'rocdecode' from https://rocm.docs.amd.com/projects/rocDecode/en/latest/objects.inv ... loading intersphinx inventory 'rocfft' from https://rocm.docs.amd.com/projects/rocFFT/en/latest/objects.inv ... loading intersphinx inventory 'rocgdb' from https://rocm.docs.amd.com/projects/ROCgdb/en/latest/objects.inv ... loading intersphinx inventory 'rocjpeg' from https://rocm.docs.amd.com/projects/rocJPEG/en/latest/objects.inv ... loading intersphinx inventory 'rocm' from https://rocm.docs.amd.com/en/latest/objects.inv ... loading intersphinx inventory 'rocm-docs-core' from https://rocm.docs.amd.com/projects/rocm-docs-core/en/latest/objects.inv ... loading intersphinx inventory 'rocm-install-on-linux' from https://rocm.docs.amd.com/projects/install-on-linux/en/latest/objects.inv ... loading intersphinx inventory 'rocm-install-on-windows' from https://rocm.docs.amd.com/projects/install-on-windows/en/latest/objects.inv ... loading intersphinx inventory 'rocm_bandwidth_test' from https://rocm.docs.amd.com/projects/rocm_bandwidth_test/en/latest/objects.inv ... loading intersphinx inventory 'rocm_smi_lib' from https://rocm.docs.amd.com/projects/rocm_smi_lib/en/latest/objects.inv ... loading intersphinx inventory 'rocmcmakebuildtools' from https://rocm.docs.amd.com/projects/ROCmCMakeBuildTools/en/latest/objects.inv ... loading intersphinx inventory 'rocminfo' from https://rocm.docs.amd.com/projects/rocminfo/en/latest/objects.inv ... loading intersphinx inventory 'rocmvalidationsuite' from https://rocm.docs.amd.com/projects/ROCmValidationSuite/en/latest/objects.inv ... loading intersphinx inventory 'rocprim' from https://rocm.docs.amd.com/projects/rocPRIM/en/latest/objects.inv ... loading intersphinx inventory 'rocprofiler-compute' from https://rocm.docs.amd.com/projects/rocprofiler-compute/en/latest/objects.inv ... loading intersphinx inventory 'rocprofiler' from https://rocm.docs.amd.com/projects/rocprofiler/en/latest/objects.inv ... loading intersphinx inventory 'rocprofiler-sdk' from https://rocm.docs.amd.com/projects/rocprofiler-sdk/en/latest/objects.inv ... loading intersphinx inventory 'rocprofiler-systems' from https://rocm.docs.amd.com/projects/rocprofiler-systems/en/latest/objects.inv ... loading intersphinx inventory 'rocpydecode' from https://rocm.docs.amd.com/projects/rocPyDecode/en/latest/objects.inv ... loading intersphinx inventory 'rocrand' from https://rocm.docs.amd.com/projects/rocRAND/en/latest/objects.inv ... loading intersphinx inventory 'rocr-runtime' from https://rocm.docs.amd.com/projects/ROCR-Runtime/en/latest/objects.inv ... loading intersphinx inventory 'rocr_debug_agent' from https://rocm.docs.amd.com/projects/rocr_debug_agent/en/latest/objects.inv ... loading intersphinx inventory 'rocsolver' from https://rocm.docs.amd.com/projects/rocSOLVER/en/latest/objects.inv ... loading intersphinx inventory 'rocsparse' from https://rocm.docs.amd.com/projects/rocSPARSE/en/latest/objects.inv ... loading intersphinx inventory 'rocthrust' from https://rocm.docs.amd.com/projects/rocThrust/en/latest/objects.inv ... loading intersphinx inventory 'roctracer' from https://rocm.docs.amd.com/projects/roctracer/en/latest/objects.inv ... loading intersphinx inventory 'rocwmma' from https://rocm.docs.amd.com/projects/rocWMMA/en/latest/objects.inv ... loading intersphinx inventory 'rpp' from https://rocm.docs.amd.com/projects/rpp/en/latest/objects.inv ... loading intersphinx inventory 'rtd' from https://docs.readthedocs.io/en/stable/objects.inv ... loading intersphinx inventory 'sphinx' from https://www.sphinx-doc.org/en/master/objects.inv ... loading intersphinx inventory 'transferbench' from https://rocm.docs.amd.com/projects/TransferBench/en/latest/objects.inv ... [autosummary] generating autosummary for: how-to/multi-node-config.rst, how-to/single-node-config.rst, index.rst, reference/hardware-support.rst building [mo]: targets for 0 po files that are out of date writing output... building [html]: targets for 4 source files that are out of date updating environment: [new config] 4 added, 0 changed, 0 removed reading sources... [ 25%] how-to/multi-node-config reading sources... [ 50%] how-to/single-node-config reading sources... [ 75%] index reading sources... [100%] reference/hardware-support looking for now-outdated files... none found pickling environment... done checking consistency... done preparing documents... done copying assets... copying static files... Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/html/_static/basic.css Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/html/_static/language_data.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/html/_static/documentation_options.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/html/_static/copybutton.js copying static files: done copying extra files... copying extra files: done copying assets: done writing output... [ 25%] how-to/multi-node-config writing output... [ 50%] how-to/single-node-config writing output... [ 75%] index writing output... [100%] reference/hardware-support /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:17: WARNING: undefined label: '/reference/hardware-support' [ref.ref] /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:357: WARNING: unknown document: 'rocmvalidationsuite:how%20to/configure-rvs' [ref.doc] generating indices... genindex done writing additional pages... search done copying images... [100%] data/D2D-perftest-multithread.png dumping search index in English (code: en)... done dumping object inventory... done ====================== slowest reading durations ======================= 0.277 how-to/multi-node-config 0.156 how-to/single-node-config 0.028 reference/hardware-support 0.016 index build succeeded, 4 warnings. The HTML pages are in ../_readthedocs/html. [rtd-command-info] start-time: 2024-12-05T00:47:41.947201Z, end-time: 2024-12-05T00:47:43.094106Z, duration: 1, exit-code: 0 git clone --depth 1 git@github.com:ROCm/gpu-cluster-networking.git . Cloning into '.'... Warning: Permanently added 'github.com' (ED25519) to the list of known hosts. [rtd-command-info] start-time: 2024-12-05T00:47:43.165159Z, end-time: 2024-12-05T00:47:44.251431Z, duration: 1, exit-code: 0 git fetch origin --force --prune --prune-tags --depth 50 refs/heads/docs/6.3.0:refs/remotes/origin/docs/6.3.0 Warning: Permanently added 'github.com' (ED25519) to the list of known hosts. From github.com:ROCm/gpu-cluster-networking * [new branch] docs/6.3.0 -> origin/docs/6.3.0 [rtd-command-info] start-time: 2024-12-05T00:47:44.216850Z, end-time: 2024-12-05T00:47:48.451639Z, duration: 4, exit-code: 0 python -m sphinx -T -b singlehtml -d _build/doctrees -D language=en . $READTHEDOCS_OUTPUT/htmlzip Running Sphinx v8.1.3 loading translations [en]... done making output directory... done Remote mappings will be fetched from ROCm/rocm-docs-core branch=develop WARNING: Current project 'gpu-cluster-networking' not found in projects. Did you forget to set 'external_projects_current_project' to the name of the current project? loading pickled environment... The configuration has changed (17 options: 'header_link', 'header_title', 'html_context', 'html_favicon', 'html_permalinks_icon', ...) done myst v4.0.0: MdParserConfig(commonmark_only=False, gfm_only=False, enable_extensions={'colon_fence', 'dollarmath', 'html_image', 'fieldlist', 'replacements', 'substitution'}, disable_syntax=[], all_links_external=False, links_external_new_tab=False, url_schemes=('http', 'https', 'mailto', 'ftp'), ref_domains=None, fence_as_directive=set(), number_code_blocks=[], title_to_header=False, heading_anchors=3, heading_slug_func=None, html_meta={}, footnote_sort=True, footnote_transition=True, words_per_minute=200, substitutions={}, linkify_fuzzy_links=True, dmath_allow_labels=True, dmath_allow_space=True, dmath_allow_digits=True, dmath_double_inline=False, update_mathjax=True, mathjax_classes='tex2jax_process|mathjax_process|math|output_area', enable_checkboxes=False, suppress_warnings=[], highlight_code_blocks=True) loading intersphinx inventory 'omniperf' from https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv ... WARNING: failed to reach any of the inventories with the following issues: intersphinx inventory 'https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv' not fetchable due to : 404 Client Error: Not Found for url: https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv [autosummary] generating autosummary for: how-to/multi-node-config.rst, how-to/single-node-config.rst, index.rst, reference/hardware-support.rst building [mo]: targets for 0 po files that are out of date writing output... building [singlehtml]: all documents updating environment: 0 added, 0 changed, 0 removed reading sources... looking for now-outdated files... none found preparing documents... done copying assets... copying static files... Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/basic.css Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/language_data.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/documentation_options.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/copybutton.js copying static files: done copying extra files... copying extra files: done copying assets: done assembling single document... index how-to/single-node-config how-to/multi-node-config reference/hardware-support /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:17: WARNING: undefined label: '/reference/hardware-support' [ref.ref] /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:357: WARNING: unknown document: 'rocmvalidationsuite:how%20to/configure-rvs' [ref.doc] assembling single document: done writing... done writing additional files... done copying images... [100%] data/D2D-perftest-multithread.png copying static files... Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/basic.css Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/language_data.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/documentation_options.js Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/htmlzip/_static/copybutton.js copying static files: done copying extra files... copying extra files: done dumping object inventory... done build succeeded, 4 warnings. The HTML page is in ../_readthedocs/htmlzip. [rtd-command-info] start-time: 2024-12-05T00:47:44.424829Z, end-time: 2024-12-05T00:47:44.510133Z, duration: 0, exit-code: 0 git checkout --force origin/docs/6.3.0 Note: switching to 'origin/docs/6.3.0'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by switching back to a branch. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -c with the switch command. Example: git switch -c Or undo this operation with: git switch - Turn off this advice by setting config variable advice.detachedHead to false HEAD is now at f94b80a Update documentation requirements [rtd-command-info] start-time: 2024-12-05T00:47:44.577529Z, end-time: 2024-12-05T00:47:44.657520Z, duration: 0, exit-code: 0 cat .readthedocs.yaml # Read the Docs configuration file # See https://docs.readthedocs.io/en/stable/config-file/v2.html for details version: 2 build: os: ubuntu-22.04 tools: python: "3.10" python: install: - requirements: docs/sphinx/requirements.txt sphinx: configuration: docs/conf.py formats: [htmlzip, pdf] [rtd-command-info] start-time: 2024-12-05T00:47:49.578174Z, end-time: 2024-12-05T00:47:52.941048Z, duration: 3, exit-code: 0 python -m sphinx -T -b latex -d _build/doctrees -D language=en . $READTHEDOCS_OUTPUT/pdf Running Sphinx v8.1.3 loading translations [en]... done making output directory... done Remote mappings will be fetched from ROCm/rocm-docs-core branch=develop WARNING: Current project 'gpu-cluster-networking' not found in projects. Did you forget to set 'external_projects_current_project' to the name of the current project? loading pickled environment... The configuration has changed (17 options: 'header_link', 'header_title', 'html_context', 'html_favicon', 'html_permalinks_icon', ...) done myst v4.0.0: MdParserConfig(commonmark_only=False, gfm_only=False, enable_extensions={'substitution', 'fieldlist', 'html_image', 'colon_fence', 'replacements', 'dollarmath'}, disable_syntax=[], all_links_external=False, links_external_new_tab=False, url_schemes=('http', 'https', 'mailto', 'ftp'), ref_domains=None, fence_as_directive=set(), number_code_blocks=[], title_to_header=False, heading_anchors=3, heading_slug_func=None, html_meta={}, footnote_sort=True, footnote_transition=True, words_per_minute=200, substitutions={}, linkify_fuzzy_links=True, dmath_allow_labels=True, dmath_allow_space=True, dmath_allow_digits=True, dmath_double_inline=False, update_mathjax=True, mathjax_classes='tex2jax_process|mathjax_process|math|output_area', enable_checkboxes=False, suppress_warnings=[], highlight_code_blocks=True) loading intersphinx inventory 'omniperf' from https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv ... WARNING: failed to reach any of the inventories with the following issues: intersphinx inventory 'https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv' not fetchable due to : 404 Client Error: Not Found for url: https://rocm.docs.amd.com/projects/omniperf/en/latest/objects.inv [autosummary] generating autosummary for: how-to/multi-node-config.rst, how-to/single-node-config.rst, index.rst, reference/hardware-support.rst building [mo]: targets for 0 po files that are out of date writing output... building [latex]: all documents updating environment: 0 added, 0 changed, 0 removed reading sources... looking for now-outdated files... none found preparing documents... done copying assets... copying TeX support files... Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/pdf/make.bat Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/pdf/latexmkrc Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/pdf/latexmkjarc Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/pdf/Makefile done copying assets: done processing gpuclusternetworkingdocumentation.tex... index how-to/single-node-config how-to/multi-node-config reference/hardware-support resolving references... /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:17: WARNING: undefined label: '/reference/hardware-support' [ref.ref] /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/docs/how-to/single-node-config.rst:357: WARNING: unknown document: 'rocmvalidationsuite:how%20to/configure-rvs' [ref.doc] processing gpuclusternetworkingdocumentation.tex: done writing... done copying images... [100%] data/D2D-perftest-multithread.png Writing evaluated template result to /home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/checkouts/latest/_readthedocs/pdf/sphinxmessages.sty build succeeded, 4 warnings. The LaTeX files are in ../_readthedocs/pdf. Run 'make' in that directory to run these through (pdf)latex (use `make latexpdf' here to do that automatically). [rtd-command-info] start-time: 2024-12-05T00:47:52.746646Z, end-time: 2024-12-05T00:47:52.856636Z, duration: 0, exit-code: 0 asdf global python 3.10.15 [rtd-command-info] start-time: 2024-12-05T00:47:53.202543Z, end-time: 2024-12-05T00:47:53.299392Z, duration: 0, exit-code: 0 cat latexmkrc $latex = 'latex ' . $ENV{'LATEXOPTS'} . ' %O %S'; $pdflatex = 'pdflatex ' . $ENV{'LATEXOPTS'} . ' %O %S'; $lualatex = 'lualatex ' . $ENV{'LATEXOPTS'} . ' %O %S'; $xelatex = 'xelatex --no-pdf ' . $ENV{'LATEXOPTS'} . ' %O %S'; $makeindex = 'makeindex -s python.ist %O -o %D %S'; add_cus_dep( "glo", "gls", 0, "makeglo" ); sub makeglo { return system( "makeindex -s gglo.ist -o '$_[0].gls' '$_[0].glo'" ); } [rtd-command-info] start-time: 2024-12-05T00:47:53.368889Z, end-time: 2024-12-05T00:48:01.710931Z, duration: 8, exit-code: 0 latexmk -r latexmkrc -pdf -f -dvi- -ps- -jobname=advanced-micro-devices-gpu-cluster-networking -interaction=nonstopmode Use of uninitialized value in concatenation (.) or string at (eval 10) line 1. Use of uninitialized value in concatenation (.) or string at (eval 10) line 2. Use of uninitialized value in concatenation (.) or string at (eval 10) line 3. Use of uninitialized value in concatenation (.) or string at (eval 10) line 4. Subroutine makeglo redefined at (eval 11) line 7. Use of uninitialized value in concatenation (.) or string at (eval 11) line 1. Use of uninitialized value in concatenation (.) or string at (eval 11) line 2. Use of uninitialized value in concatenation (.) or string at (eval 11) line 3. Use of uninitialized value in concatenation (.) or string at (eval 11) line 4. Rc files read: /etc/LatexMk latexmkrc latexmkrc Latexmk: This is Latexmk, John Collins, 20 November 2021, version: 4.76. Rule 'pdflatex': File changes, etc: Changed files, or newly in use since previous run(s): 'gpuclusternetworkingdocumentation.tex' ------------ Run number 1 of rule 'pdflatex' ------------ ------------ Running 'pdflatex -interaction=nonstopmode -recorder --jobname="advanced-micro-devices-gpu-cluster-networking" "gpuclusternetworkingdocumentation.tex"' ------------ Latexmk: applying rule 'pdflatex'... This is pdfTeX, Version 3.141592653-2.6-1.40.22 (TeX Live 2022/dev/Debian) (preloaded format=pdflatex) restricted \write18 enabled. entering extended mode (./gpuclusternetworkingdocumentation.tex LaTeX2e <2021-11-15> patch level 1 L3 programming layer <2022-01-21> (./sphinxmanual.cls Document Class: sphinxmanual 2019/12/01 v2.3.0 Document class (Sphinx manual) (/usr/share/texlive/texmf-dist/tex/latex/base/report.cls Document Class: report 2021/10/04 v1.4n Standard LaTeX document class (/usr/share/texlive/texmf-dist/tex/latex/base/size10.clo))) (/usr/share/texlive/texmf-dist/tex/latex/base/inputenc.sty) (/usr/share/texlive/texmf-dist/tex/latex/cmap/cmap.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/fontenc.sty<>) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amssymb.sty (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texlive/texmf-dist/tex/generic/babel/babel.sty (/usr/share/texlive/texmf-dist/tex/generic/babel/txtbabel.def) (/usr/share/texlive/texmf-dist/tex/generic/babel-english/english.ldf)) (/usr/share/texmf/tex/latex/tex-gyre/tgtermes.sty (/usr/share/texlive/texmf-dist/tex/latex/kvoptions/kvoptions.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/keyval.sty) (/usr/share/texlive/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty) (/usr/share/texlive/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty))) (/usr/share/texmf/tex/latex/tex-gyre/tgheros.sty) (/usr/share/texlive/texmf-dist/tex/latex/fncychap/fncychap.sty) (./sphinx.sty (/usr/share/texlive/texmf-dist/tex/latex/xcolor/xcolor.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/color.cfg) (/usr/share/texlive/texmf-dist/tex/latex/graphics-def/pdftex.def)) (./sphinxoptionshyperref.sty) (./sphinxoptionsgeometry.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/textcomp.sty) (/usr/share/texlive/texmf-dist/tex/latex/float/float.sty) (/usr/share/texlive/texmf-dist/tex/latex/wrapfig/wrapfig.sty) (/usr/share/texlive/texmf-dist/tex/latex/capt-of/capt-of.sty) (/usr/share/texlive/texmf-dist/tex/latex/tools/multicol.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphicx.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphics.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/trig.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/graphics.cfg))) (./sphinxlatexgraphics.sty) (./sphinxpackageboxes.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.cfg) (/usr/share/texlive/texmf-dist/tex/latex/pict2e/p2e-pdftex.def)) (/usr/share/texlive/texmf-dist/tex/latex/ellipse/ellipse.sty)) (./sphinxlatexadmonitions.sty (/usr/share/texlive/texmf-dist/tex/latex/framed/framed.sty) (./sphinxpackagefootnote.sty)) (./sphinxlatexliterals.sty (/usr/share/texlive/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/alltt.sty) (/usr/share/texlive/texmf-dist/tex/latex/upquote/upquote.sty) (/usr/share/texlive/texmf-dist/tex/latex/needspace/needspace.sty)) (./sphinxlatexshadowbox.sty) (./sphinxlatexcontainers.sty) (./sphinxhighlight.sty) (./sphinxlatextables.sty (/usr/share/texlive/texmf-dist/tex/latex/tabulary/tabulary.sty (/usr/share/texlive/texmf-dist/tex/latex/tools/array.sty)) (/usr/share/texlive/texmf-dist/tex/latex/tools/longtable.sty) (/usr/share/texlive/texmf-dist/tex/latex/varwidth/varwidth.sty) (/usr/share/texlive/texmf-dist/tex/latex/colortbl/colortbl.sty) (/usr/share/texlive/texmf-dist/tex/latex/booktabs/booktabs.sty)) (./sphinxlatexnumfig.sty) (./sphinxlatexlists.sty) (./sphinxlatexindbibtoc.sty (/usr/share/texlive/texmf-dist/tex/latex/base/makeidx.sty)) (./sphinxlatexstylepage.sty (/usr/share/texlive/texmf-dist/tex/latex/parskip/parskip.sty (/usr/share/texlive/texmf-dist/tex/latex/etoolbox/etoolbox.sty)) (/usr/share/texlive/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty)) (./sphinxlatexstyleheadings.sty (/usr/share/texlive/texmf-dist/tex/latex/titlesec/titlesec.sty)) (./sphinxlatexstyletext.sty) (./sphinxlatexobjects.sty)) (/usr/share/texlive/texmf-dist/tex/latex/geometry/geometry.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/ifvtex.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/iftex.sty))) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref.sty (/usr/share/texlive/texmf-dist/tex/generic/pdftexcmds/pdftexcmds.sty (/usr/share/texlive/texmf-dist/tex/generic/infwarerr/infwarerr.sty)) (/usr/share/texlive/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty) (/usr/share/texlive/texmf-dist/tex/generic/pdfescape/pdfescape.sty) (/usr/share/texlive/texmf-dist/tex/latex/hycolor/hycolor.sty) (/usr/share/texlive/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty) (/usr/share/texlive/texmf-dist/tex/latex/auxhook/auxhook.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/pd1enc.def) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref-langpatches.def) (/usr/share/texlive/texmf-dist/tex/generic/intcalc/intcalc.sty) (/usr/share/texlive/texmf-dist/tex/generic/etexcmds/etexcmds.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/puenc.def) (/usr/share/texlive/texmf-dist/tex/latex/url/url.sty) (/usr/share/texlive/texmf-dist/tex/generic/bitset/bitset.sty (/usr/share/texlive/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty)) (/usr/share/texlive/texmf-dist/tex/latex/base/atbegshi-ltx.sty)) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hpdftex.def (/usr/share/texlive/texmf-dist/tex/latex/base/atveryend-ltx.sty) (/usr/share/texlive/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty (/usr/share/texlive/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty))) (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/hypcap.sty) (./sphinxmessages.sty) Writing index file advanced-micro-devices-gpu-cluster-networking.idx (/usr/share/texmf/tex/latex/tex-gyre/t1qtm.fd) (/usr/share/texlive/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def) (./advanced-micro-devices-gpu-cluster-networking.aux) (/usr/share/texlive/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] ) (/usr/share/texlive/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg)) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5.sty (/usr/share/texlive/texmf-dist/tex/latex/l3kernel/expl3.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/l3keys2e/l3keys2e.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/xparse/xparse.sty) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-generic-help er.sty (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-mapping.def) )) *geometry* driver: auto-detecting *geometry* detected driver: pdftex (/usr/share/texlive/texmf-dist/tex/latex/hyperref/nameref.sty (/usr/share/texlive/texmf-dist/tex/latex/refcount/refcount.sty) (/usr/share/texlive/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty)) Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\spacefactor' on input line 81. Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\@m' on input line 81. (/usr/share/texmf/tex/latex/tex-gyre/t1qhv.fd)<><><><> (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsa.fd) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsb.fd) [1{/var/lib/texmf/fo nts/map/pdftex/updmap/pdftex.map}] [2] [1] [2] (/usr/share/texmf/tex/latex/tex-gyre/ts1qtm.fd) LaTeX Warning: Hyper reference `how-to/single-node-config::doc' on page 1 undef ined on input line 130. LaTeX Warning: Hyper reference `how-to/multi-node-config::doc' on page 1 undefi ned on input line 134. LaTeX Warning: Hyper reference `reference/hardware-support::doc' on page 1 unde fined on input line 158. (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree1.fd) [1] [2] Chapter 1. (/usr/share/texlive/texmf-dist/tex/latex/txfonts/t1txtt.fd) LaTeX Warning: Hyper reference `how-to/single-node-config:disable-acs-script' o n page 3 undefined on input line 263. [3] (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree2.fd) [4] [5] LaTeX Warning: Hyper reference `how-to/single-node-config:disable-acs-script' o n page 6 undefined on input line 562. [6] LaTeX Warning: Hyper reference `how-to/single-node-config:roce-configuration-sc ript-for-broadcom-thor-nic' on page 7 undefined on input line 585. [7] (/usr/share/texlive/texmf-dist/tex/latex/txfonts/ts1txtt.fd) [8] Overfull \hbox (186.49307pt too wide) in paragraph at lines 807--807 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \hbox (186.49307pt too wide) in paragraph at lines 819--819 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \vbox (2.84605pt too high) detected at line 832 [9] [10] Underfull \vbox (badness 10000) detected at line 942 Underfull \vbox (badness 10000) detected at line 942 [11] [12] [13] Underfull \vbox (badness 10000) detected at line 1098 Underfull \vbox (badness 10000) detected at line 1098 [14] Overfull \vbox (2.3893pt too high) detected at line 1152 [15] Overfull \vbox (2.3893pt too high) detected at line 1200 [16] [17] [18] Chapter 2. LaTeX Warning: Hyper reference `how-to/single-node-config::doc' on page 19 unde fined on input line 1311. [19] [20] [21] LaTeX Warning: Hyper reference `how-to/multi-node-config:ofed-perftest-installa tion-and-benchmarking' on page 22 undefined on input line 1611. [22] [23] LaTeX Warning: Hyper reference `how-to/multi-node-config:multinode-prerequisite s' on page 24 undefined on input line 1849. [24 <./D2D-perftest-multithread.png>] Underfull \vbox (badness 10000) detected at line 1959 Underfull \vbox (badness 10000) detected at line 1959 [25] [26] Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 []|\T1/txtt/m/n/10 /$OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mc a spml Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allreduce []d Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_alltoall []d Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allgather []d Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ [27] Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun []mca oob_tcp_if_exclude docker,lo []mc a Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 btl_tcp_if_exclude docker,lo []host {HOST1}:8,{HOST2}:8 []np Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 16 []x LD_LIBRARY_PATH=/opt/rccl/build/rccl/install/lib:/ Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 opt/ompi/lib []x NCCL_IB_GID_INDEX=3 []x NCCL_DEBUG=VERSION Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []\T1/txtt/m/n/10 x NCCL_IB_HCA=bnxt_re0,bnxt_re1,bnxt_re2,bnxt_re3,bnxt_re4, Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 bnxt_re5,bnxt_re6,bnxt_re7 []x NCCL_IGNORE_CPU_AFFINITY=1 [28] [29] [30] Chapter 3. No file advanced-micro-devices-gpu-cluster-networking.ind. [31] (./advanced-micro-devices-gpu-cluster-networking.aux) LaTeX Warning: There were undefined references. LaTeX Warning: Label(s) may have changed. Rerun to get cross-references right. Package rerunfilecheck Warning: File `advanced-micro-devices-gpu-cluster-networ king.out' has changed. (rerunfilecheck) Rerun to get outlines right (rerunfilecheck) or use package `bookmark'. ) (see the transcript file for additional information){/usr/share/texmf/fonts/enc /dvips/tex-gyre/q-ec.enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/base/8r .enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free2.enc}{ /usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free1.enc}{/usr/s hare/texmf/fonts/enc/dvips/tex-gyre/q-ts1.enc} Output written on advanced-micro-devices-gpu-cluster-networking.pdf (35 pages, 345223 bytes). Transcript written on advanced-micro-devices-gpu-cluster-networking.log. Latexmk: Index file 'advanced-micro-devices-gpu-cluster-networking.idx' was written Latexmk: Missing input file 'advanced-micro-devices-gpu-cluster-networking.ind' (or dependence on it) from following: 'No file advanced-micro-devices-gpu-cluster-networking.ind.' Latexmk: References changed. Latexmk: References changed. Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Rule 'makeindex advanced-micro-devices-gpu-cluster-networking.idx': File changes, etc: Changed files, or newly in use since previous run(s): 'advanced-micro-devices-gpu-cluster-networking.idx' ------------ Run number 1 of rule 'makeindex advanced-micro-devices-gpu-cluster-networking.idx' ------------ ------------ Running 'makeindex -s python.ist -o "advanced-micro-devices-gpu-cluster-networking.ind" "advanced-micro-devices-gpu-cluster-networking.idx"' ------------ Latexmk: Examining 'advanced-micro-devices-gpu-cluster-networking.log' === TeX engine is 'pdfTeX' Latexmk: applying rule 'makeindex advanced-micro-devices-gpu-cluster-networking.idx'... This is makeindex, version 2.15 [TeX Live 2022/dev] (kpathsea + Thai support). Scanning style file ./python.ist.......done (7 attributes redefined, 0 ignored). Scanning input file advanced-micro-devices-gpu-cluster-networking.idx...done (0 entries accepted, 0 rejected). Nothing written in advanced-micro-devices-gpu-cluster-networking.ind. Transcript written in advanced-micro-devices-gpu-cluster-networking.ilg. Rule 'pdflatex': File changes, etc: Changed files, or newly in use since previous run(s): 'advanced-micro-devices-gpu-cluster-networking.aux' 'advanced-micro-devices-gpu-cluster-networking.ind' 'advanced-micro-devices-gpu-cluster-networking.out' ------------ Run number 2 of rule 'pdflatex' ------------ ------------ Running 'pdflatex -interaction=nonstopmode -recorder --jobname="advanced-micro-devices-gpu-cluster-networking" "gpuclusternetworkingdocumentation.tex"' ------------ Latexmk: applying rule 'pdflatex'... This is pdfTeX, Version 3.141592653-2.6-1.40.22 (TeX Live 2022/dev/Debian) (preloaded format=pdflatex) restricted \write18 enabled. entering extended mode (./gpuclusternetworkingdocumentation.tex LaTeX2e <2021-11-15> patch level 1 L3 programming layer <2022-01-21> (./sphinxmanual.cls Document Class: sphinxmanual 2019/12/01 v2.3.0 Document class (Sphinx manual) (/usr/share/texlive/texmf-dist/tex/latex/base/report.cls Document Class: report 2021/10/04 v1.4n Standard LaTeX document class (/usr/share/texlive/texmf-dist/tex/latex/base/size10.clo))) (/usr/share/texlive/texmf-dist/tex/latex/base/inputenc.sty) (/usr/share/texlive/texmf-dist/tex/latex/cmap/cmap.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/fontenc.sty<>) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amssymb.sty (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texlive/texmf-dist/tex/generic/babel/babel.sty (/usr/share/texlive/texmf-dist/tex/generic/babel/txtbabel.def) (/usr/share/texlive/texmf-dist/tex/generic/babel-english/english.ldf)) (/usr/share/texmf/tex/latex/tex-gyre/tgtermes.sty (/usr/share/texlive/texmf-dist/tex/latex/kvoptions/kvoptions.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/keyval.sty) (/usr/share/texlive/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty) (/usr/share/texlive/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty))) (/usr/share/texmf/tex/latex/tex-gyre/tgheros.sty) (/usr/share/texlive/texmf-dist/tex/latex/fncychap/fncychap.sty) (./sphinx.sty (/usr/share/texlive/texmf-dist/tex/latex/xcolor/xcolor.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/color.cfg) (/usr/share/texlive/texmf-dist/tex/latex/graphics-def/pdftex.def)) (./sphinxoptionshyperref.sty) (./sphinxoptionsgeometry.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/textcomp.sty) (/usr/share/texlive/texmf-dist/tex/latex/float/float.sty) (/usr/share/texlive/texmf-dist/tex/latex/wrapfig/wrapfig.sty) (/usr/share/texlive/texmf-dist/tex/latex/capt-of/capt-of.sty) (/usr/share/texlive/texmf-dist/tex/latex/tools/multicol.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphicx.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphics.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/trig.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/graphics.cfg))) (./sphinxlatexgraphics.sty) (./sphinxpackageboxes.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.cfg) (/usr/share/texlive/texmf-dist/tex/latex/pict2e/p2e-pdftex.def)) (/usr/share/texlive/texmf-dist/tex/latex/ellipse/ellipse.sty)) (./sphinxlatexadmonitions.sty (/usr/share/texlive/texmf-dist/tex/latex/framed/framed.sty) (./sphinxpackagefootnote.sty)) (./sphinxlatexliterals.sty (/usr/share/texlive/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/alltt.sty) (/usr/share/texlive/texmf-dist/tex/latex/upquote/upquote.sty) (/usr/share/texlive/texmf-dist/tex/latex/needspace/needspace.sty)) (./sphinxlatexshadowbox.sty) (./sphinxlatexcontainers.sty) (./sphinxhighlight.sty) (./sphinxlatextables.sty (/usr/share/texlive/texmf-dist/tex/latex/tabulary/tabulary.sty (/usr/share/texlive/texmf-dist/tex/latex/tools/array.sty)) (/usr/share/texlive/texmf-dist/tex/latex/tools/longtable.sty) (/usr/share/texlive/texmf-dist/tex/latex/varwidth/varwidth.sty) (/usr/share/texlive/texmf-dist/tex/latex/colortbl/colortbl.sty) (/usr/share/texlive/texmf-dist/tex/latex/booktabs/booktabs.sty)) (./sphinxlatexnumfig.sty) (./sphinxlatexlists.sty) (./sphinxlatexindbibtoc.sty (/usr/share/texlive/texmf-dist/tex/latex/base/makeidx.sty)) (./sphinxlatexstylepage.sty (/usr/share/texlive/texmf-dist/tex/latex/parskip/parskip.sty (/usr/share/texlive/texmf-dist/tex/latex/etoolbox/etoolbox.sty)) (/usr/share/texlive/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty)) (./sphinxlatexstyleheadings.sty (/usr/share/texlive/texmf-dist/tex/latex/titlesec/titlesec.sty)) (./sphinxlatexstyletext.sty) (./sphinxlatexobjects.sty)) (/usr/share/texlive/texmf-dist/tex/latex/geometry/geometry.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/ifvtex.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/iftex.sty))) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref.sty (/usr/share/texlive/texmf-dist/tex/generic/pdftexcmds/pdftexcmds.sty (/usr/share/texlive/texmf-dist/tex/generic/infwarerr/infwarerr.sty)) (/usr/share/texlive/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty) (/usr/share/texlive/texmf-dist/tex/generic/pdfescape/pdfescape.sty) (/usr/share/texlive/texmf-dist/tex/latex/hycolor/hycolor.sty) (/usr/share/texlive/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty) (/usr/share/texlive/texmf-dist/tex/latex/auxhook/auxhook.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/pd1enc.def) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref-langpatches.def) (/usr/share/texlive/texmf-dist/tex/generic/intcalc/intcalc.sty) (/usr/share/texlive/texmf-dist/tex/generic/etexcmds/etexcmds.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/puenc.def) (/usr/share/texlive/texmf-dist/tex/latex/url/url.sty) (/usr/share/texlive/texmf-dist/tex/generic/bitset/bitset.sty (/usr/share/texlive/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty)) (/usr/share/texlive/texmf-dist/tex/latex/base/atbegshi-ltx.sty)) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hpdftex.def (/usr/share/texlive/texmf-dist/tex/latex/base/atveryend-ltx.sty) (/usr/share/texlive/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty (/usr/share/texlive/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty))) (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/hypcap.sty) (./sphinxmessages.sty) Writing index file advanced-micro-devices-gpu-cluster-networking.idx (/usr/share/texmf/tex/latex/tex-gyre/t1qtm.fd) (/usr/share/texlive/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def) (./advanced-micro-devices-gpu-cluster-networking.aux) (/usr/share/texlive/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] ) (/usr/share/texlive/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg)) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5.sty (/usr/share/texlive/texmf-dist/tex/latex/l3kernel/expl3.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/l3keys2e/l3keys2e.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/xparse/xparse.sty) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-generic-help er.sty (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-mapping.def) )) *geometry* driver: auto-detecting *geometry* detected driver: pdftex (/usr/share/texlive/texmf-dist/tex/latex/hyperref/nameref.sty (/usr/share/texlive/texmf-dist/tex/latex/refcount/refcount.sty) (/usr/share/texlive/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty)) (./advanced-micro-devices-gpu-cluster-networking.out) (./advanced-micro-devices-gpu-cluster-networking.out) Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\spacefactor' on input line 81. Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\@m' on input line 81. (/usr/share/texmf/tex/latex/tex-gyre/t1qhv.fd)<><><><> (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsa.fd) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsb.fd) [1{/var/lib/texmf/fo nts/map/pdftex/updmap/pdftex.map}] [2] (./advanced-micro-devices-gpu-cluster-networking.toc [1]) [2] (/usr/share/texmf/tex/latex/tex-gyre/ts1qtm.fd) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree1.fd) [1] [2] Chapter 1. (/usr/share/texlive/texmf-dist/tex/latex/txfonts/t1txtt.fd) [3] (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree2.fd) [4] [5] [6] [7] (/usr/share/texlive/texmf-dist/tex/latex/txfonts/ts1txtt.fd) [8] Overfull \hbox (186.49307pt too wide) in paragraph at lines 807--807 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \hbox (186.49307pt too wide) in paragraph at lines 819--819 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \vbox (2.84605pt too high) detected at line 832 [9] [10] Underfull \vbox (badness 10000) detected at line 942 Underfull \vbox (badness 10000) detected at line 942 [11] [12] [13] Underfull \vbox (badness 10000) detected at line 1098 Underfull \vbox (badness 10000) detected at line 1098 [14] Overfull \vbox (2.3893pt too high) detected at line 1152 [15] Overfull \vbox (2.3893pt too high) detected at line 1200 [16] [17] [18] Chapter 2. [19] [20] [21] [22] [23] [24 <./D2D-perftest-multithread.png>] Underfull \vbox (badness 10000) detected at line 1959 Underfull \vbox (badness 10000) detected at line 1959 [25] [26] Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 []|\T1/txtt/m/n/10 /$OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mc a spml Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allreduce []d Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_alltoall []d Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allgather []d Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ [27] Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun []mca oob_tcp_if_exclude docker,lo []mc a Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 btl_tcp_if_exclude docker,lo []host {HOST1}:8,{HOST2}:8 []np Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 16 []x LD_LIBRARY_PATH=/opt/rccl/build/rccl/install/lib:/ Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 opt/ompi/lib []x NCCL_IB_GID_INDEX=3 []x NCCL_DEBUG=VERSION Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []\T1/txtt/m/n/10 x NCCL_IB_HCA=bnxt_re0,bnxt_re1,bnxt_re2,bnxt_re3,bnxt_re4, Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 bnxt_re5,bnxt_re6,bnxt_re7 []x NCCL_IGNORE_CPU_AFFINITY=1 [28] [29] [30] Chapter 3. (./advanced-micro-devices-gpu-cluster-networking.ind) [31] (./advanced-micro-devices-gpu-cluster-networking.aux) ) (see the transcript file for additional information){/usr/share/texmf/fonts/enc /dvips/tex-gyre/q-ec.enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/base/8r .enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free2.enc}{ /usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free1.enc}{/usr/s hare/texmf/fonts/enc/dvips/tex-gyre/q-ts1.enc} Output written on advanced-micro-devices-gpu-cluster-networking.pdf (35 pages, 353422 bytes). Transcript written on advanced-micro-devices-gpu-cluster-networking.log. Latexmk: Index file 'advanced-micro-devices-gpu-cluster-networking.idx' was written Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Rule 'pdflatex': File changes, etc: Changed files, or newly in use since previous run(s): 'advanced-micro-devices-gpu-cluster-networking.toc' ------------ Run number 3 of rule 'pdflatex' ------------ ------------ Running 'pdflatex -interaction=nonstopmode -recorder --jobname="advanced-micro-devices-gpu-cluster-networking" "gpuclusternetworkingdocumentation.tex"' ------------ Latexmk: Examining 'advanced-micro-devices-gpu-cluster-networking.log' === TeX engine is 'pdfTeX' Latexmk: applying rule 'pdflatex'... This is pdfTeX, Version 3.141592653-2.6-1.40.22 (TeX Live 2022/dev/Debian) (preloaded format=pdflatex) restricted \write18 enabled. entering extended mode (./gpuclusternetworkingdocumentation.tex LaTeX2e <2021-11-15> patch level 1 L3 programming layer <2022-01-21> (./sphinxmanual.cls Document Class: sphinxmanual 2019/12/01 v2.3.0 Document class (Sphinx manual) (/usr/share/texlive/texmf-dist/tex/latex/base/report.cls Document Class: report 2021/10/04 v1.4n Standard LaTeX document class (/usr/share/texlive/texmf-dist/tex/latex/base/size10.clo))) (/usr/share/texlive/texmf-dist/tex/latex/base/inputenc.sty) (/usr/share/texlive/texmf-dist/tex/latex/cmap/cmap.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/fontenc.sty<>) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsmath.sty For additional information on amsmath, use the `?' option. (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amstext.sty (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsgen.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsbsy.sty) (/usr/share/texlive/texmf-dist/tex/latex/amsmath/amsopn.sty)) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amssymb.sty (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/amsfonts.sty)) (/usr/share/texlive/texmf-dist/tex/generic/babel/babel.sty (/usr/share/texlive/texmf-dist/tex/generic/babel/txtbabel.def) (/usr/share/texlive/texmf-dist/tex/generic/babel-english/english.ldf)) (/usr/share/texmf/tex/latex/tex-gyre/tgtermes.sty (/usr/share/texlive/texmf-dist/tex/latex/kvoptions/kvoptions.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/keyval.sty) (/usr/share/texlive/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty) (/usr/share/texlive/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty))) (/usr/share/texmf/tex/latex/tex-gyre/tgheros.sty) (/usr/share/texlive/texmf-dist/tex/latex/fncychap/fncychap.sty) (./sphinx.sty (/usr/share/texlive/texmf-dist/tex/latex/xcolor/xcolor.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/color.cfg) (/usr/share/texlive/texmf-dist/tex/latex/graphics-def/pdftex.def)) (./sphinxoptionshyperref.sty) (./sphinxoptionsgeometry.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/textcomp.sty) (/usr/share/texlive/texmf-dist/tex/latex/float/float.sty) (/usr/share/texlive/texmf-dist/tex/latex/wrapfig/wrapfig.sty) (/usr/share/texlive/texmf-dist/tex/latex/capt-of/capt-of.sty) (/usr/share/texlive/texmf-dist/tex/latex/tools/multicol.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphicx.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/graphics.sty (/usr/share/texlive/texmf-dist/tex/latex/graphics/trig.sty) (/usr/share/texlive/texmf-dist/tex/latex/graphics-cfg/graphics.cfg))) (./sphinxlatexgraphics.sty) (./sphinxpackageboxes.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.sty (/usr/share/texlive/texmf-dist/tex/latex/pict2e/pict2e.cfg) (/usr/share/texlive/texmf-dist/tex/latex/pict2e/p2e-pdftex.def)) (/usr/share/texlive/texmf-dist/tex/latex/ellipse/ellipse.sty)) (./sphinxlatexadmonitions.sty (/usr/share/texlive/texmf-dist/tex/latex/framed/framed.sty) (./sphinxpackagefootnote.sty)) (./sphinxlatexliterals.sty (/usr/share/texlive/texmf-dist/tex/latex/fancyvrb/fancyvrb.sty) (/usr/share/texlive/texmf-dist/tex/latex/base/alltt.sty) (/usr/share/texlive/texmf-dist/tex/latex/upquote/upquote.sty) (/usr/share/texlive/texmf-dist/tex/latex/needspace/needspace.sty)) (./sphinxlatexshadowbox.sty) (./sphinxlatexcontainers.sty) (./sphinxhighlight.sty) (./sphinxlatextables.sty (/usr/share/texlive/texmf-dist/tex/latex/tabulary/tabulary.sty (/usr/share/texlive/texmf-dist/tex/latex/tools/array.sty)) (/usr/share/texlive/texmf-dist/tex/latex/tools/longtable.sty) (/usr/share/texlive/texmf-dist/tex/latex/varwidth/varwidth.sty) (/usr/share/texlive/texmf-dist/tex/latex/colortbl/colortbl.sty) (/usr/share/texlive/texmf-dist/tex/latex/booktabs/booktabs.sty)) (./sphinxlatexnumfig.sty) (./sphinxlatexlists.sty) (./sphinxlatexindbibtoc.sty (/usr/share/texlive/texmf-dist/tex/latex/base/makeidx.sty)) (./sphinxlatexstylepage.sty (/usr/share/texlive/texmf-dist/tex/latex/parskip/parskip.sty (/usr/share/texlive/texmf-dist/tex/latex/etoolbox/etoolbox.sty)) (/usr/share/texlive/texmf-dist/tex/latex/fancyhdr/fancyhdr.sty)) (./sphinxlatexstyleheadings.sty (/usr/share/texlive/texmf-dist/tex/latex/titlesec/titlesec.sty)) (./sphinxlatexstyletext.sty) (./sphinxlatexobjects.sty)) (/usr/share/texlive/texmf-dist/tex/latex/geometry/geometry.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/ifvtex.sty (/usr/share/texlive/texmf-dist/tex/generic/iftex/iftex.sty))) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref.sty (/usr/share/texlive/texmf-dist/tex/generic/pdftexcmds/pdftexcmds.sty (/usr/share/texlive/texmf-dist/tex/generic/infwarerr/infwarerr.sty)) (/usr/share/texlive/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty) (/usr/share/texlive/texmf-dist/tex/generic/pdfescape/pdfescape.sty) (/usr/share/texlive/texmf-dist/tex/latex/hycolor/hycolor.sty) (/usr/share/texlive/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty) (/usr/share/texlive/texmf-dist/tex/latex/auxhook/auxhook.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/pd1enc.def) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hyperref-langpatches.def) (/usr/share/texlive/texmf-dist/tex/generic/intcalc/intcalc.sty) (/usr/share/texlive/texmf-dist/tex/generic/etexcmds/etexcmds.sty) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/puenc.def) (/usr/share/texlive/texmf-dist/tex/latex/url/url.sty) (/usr/share/texlive/texmf-dist/tex/generic/bitset/bitset.sty (/usr/share/texlive/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty)) (/usr/share/texlive/texmf-dist/tex/latex/base/atbegshi-ltx.sty)) (/usr/share/texlive/texmf-dist/tex/latex/hyperref/hpdftex.def (/usr/share/texlive/texmf-dist/tex/latex/base/atveryend-ltx.sty) (/usr/share/texlive/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty (/usr/share/texlive/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty))) (/usr/share/texlive/texmf-dist/tex/latex/oberdiek/hypcap.sty) (./sphinxmessages.sty) Writing index file advanced-micro-devices-gpu-cluster-networking.idx (/usr/share/texmf/tex/latex/tex-gyre/t1qtm.fd) (/usr/share/texlive/texmf-dist/tex/latex/l3backend/l3backend-pdftex.def) (./advanced-micro-devices-gpu-cluster-networking.aux) (/usr/share/texlive/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] ) (/usr/share/texlive/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty (/usr/share/texlive/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg)) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5.sty (/usr/share/texlive/texmf-dist/tex/latex/l3kernel/expl3.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/l3keys2e/l3keys2e.sty) (/usr/share/texlive/texmf-dist/tex/latex/l3packages/xparse/xparse.sty) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-generic-help er.sty (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/fontawesome5-mapping.def) )) *geometry* driver: auto-detecting *geometry* detected driver: pdftex (/usr/share/texlive/texmf-dist/tex/latex/hyperref/nameref.sty (/usr/share/texlive/texmf-dist/tex/latex/refcount/refcount.sty) (/usr/share/texlive/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty)) (./advanced-micro-devices-gpu-cluster-networking.out) (./advanced-micro-devices-gpu-cluster-networking.out) Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\spacefactor' on input line 81. Package hyperref Warning: Token not allowed in a PDF string (Unicode): (hyperref) removing `\@m' on input line 81. (/usr/share/texmf/tex/latex/tex-gyre/t1qhv.fd)<><><><> (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsa.fd) (/usr/share/texlive/texmf-dist/tex/latex/amsfonts/umsb.fd) [1{/var/lib/texmf/fo nts/map/pdftex/updmap/pdftex.map}] [2] (./advanced-micro-devices-gpu-cluster-networking.toc [1]) [2] (/usr/share/texmf/tex/latex/tex-gyre/ts1qtm.fd) (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree1.fd) [1] [2] Chapter 1. (/usr/share/texlive/texmf-dist/tex/latex/txfonts/t1txtt.fd) [3] (/usr/share/texlive/texmf-dist/tex/latex/fontawesome5/ufontawesomefree2.fd) [4] [5] [6] [7] (/usr/share/texlive/texmf-dist/tex/latex/txfonts/ts1txtt.fd) [8] Overfull \hbox (186.49307pt too wide) in paragraph at lines 807--807 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \hbox (186.49307pt too wide) in paragraph at lines 819--819 []|[]\T1/txtt/m/n/10 ========================================================== ===================================================================[]| Overfull \vbox (2.84605pt too high) detected at line 832 [9] [10] Underfull \vbox (badness 10000) detected at line 942 Underfull \vbox (badness 10000) detected at line 942 [11] [12] [13] Underfull \vbox (badness 10000) detected at line 1098 Underfull \vbox (badness 10000) detected at line 1098 [14] Overfull \vbox (2.3893pt too high) detected at line 1152 [15] Overfull \vbox (2.3893pt too high) detected at line 1200 [16] [17] [18] Chapter 2. [19] [20] [21] [22] [23] [24 <./D2D-perftest-multithread.png>] Underfull \vbox (badness 10000) detected at line 1959 Underfull \vbox (badness 10000) detected at line 1959 [25] [26] Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2014--2017 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2021--2024 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2028--2031 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 []|\T1/txtt/m/n/10 /$OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mc a spml Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2035--2038 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 []|\T1/txtt/m/n/10 $OMPI_DIR/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 0 [][]bind[]to none []np 2 []host , []x Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 UCX_TLS=all []x MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 Underfull \hbox (badness 10000) in paragraph at lines 2042--2045 \T1/txtt/m/n/10 numactl [][]localalloc $OSU_DIR/libexec/osu[]micro[]benchmarks/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2076--2079 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allreduce []d Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2083--2086 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2090--2093 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_alltoall []d Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2097--2100 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 [][]\T1/txtt/m/n/10 mca spml ucx [][]mca btl ^self,vader,openib [][]mca Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 coll_hcoll_enable 0 [][]bind[]to none []np 2 []host 10.1. Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 10.110,10.1.10.72 []x UCX_TLS=all []x MV2_USE_ROCM=1 []x Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 HIP_VISIBLE_DEVICES=1 numactl [][]localalloc /opt/osu[]7.3/ Underfull \hbox (badness 10000) in paragraph at lines 2104--2107 \T1/txtt/m/n/10 libexec/osu[]micro[]benchmarks/mpi/collective/osu_allgather []d Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun [][]mca pml ucx [][]mca osc ucx [][]mca spml Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 ucx [][]mca btl ^self,vader,openib [][]mca coll_hcoll_enable 0 Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 [][]\T1/txtt/m/n/10 bind[]to none []np 16 []hostfile ./hostfile []x UCX_TLS=all []x Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 MV2_USE_ROCM=1 []x HIP_VISIBLE_DEVICES=1 numactl [][]localalloc Underfull \hbox (badness 10000) in paragraph at lines 2111--2114 \T1/txtt/m/n/10 /opt/osu[]7.3/libexec/osu[]micro[]benchmarks/mpi/collective/ [27] Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []|\T1/txtt/m/n/10 /opt/ompi/bin/mpirun []mca oob_tcp_if_exclude docker,lo []mc a Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 btl_tcp_if_exclude docker,lo []host {HOST1}:8,{HOST2}:8 []np Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 16 []x LD_LIBRARY_PATH=/opt/rccl/build/rccl/install/lib:/ Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 opt/ompi/lib []x NCCL_IB_GID_INDEX=3 []x NCCL_DEBUG=VERSION Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 []\T1/txtt/m/n/10 x NCCL_IB_HCA=bnxt_re0,bnxt_re1,bnxt_re2,bnxt_re3,bnxt_re4, Underfull \hbox (badness 10000) in paragraph at lines 2138--2141 \T1/txtt/m/n/10 bnxt_re5,bnxt_re6,bnxt_re7 []x NCCL_IGNORE_CPU_AFFINITY=1 [28] [29] [30] Chapter 3. (./advanced-micro-devices-gpu-cluster-networking.ind) [31] (./advanced-micro-devices-gpu-cluster-networking.aux) ) (see the transcript file for additional information){/usr/share/texmf/fonts/enc /dvips/tex-gyre/q-ec.enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/base/8r .enc}{/usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free2.enc}{ /usr/share/texlive/texmf-dist/fonts/enc/dvips/fontawesome5/fa5free1.enc}{/usr/s hare/texmf/fonts/enc/dvips/tex-gyre/q-ts1.enc} Output written on advanced-micro-devices-gpu-cluster-networking.pdf (35 pages, 353422 bytes). Transcript written on advanced-micro-devices-gpu-cluster-networking.log. Latexmk: Index file 'advanced-micro-devices-gpu-cluster-networking.idx' was written Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Latexmk: Log file says output to 'advanced-micro-devices-gpu-cluster-networking.pdf' Latexmk: Examining 'advanced-micro-devices-gpu-cluster-networking.log' === TeX engine is 'pdfTeX' Latexmk: All targets (advanced-micro-devices-gpu-cluster-networking.pdf) are up-to-date [rtd-command-info] start-time: 2024-12-05T00:47:53.414732Z, end-time: 2024-12-05T00:47:56.162005Z, duration: 2, exit-code: 0 python -mvirtualenv $READTHEDOCS_VIRTUALENV_PATH created virtual environment CPython3.10.15.final.0-64 in 1709ms creator CPython3Posix(dest=/home/docs/checkouts/readthedocs.org/user_builds/advanced-micro-devices-gpu-cluster-networking/envs/latest, clear=False, no_vcs_ignore=False, global=False) seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/home/docs/.local/share/virtualenv) added seed packages: pip==23.1, setuptools==67.6.1, wheel==0.40.0 activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator