February 2020 - Dev - lists.clearlinux.org

[PATCHv2 filesystem] Use the parent process's PATH

by William Douglas

It is unexpected based on user feedback to completely reset the PATH. Instead attempt to fixup the PATH to contain what we expect (and remove the /bin, /sbin, /usr/sbin bits from systemd). Should resolve #1033 --- profile.x86_64 | 39 ++++++++++++++++++++++++++++++++++----- 1 file changed, 34 insertions(+), 5 deletions(-) diff --git a/profile.x86_64 b/profile.x86_64 index d8b500e..f308fe9 100644 --- a/profile.x86_64 +++ b/profile.x86_64 @@ -1,15 +1,44 @@ # /etc/profile: system-wide .profile file for the Bourne shell (sh(1)) # and Bourne compatible shells (bash(1), ksh(1), ash(1), ...). -PATH="/usr/bin" +# Add /usr/bin, the avx2/avx512 bin paths and 3rd-party bin path to PATH as needed +# Then cleanup symlink paths +case ":${PATH:-}:" in + *:/usr/bin:*) ;; + *) PATH="/usr/bin${PATH:+:$PATH}" ;; +esac + if grep -q "flags.*:.* avx512bw" /proc/cpuinfo; then - PATH="/usr/bin/haswell/avx512_1:/usr/bin/haswell:/usr/bin" + case ":${PATH:-}:" in + *:/usr/bin/haswell/avx512_1:*) ;; + *) PATH="/usr/bin/haswell/avx512_1:/usr/bin/haswell:$PATH" ;; + esac elif grep -q "flags.*:.* fma .* avx2" /proc/cpuinfo; then - PATH="/usr/bin/haswell:/usr/bin" + case ":${PATH:-}:" in + *:/usr/bin/haswell:*) ;; + *) PATH="/usr/bin/haswell:$PATH" ;; + esac fi -PATH="/usr/local/bin:$PATH:/opt/3rd-party/bin" +case ":${PATH:-}:" in + *:/usr/local/bin:*) ;; + *) PATH="/usr/local/bin:$PATH" ;; +esac +case ":${PATH:-}:" in + *:/opt/3rd-party/bin:*) ;; + *) PATH="$PATH:/opt/3rd-party/bin" ;; +esac +# Remove from beginning/end/middle of PATH +PATH="${PATH/#\/bin:}" +PATH="${PATH/%:\/bin}" +PATH="${PATH/:\/bin:/:}" +PATH="${PATH/#\/sbin:}" +PATH="${PATH/%:\/sbin}" +PATH="${PATH/:\/sbin:/:}" +PATH="${PATH/#\/usr\/sbin:}" +PATH="${PATH/%:\/usr\/sbin}" +PATH="${PATH/:\/usr\/sbin:/:}" -if [[ -x "/bin/vi" ]]; then +if [[ -x "/bin/vi" ]]; then EDITOR="/usr/bin/vi" # needed for packages like cron else EDITOR="/usr/bin/nano" # needed for packages like cron -- 2.25.1

3 years, 2 months

2
1
0 0

[PATCH filesystem] Use the parent process's PATH

by William Douglas

It is unexpected based on user feedback to completely reset the PATH. Instead attempt to fixup the PATH to contain what we expect (and remove the /bin, /sbin, /usr/sbin bits from systemd). Should resolve #1033 --- profile.i386 | 2 +- profile.x86_64 | 39 ++++++++++++++++++++++++++++++++++----- 2 files changed, 35 insertions(+), 6 deletions(-) diff --git a/profile.i386 b/profile.i386 index 558dc86..b4a4185 100644 --- a/profile.i386 +++ b/profile.i386 @@ -1,7 +1,7 @@ # /etc/profile: system-wide .profile file for the Bourne shell (sh(1)) # and Bourne compatible shells (bash(1), ksh(1), ash(1), ...). -PATH="/usr/local/bin:/usr/bin" +PATH="/usr/local/bin:/usr/bin:$PATH" EDITOR="/usr/bin/nano" # needed for packages like cron test -z "$TERM" && TERM="xterm" # Basic terminal capab. For screen etc. diff --git a/profile.x86_64 b/profile.x86_64 index d8b500e..f308fe9 100644 --- a/profile.x86_64 +++ b/profile.x86_64 @@ -1,15 +1,44 @@ # /etc/profile: system-wide .profile file for the Bourne shell (sh(1)) # and Bourne compatible shells (bash(1), ksh(1), ash(1), ...). -PATH="/usr/bin" +# Add /usr/bin, the avx2/avx512 bin paths and 3rd-party bin path to PATH as needed +# Then cleanup symlink paths +case ":${PATH:-}:" in + *:/usr/bin:*) ;; + *) PATH="/usr/bin${PATH:+:$PATH}" ;; +esac + if grep -q "flags.*:.* avx512bw" /proc/cpuinfo; then - PATH="/usr/bin/haswell/avx512_1:/usr/bin/haswell:/usr/bin" + case ":${PATH:-}:" in + *:/usr/bin/haswell/avx512_1:*) ;; + *) PATH="/usr/bin/haswell/avx512_1:/usr/bin/haswell:$PATH" ;; + esac elif grep -q "flags.*:.* fma .* avx2" /proc/cpuinfo; then - PATH="/usr/bin/haswell:/usr/bin" + case ":${PATH:-}:" in + *:/usr/bin/haswell:*) ;; + *) PATH="/usr/bin/haswell:$PATH" ;; + esac fi -PATH="/usr/local/bin:$PATH:/opt/3rd-party/bin" +case ":${PATH:-}:" in + *:/usr/local/bin:*) ;; + *) PATH="/usr/local/bin:$PATH" ;; +esac +case ":${PATH:-}:" in + *:/opt/3rd-party/bin:*) ;; + *) PATH="$PATH:/opt/3rd-party/bin" ;; +esac +# Remove from beginning/end/middle of PATH +PATH="${PATH/#\/bin:}" +PATH="${PATH/%:\/bin}" +PATH="${PATH/:\/bin:/:}" +PATH="${PATH/#\/sbin:}" +PATH="${PATH/%:\/sbin}" +PATH="${PATH/:\/sbin:/:}" +PATH="${PATH/#\/usr\/sbin:}" +PATH="${PATH/%:\/usr\/sbin}" +PATH="${PATH/:\/usr\/sbin:/:}" -if [[ -x "/bin/vi" ]]; then +if [[ -x "/bin/vi" ]]; then EDITOR="/usr/bin/vi" # needed for packages like cron else EDITOR="/usr/bin/nano" # needed for packages like cron -- 2.25.0

3 years, 2 months

4
4
0 0

[PATCH clr-bundles] haskell-basic: add dependencies so that ghc work

by Ross Burton

Using ghc directly doesn't work out of the box with haskell-basic, first Rts.h and friends are needed to compile and then libnuma.so is needed to link. Add the providers of these files (ghc-dev and devpkg-numa, respectively) to the bundle. Closes #929 --- bundles/haskell-basic | 2 ++ 1 file changed, 2 insertions(+) diff --git a/bundles/haskell-basic b/bundles/haskell-basic index 7a9de395..3a00b19a 100644 --- a/bundles/haskell-basic +++ b/bundles/haskell-basic @@ -7,6 +7,7 @@ # stack ends up using gcc, make, xz, perl, libgmp, libffi and zlib include(c-basic) include(devpkg-zlib) +include(devpkg-numa) include(git) include(make) include(p11-kit) @@ -16,6 +17,7 @@ automake gcc gcc-dev ghc +ghc-dev glibc-dev gmp-dev ncurses-lib -- 2.25.1

3 years, 2 months

2
1
0 0

Re: [PATCH filesystem] Use the parent process's PATH

by Lucius

This does fix the issue in #1033 but there is one potential compatibility issue. I can understand if this is not of high priority for now but it's worth mentioning for future reference. `profile.x86_64` is installed as `/usr/share/defaults/etc/profile` and that is sourced by `~/.bashrc`, which in turn is sourced by `~/.profile`, so this file would be sourced strict POSIX compatible shells that doesn't support Bash features. Notably, (1) `[[` is not supported in POSIX and (2) supported parameter expansions are limited. (See https://pubs.opengroup.org/onlinepubs/9699919799/utilities/V3_chap02.html#t…) Suppose a user built `dash` and other strict POSIX shells, and made it a login shell, upon sourcing `/usr/share/defaults/etc/profile`, error would occur and `PATH` env variable won't be set up correctly.

3 years, 3 months

1
0
0 0

[PATCH clr-bundles v2] Add `npb` bundle

by Juro Bystricky

NAS Parallel Benchmarks. Set of programs to evaluate the performance of parallel computers. --- bundles/npb | 14 ++++++++++++++ packages.list | 1 + 2 files changed, 15 insertions(+) create mode 100644 bundles/npb diff --git a/bundles/npb b/bundles/npb new file mode 100644 index 00000000..9c81d87c --- /dev/null +++ b/bundles/npb @@ -0,0 +1,14 @@ +# [TITLE]: npb +# [DESCRIPTION]: NAS Parallel Benchmarks +# [STATUS]: Active +# [CAPABILITIES]: +# [TAGS]: Tools and Utilities +# [MAINTAINER]: Juro Bystricky <juro.bystricky(a)intel.com> + + +# start of custom additions (edits outside this area will be removed automatically) +also-add(modules) +# end of custom additions + +# main package +npb diff --git a/packages.list b/packages.list index 661c5b98..fda42fa0 100644 --- a/packages.list +++ b/packages.list @@ -431,3 +431,4 @@ vifm # A filemanager for the console with VIM like keybindings and control. qt5ct # Qt 5 configuration tool independent of desktops rlwrap # Another readline wrapper pcs # No detailed summary available +npb # NAS Parallel Benchmarks -- 2.25.1

3 years, 3 months

2
1
0 0

Re: [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle.

by Bystricky

________________________________________ > Improving discoverability is something I am interested in. For that > though I'd like to make more use of swupd's alias feature (man > swupd-alias for more details here) but we haven't really started down > that path yet. Would be nice if we could do something like: $ sudo swupd bundle-list --all --verbose Where each bundle description would be displayed as well. > ________________________________________ > From: Douglas, William [william.douglas(a)intel.com] > Sent: Thursday, February 27, 2020 11:27 AM > To: Bystricky, Juro > Cc: dev(a)lists.clearlinux.org > Subject: Re: [Clr-dev] [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle. > > I'd prefer to keep the bundle name matching the the package name (ala > make bundle) for this unless this is intended to hold more benchmark > packages in the future. > > On Thu, Feb 27, 2020 at 9:35 AM Juro Bystricky <juro.bystricky(a)intel.com> wrote: > > > > Set of programs to evaluate the performance of parallel computers. > > --- > > bundles/nas-parallel-benchmarks | 10 ++++++++++ > > 1 file changed, 10 insertions(+) > > create mode 100644 bundles/nas-parallel-benchmarks > > > > diff --git a/bundles/nas-parallel-benchmarks b/bundles/nas-parallel-benchmarks > > new file mode 100644 > > index 00000000..ee0dee3d > > --- /dev/null > > +++ b/bundles/nas-parallel-benchmarks > > @@ -0,0 +1,10 @@ > > +# [TITLE]: NAS-Parallel-Benchmarks > > +# [DESCRIPTION]: Set of programs to evaluate the performance of parallel supercomputers > > +# [STATUS]: Active > > +# [CAPABILITIES]: > > +# [TAGS]: Tools and Utilities > > +# [MAINTAINER]: Juro Bystricky <juro.bystricky(a)intel.com> > > + > > +also-add(modules) > > +npb > > + > > -- > > 2.25.1 > > _______________________________________________ > > Dev mailing list -- dev(a)lists.clearlinux.org > > To unsubscribe send an email to dev-leave(a)lists.clearlinux.org

3 years, 3 months

1
0
0 0

Re: [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle.

by Douglas

On Thu, Feb 27, 2020 at 12:04 PM Bystricky, Juro <juro.bystricky(a)intel.com> wrote: > > Thanks William, > the bundle contains all NAS benchmark programs (MPI + OMP), so no plans to add more. > I did consider the bundle name "npb", but I assumed it would be more likely a user would search > for "nas-parallel-benchmarks" than "npb". But I have no strong feelings either way, just that "npb" was > a bit ambiguous. Improving discoverability is something I am interested in. For that though I'd like to make more use of swupd's alias feature (man swupd-alias for more details here) but we haven't really started down that path yet. > I'll send in a new patch, created by "make bundle". > > ________________________________________ > From: Douglas, William [william.douglas(a)intel.com] > Sent: Thursday, February 27, 2020 11:27 AM > To: Bystricky, Juro > Cc: dev(a)lists.clearlinux.org > Subject: Re: [Clr-dev] [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle. > > I'd prefer to keep the bundle name matching the the package name (ala > make bundle) for this unless this is intended to hold more benchmark > packages in the future. > > On Thu, Feb 27, 2020 at 9:35 AM Juro Bystricky <juro.bystricky(a)intel.com> wrote: > > > > Set of programs to evaluate the performance of parallel computers. > > --- > > bundles/nas-parallel-benchmarks | 10 ++++++++++ > > 1 file changed, 10 insertions(+) > > create mode 100644 bundles/nas-parallel-benchmarks > > > > diff --git a/bundles/nas-parallel-benchmarks b/bundles/nas-parallel-benchmarks > > new file mode 100644 > > index 00000000..ee0dee3d > > --- /dev/null > > +++ b/bundles/nas-parallel-benchmarks > > @@ -0,0 +1,10 @@ > > +# [TITLE]: NAS-Parallel-Benchmarks > > +# [DESCRIPTION]: Set of programs to evaluate the performance of parallel supercomputers > > +# [STATUS]: Active > > +# [CAPABILITIES]: > > +# [TAGS]: Tools and Utilities > > +# [MAINTAINER]: Juro Bystricky <juro.bystricky(a)intel.com> > > + > > +also-add(modules) > > +npb > > + > > -- > > 2.25.1 > > _______________________________________________ > > Dev mailing list -- dev(a)lists.clearlinux.org > > To unsubscribe send an email to dev-leave(a)lists.clearlinux.org

3 years, 3 months

1
0
0 0

Re: [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle.

by Bystricky

Thanks William, the bundle contains all NAS benchmark programs (MPI + OMP), so no plans to add more. I did consider the bundle name "npb", but I assumed it would be more likely a user would search for "nas-parallel-benchmarks" than "npb". But I have no strong feelings either way, just that "npb" was a bit ambiguous. I'll send in a new patch, created by "make bundle". ________________________________________ From: Douglas, William [william.douglas(a)intel.com] Sent: Thursday, February 27, 2020 11:27 AM To: Bystricky, Juro Cc: dev(a)lists.clearlinux.org Subject: Re: [Clr-dev] [PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle. I'd prefer to keep the bundle name matching the the package name (ala make bundle) for this unless this is intended to hold more benchmark packages in the future. On Thu, Feb 27, 2020 at 9:35 AM Juro Bystricky <juro.bystricky(a)intel.com> wrote: > > Set of programs to evaluate the performance of parallel computers. > --- > bundles/nas-parallel-benchmarks | 10 ++++++++++ > 1 file changed, 10 insertions(+) > create mode 100644 bundles/nas-parallel-benchmarks > > diff --git a/bundles/nas-parallel-benchmarks b/bundles/nas-parallel-benchmarks > new file mode 100644 > index 00000000..ee0dee3d > --- /dev/null > +++ b/bundles/nas-parallel-benchmarks > @@ -0,0 +1,10 @@ > +# [TITLE]: NAS-Parallel-Benchmarks > +# [DESCRIPTION]: Set of programs to evaluate the performance of parallel supercomputers > +# [STATUS]: Active > +# [CAPABILITIES]: > +# [TAGS]: Tools and Utilities > +# [MAINTAINER]: Juro Bystricky <juro.bystricky(a)intel.com> > + > +also-add(modules) > +npb > + > -- > 2.25.1 > _______________________________________________ > Dev mailing list -- dev(a)lists.clearlinux.org > To unsubscribe send an email to dev-leave(a)lists.clearlinux.org

3 years, 3 months

1
0
0 0

[PATCH clr-bundles] Add `nas-parallel-benchmarks` bundle.

by Juro Bystricky

Set of programs to evaluate the performance of parallel computers. --- bundles/nas-parallel-benchmarks | 10 ++++++++++ 1 file changed, 10 insertions(+) create mode 100644 bundles/nas-parallel-benchmarks diff --git a/bundles/nas-parallel-benchmarks b/bundles/nas-parallel-benchmarks new file mode 100644 index 00000000..ee0dee3d --- /dev/null +++ b/bundles/nas-parallel-benchmarks @@ -0,0 +1,10 @@ +# [TITLE]: NAS-Parallel-Benchmarks +# [DESCRIPTION]: Set of programs to evaluate the performance of parallel supercomputers +# [STATUS]: Active +# [CAPABILITIES]: +# [TAGS]: Tools and Utilities +# [MAINTAINER]: Juro Bystricky <juro.bystricky(a)intel.com> + +also-add(modules) +npb + -- 2.25.1

3 years, 3 months

2
1
0 0

[PATCH clr-bundles] `vim` works just fine without python and perl.

by Auke Kok

Obviously these should not be required. --- bundles/vim | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/bundles/vim b/bundles/vim index 032fbb8d..f0c4bdfb 100644 --- a/bundles/vim +++ b/bundles/vim @@ -5,8 +5,8 @@ # [TAGS]: Productivity, Developer Tools, Editor # [MAINTAINER]: William Douglas <william.douglas(a)intel.com> # Run time requirement as vim is compiled to use libpython -include(python3-basic) -include(perl-basic) +also-add(python3-basic) +also-add(perl-basic) ctags vim vim-fugitive -- 2.25.1

3 years, 3 months

4
4
0 0

2023

2022

2021

2020

2019

2018

2017

2016

2015

Dev February 2020