This is a test version of Biostars. For the public version, visit https://www.biostars.org.
error in pipeline installation dependent on numpy version 1.18.5

Hello everyone

I am working on whole slide imaging data. For this, I am trying to install pipeline available at https://github.com/aetherAI/whole-slide-cnn. All dependency packages are listed in poetry.lock and pyproject.toml.

Approach 1)

For installation, Under conda enviroment, I am using python 3.9. I am running "poetry install" for the packages installation.

"Package operations: 44 installs, 3 updates, 0 removals

  • Installing numpy (1.18.5): Installing...

" 
Error : 
"
 note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for numpy
  Failed to build numpy
  ERROR: Could not build wheels for numpy, which is required to install pyproject.toml-based projects

"

Approach 2)

I also tried to install numpy (specific version 1.18.5) from pip with command pip install numpy==1.18.5 which gives me same error.

"
note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for numpy
Failed to build numpy
ERROR: Could not build wheels for numpy, which is required to install pyproject.toml-based projects
"

Approach 3)

As a third approach, I downloaded wheel file for its installation from .whl file which was downloaded from https://mirrors.aliyun.com/pypi/simple/numpy/ and does not work .

I am working under python 3.9.10 (required by pipeline > 3.9), pip 22.3.1 and poetry 1.3.1

I am struggling from many days. If anyone had encountered same problem in installation of numpy ==1.18.5 , please help me to fix it.

I would appreciate all the suggestions

Thanks in advance

numpy cnn python imaging
• 5,696 views • link
updated by lieven.sterck lieven.sterck • written by Omics data mining Omics data mining

Could you post the whole error log?

• 0 views • link
written by barslmn • barslmn

I tried to post entire error log but due to character limits , I am posting some error lines for approach 1 ...

Installing dependencies from lock file

Package operations: 44 installs, 3 updates, 0 removals

• Installing numpy (1.18.5)

CalledProcessError

Command '['/home/user/.conda/envs/whole/bin/python', '-m', 'pip', 'install', '--use-pep517', '--disable-pip-version-check', '--isolated', '--no-input', '--prefix', '/home/user/.conda/envs/whole', '--no-deps', '/home/user/.cache/pypoetry/artifacts/81/1b/af/c0086d36792c25e4c2b8da18a80c1d462be878dd505571a513f5592c11/numpy-1.18.5.zip']' returned non-zero exit status 1.

at ~/.conda/envs/whole/lib/python3.9/subprocess.py:528 in run 524│ # We don't call process.wait() as .__exit__ does that for us. 525│ raise 526│ retcode = process.poll() 527│ if check and retcode: → 528│ raise CalledProcessError(retcode, process.args, 529│ output=stdout, stderr=stderr) 530│ return CompletedProcess(process.args, retcode, stdout, stderr) 531│ 532│

The following error occurred when trying to handle this error:

EnvCommandError

Command ['/home/user/.conda/envs/whole/bin/python', '-m', 'pip', 'install', '--use-pep517', '--disable-pip-version-check', '--isolated', '--no-input', '--prefix', '/home/user/.conda/envs/whole', '--no-deps', '/home/user/.cache/pypoetry/artifacts/81/1b/af/c0086d36792c25e4c2b8da18a80c1d462be878dd505571a513f5592c11/numpy-1.18.5.zip'] errored with the following return code 1, and output: Processing /home/user/.cache/pypoetry/artifacts/81/1b/af/c0086d36792c25e4c2b8da18a80c1d462be878dd505571a513f5592c11/numpy-1.18.5.zip Installing build dependencies: started Installing build dependencies: finished with status 'done' Getting requirements to build wheel: started Getting requirements to build wheel: finished with status 'done' Preparing metadata (pyproject.toml): started Preparing metadata (pyproject.toml): finished with status 'done' Building wheels for collected packages: numpy Building wheel for numpy (pyproject.toml): started Building wheel for numpy (pyproject.toml): finished with status 'error' error: subprocess-exited-with-error

× Building wheel for numpy (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [601 lines of output]
    Running from numpy source directory.
    /tmp/pip-req-build-ii1anjl7/tools/cythonize.py:75: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
      required_version = LooseVersion('0.29.14')
    /tmp/pip-req-build-ii1anjl7/tools/cythonize.py:77: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead.
      if LooseVersion(cython_version) < required_version:
    numpy/random/_bounded_integers.pxd.in has not changed
    numpy/random/_mt19937.pyx has not changed
    numpy/random/_generator.pyx has not changed
    numpy/random/_philox.pyx has not changed
    numpy/random/_bit_generator.pyx has not changed
    numpy/random/_bounded_integers.pyx.in has not changed
    numpy/random/_common.pyx has not changed
    numpy/random/_sfc64.pyx has not changed
    numpy/random/_pcg64.pyx has not changed
    numpy/random/mtrand.pyx has not changed
    Processing numpy/random/_bounded_integers.pyx
    Cythonizing sources
    blas_opt_info:
    blas_mkl_info:
    customize UnixCCompiler
      libraries mkl_rt not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib', '/usr/lib/']
      NOT AVAILABLE

    blis_info:
      libraries blis not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib', '/usr/lib/']
      NOT AVAILABLE

    openblas_info:
      libraries openblas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib', '/usr/lib/']
      NOT AVAILABLE

    atlas_3_10_blas_threads_info:
    Setting PTATLAS=ATLAS
      libraries tatlas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib/sse2', '/usr/lib', '/usr/lib/sse2', '/usr/lib/']
      NOT AVAILABLE

    atlas_3_10_blas_info:
      libraries satlas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib/sse2', '/usr/lib', '/usr/lib/sse2', '/usr/lib/']
      NOT AVAILABLE

    atlas_blas_threads_info:
    Setting PTATLAS=ATLAS
      libraries ptf77blas,ptcblas,atlas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib/sse2', '/usr/lib', '/usr/lib/sse2', '/usr/lib/']
      NOT AVAILABLE

    atlas_blas_info:
      libraries f77blas,cblas,atlas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64/sse2', '/usr/lib64', '/usr/lib/sse2', '/usr/lib', '/usr/lib/sse2', '/usr/lib/']
      NOT AVAILABLE

    accelerate_info:
      NOT AVAILABLE

    /tmp/pip-req-build-ii1anjl7/numpy/distutils/system_info.py:1896: UserWarning:
        Optimized (vendor) Blas libraries are not found.
        Falls back to netlib Blas library which has worse performance.
        A better performance should be easily gained by switching
        Blas library.
      if self._calc_info(blas):
    blas_info:
      libraries blas not found in ['/home/user/.conda/envs/whole/lib', '/usr/local/lib64', '/usr/local/lib', '/usr/lib64', '/usr/lib', '/usr/lib/']
      NOT AVAILABLE

    /tmp/pip-req-build-ii1anjl7/numpy/distutils/system_info.py:1896: UserWarning:
        Blas (http://www.netlib.org/blas/) libraries not found.
        Directories to search for the libraries can be specified in the
        numpy/distutils/site.cfg file (section [blas]) or by setting
        the BLAS environment variable.
      if self._calc_info(blas):
    blas_src_info:
      NOT AVAILABLE


    atlas_3_10_threads_info:
    Setting PTATLAS=ATLAS
      libraries lapack_atlas not found in /home/user/.conda/envs/whole/lib
      libraries tatlas,tatlas not found in /home/user/.conda/envs/whole/lib
      libraries lapack_atlas not found in /usr/local/lib64
      libraries tatlas,tatlas not found in /usr/local/lib64
      libraries lapack_atlas not found in /usr/local/lib

...... ... .... ...

error: Command "gcc -pthread -B /home/user/.conda/envs/whole/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -fwrapv -O2 -Wall -fPIC -O2 -isystem /home/user/.conda/envs/whole/include -fPIC -O2 -isystem /home/user/.conda/envs/whole/include -fPIC -Ibuild/src.linux-x86_64-3.9/numpy/core/src/common -Inumpy/core/include -Ibuild/src.linux-x86_64-3.9/numpy/core/include/numpy -Inumpy/core/src/common -Inumpy/core/src -Inumpy/core -Inumpy/core/src/npymath -Inumpy/core/src/multiarray -Inumpy/core/src/umath -Inumpy/core/src/npysort -I/home/user/.conda/envs/whole/include/python3.9 -Ibuild/src.linux-x86_64-3.9/numpy/core/src/common -Ibuild/src.linux-x86_64-3.9/numpy/core/src/npymath -c build/src.linux-x86_64-3.9/numpy/core/src/npysort/radixsort.c -o build/temp.linux-x86_64-cpython-39/build/src.linux-x86_64-3.9/numpy/core/src/npysort/radixsort.o -MMD -MF build/temp.linux-x86_64-cpython-39/build/src.linux-x86_64-3.9/numpy/core/src/npysort/radixsort.o.d" failed with exit status 1 [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for numpy

Failed to build numpy ERROR: Could not build wheels for numpy, which is required to install pyproject.toml-based projects

at ~/.conda/envs/whole/lib/python3.9/site-packages/poetry/utils/env.py:1540 in _run 1536│ output = subprocess.check_output( 1537│ command, stderr=subprocess.STDOUT, env=env, kwargs 1538│ ) 1539│ except CalledProcessError as e: → 1540│ raise EnvCommandError(e, input=input_) 1541│ 1542│ return decode(output) 1543│ 1544│ def execute(self, bin: str, *args: str, kwargs: Any) -> int:

The following error occurred when trying to handle this error:

PoetryException

Failed to install /home/user/.cache/pypoetry/artifacts/81/1b/af/c0086d36792c25e4c2b8da18a80c1d462be878dd505571a513f5592c11/numpy-1.18.5.zip

at ~/.conda/envs/whole/lib/python3.9/site-packages/poetry/utils/pip.py:58 in pip_install 54│ 55│ try: 56│ return environment.run_pip(*args) 57│ except EnvCommandError as e: → 58│ raise PoetryException(f"Failed to install {path.as_posix()}") from e 59│

• 0 views • link
written by Omics data mining Omics data mining

It looks like you're missing a dependency. Try installing the blas library for your OS.

• 0 views • link
written by barslmn • barslmn

I installed blas with "conda install blas" within conda enviroment. But I am still getting same error .

• 0 views • link
written by Omics data mining Omics data mining

I installed blas library and also had to define the CFLAGS for numpy as given below and it worked. I was struggling with this error from last two weeks. Thanks alot barslmn!!

CFLAGS=-std=c99 poetry install Installing dependencies from lock file

Package operations: 35 installs, 6 updates, 0 removals

• Updating importlib-metadata (4.11.4 -> 6.0.0)

• Updating numpy (1.18.0 -> 1.18.5)

• Updating h5py (3.7.0 -> 2.10.0): Failed

From poetry install, another package h5py installation failed.

From error log, it says Cython is missing but it is already installed via pip3.

File "/tmp/pip-req-build-al394xe3/setup_build.py", line 161, in run from Cython.Build import cythonize ModuleNotFoundError: No module named 'Cython' [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for h5py

Failed to build h5py ERROR: Could not build wheels for h5py, which is required to install pyproject.toml-based projects

at ~/.conda/envs/whole2/lib/python3.9/site-packages/poetry/utils/env.py:1540 in _run 1536│ output = subprocess.check_output( 1537│ command, stderr=subprocess.STDOUT, env=env, kwargs 1538│ ) 1539│ except CalledProcessError as e: → 1540│ raise EnvCommandError(e, input=input_) 1541│ 1542│ return decode(output) 1543│ 1544│ def execute(self, bin: str, *args: str, kwargs: Any) -> int:

The following error occurred when trying to handle this error:

PoetryException

Failed to install /home/usr/.cache/pypoetry/artifacts/67/73/11/59cd898ab55f65d9213500215b00e663dafb02beb2e48301f1ffc078ae/h5py-2.10.0.tar.gz

This is first time I am working with pacakges installation with poetry (for pipeline installation).

I would appreciate all the suggestion .

• 0 views • link
written by Omics data mining Omics data mining

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for biopython Failed to build biopython ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (biopython)

• 0 views • link
written by ramyqabel • ramyqabel

0 answers

No answers yet.

Log in to answer this question.

More posts like this